Reltio Connect

 View Only
Expand all | Collapse all

With the streaming API, how do we ensure we processed the events in Order?

  • 1.  With the streaming API, how do we ensure we processed the events in Order?

    Posted 07-01-2021 09:22
    This is in regards to #Dataextraction of Reltio #API​​​

    ------------------------------
    Siva Krishna Akuthota
    Advance Auto Parts
    ------------------------------


  • 2.  RE: With the streaming API, how do we ensure we processed the events in Order?
    Best Answer

    Reltio Employee
    Posted 07-01-2021 09:25
    @Siva Krishna Akuthota,

    When we talk about SQS queues, they are asynchronous by nature. They are not first in first out and all the processing in Reltio is asynchronous in nature. When you are reading objects off that queue, you may read an object. You have an object that started at 10:00 a.m. and an object that was at 10:01, you may read the 10:01 object first, based on your listener pulling events off that queue.

    I would look at the object time and the event time in the message to help you understand whether you should process this or whether it is a historical event versus the object that you have today. And so that allows you to still process things in an asynchronous nature while not having to sort these things pre done before you start processing them. So those event timestamps become important in determining how you operate.


    For more information around #dataextraction take a listen to this webinar:



    ------------------------------
    Mike Frasca
    ------------------------------