Reltio Connect

 View Only
Back to discussions
Expand all | Collapse all

Streaming: Writing to Multiple Queues for Reltio Events: Concerns and Best Practices

  • 1.  Streaming: Writing to Multiple Queues for Reltio Events: Concerns and Best Practices

    Posted 03-15-2023 09:08

    We have the need to have Reltio events available in 2 separate  AWS SQS Queues so they can be processed by 2 separate consumers.

    There will be about 30% overlap of messages that will be written to both of the queues.

    We will leverage the object_filter parameter to control what is written to each queue.

    Are there any concerns or best practices that we would need to be aware of or consider prior to doing so.

    Thanks,

    Mark



    ------------------------------
    Mark Burlock
    Dodge Data & Analytics
    Hamilton NJ
    ------------------------------


  • 2.  RE: Streaming: Writing to Multiple Queues for Reltio Events: Concerns and Best Practices
    Best Answer

    Reltio Employee
    Posted 03-16-2023 10:09

    Hi Mark,

    There are no concerns with the number of queues you configure. You may want to choose the payload type and the newly added OV Only flag appropriately to control the payload size.

    Thanks,

    Saurabh 



    ------------------------------
    Saurabh Agarwal
    ------------------------------

    Original Message