Reltio Integration Hub

Hi Team,

We have developed recipe where we are trying to overcome below issue in Reltio connector.

Design details : 

Input from Snowflake (records around 1000 will be taken)  and we need to lookup in Reltio to fetch Entity ID for the same.
When i pass the whole list i am able to get only 200 from the list as first iteration.

Is there a way to get all the 1000 records from the loop, may be use of offsetting.

Image of the design - 



------------------------------
Chetan P
Freshworks
------------------------------

You'll need to use pagination to retrieve all the records

------------------------------
Ayan Basu
------------------------------

Original Message:
Sent: 01-12-2023 01:18
From: Chetan P
Subject: RIH | Reltio API Response limit

Hi Team,

We have developed recipe where we are trying to overcome below issue in Reltio connector.

Design details : 

Input from Snowflake (records around 1000 will be taken)  and we need to lookup in Reltio to fetch Entity ID for the same.
When i pass the whole list i am able to get only 200 from the list as first iteration.

Is there a way to get all the 1000 records from the loop, may be use of offsetting.

Image of the design - 



------------------------------
Chetan P
Freshworks
------------------------------

Thanks for the response @Ayan Basu ..
Quick question on the above pagination. I believe that the above solution works for dynamic records processing as well.

For example - Today i need to process 2k & tomorrow i need to process 5k records. It should work is what i assume.​

------------------------------
Chetan P
Freshworks
------------------------------

Original Message:
Sent: 01-12-2023 12:02
From: Ayan Basu
Subject: RIH | Reltio API Response limit

You'll need to use pagination to retrieve all the records

------------------------------
Ayan Basu

Original Message:
Sent: 01-12-2023 01:18
From: Chetan P
Subject: RIH | Reltio API Response limit

Hi Team,

We have developed recipe where we are trying to overcome below issue in Reltio connector.

Design details : 

Input from Snowflake (records around 1000 will be taken)  and we need to lookup in Reltio to fetch Entity ID for the same.
When i pass the whole list i am able to get only 200 from the list as first iteration.

Is there a way to get all the 1000 records from the loop, may be use of offsetting.

Image of the design - 



------------------------------
Chetan P
Freshworks
------------------------------