Reltio Connect

 View Only
  • 1.  Integration with Azure SQLDB and Reltio using ADF

    Reltio Partner
    Posted 11-19-2021 06:15
    We are trying to load data from Azure SQLDB to Reltio via ADF. The plan is to extract from SQLDB and then call data loader jar to insert into Reltio. Can anyone please detailed out the steps required to do the same? We want to use the solution both for initial data load and incremental load.


  • 2.  RE: Integration with Azure SQLDB and Reltio using ADF

    Reltio Employee
    Posted 11-21-2021 10:01
    @Mike Frasca or @Matthew Gagan can one of you or someone on the team help with this?


  • 3.  RE: Integration with Azure SQLDB and Reltio using ADF

    Reltio Employee
    Posted 11-22-2021 08:40

    Abhijit,
       This is awesome to see some of our partners and customers using more Cloud technologies like Azure Data Factory!  I would suggest that you avoid using the data loader jar though as I think we have some more optimal solutions to this.

    Option 1:  ADF is a pretty robust tool, and it can make direct REST API calls.  If you are already using it to extract data out of SQLDB, I would suggest that instead of writing that data to a file and then using the data loader jar to load it, just have ADF make the direct calls to our REST API.  The data loader jar is doing just that, making a bunch of REST API calls.  This will reduce the complexity of your load process and remove quite a bit of IO for the file writing and reading.  

    Option 2:  Have ADF write the flat file to a file storage location, but use our core platform Data Loader to load the file.  

    https://docs.reltio.com/dataloader/dataloaderoverview.html?hl=data%2Cloader

    I would suggest option 1 overall as it reduces complexity and avoids having to write this data from SQLDB to a flat file as a temporary processing step.

    Please let me know if you have any additional questions.