Reltio Connect

 View Only
  • 1.  ETL usage in Reltio space

    Reltio Partner
    Posted 03-06-2024 00:38

    Hi,

    Could someone share some insights on ETL tool involvement in Reltio space.,

    1. Are there any preferred ETL tool for batch integrations with Reltio.
    2. Is ETL really required for integration with Reltio.
    3. Can Reltio Integration Hub (RIH) be used as ab ETL tool to perform transformations on source data before loading into Reltio.

    Any details around the ETL component in Reltio solution would be helpful.

    Thanks.

    Vinoth



    ------------------------------
    Vinoth Kumar Chittibabu
    Mastech Infotrellis Inc
    ------------------------------


  • 2.  RE: ETL usage in Reltio space

    Posted 03-06-2024 22:36

    Hello Vinoth

    For Batch integrations (assuming Inbound into Reltio) you have different options to ingest data. You can use RIH (recipe) and a list of connectors for the source as well as trigger mechanism.

    You can also use Data Loader provided by Reltio. Using Data Loader, you can load CSV or Excel files besides JSON file. You will ingest Entities and Relationships, separately. For Excel, limit is 100K rows, in one job. Your source files can be located on the cloud platform of your implementation: AWS/Azure/GCP. For local files, the size limitations restrict number of rows. 
    You will have to
    1. Create a Job for data loading
    2. Provide a source (location of the file to be loaded)
    2. Create a mapping from source (your file) to the target (Entity). You can create a mapping and re-use it (for later data loading jobs). 
    4. You can load simple, nested as well as reference attributes. You can specify default values
    5. You will need to provide crosswalk (source system) or else it will load with default source system as Reltio
    6. You will create separate mappings for Entities and Relationships (hence separate load jobs). 
    7. There are tabs for pending/Completed jobs. 
    8. You can see the job statics including completed successfully (green) or error (red) and details are provided. 
    9. Analysis tab can show you the details of the data loaded e.g. number of unique records etc. 
    10. For the same entity, you can re-use the mapping. You will have to create separate mappings for separate entities and relationships. In relationships, you will have to provide start and ending entity as well as REL_TYPE and crosswalks for the relationships. 

    Hope it helps



    ------------------------------
    Anil Kumar
    TEKSystems
    ------------------------------



  • 3.  RE: ETL usage in Reltio space

    Reltio Partner
    Posted 03-06-2024 23:44

    Hi Anil,

    Thanks for your inputs on this. 

    I understand the load process within Reltio using RIH or Data Loader or APIs.

    I would like to know if there are any Reltio preferred ETL tools, I suppose the answer is NO.

    Is it fair to say that, for any external ETL tool that is sitting outside of Reltio, the scope is to generate the files in specified formats or call the Reltio APIs to load the data after applying transformations on source data. 

    Appreciate all your inputs.

    Thanks,

    Vinoth



    ------------------------------
    Vinoth Kumar Chittibabu
    Mastech Infotrellis Inc
    ------------------------------



  • 4.  RE: ETL usage in Reltio space

    Posted 03-07-2024 15:55

    HI Vinoth,

    You can use any ETL tool as long as it has the ability to connect to Reltio using Rest API. For example, you can use Informatica Cloud (CDI = Cloud Data Integration and CAI = Cloud Application Integration). It can be used for both data loads and extracts from Reltio MDM and to load into database systems like Redshift for further consumption. 

    Reltio Integration Hub (RIH) is another opton but it uses Workato behind the scenes and may require procuring additional licenses to procure unless its part of your Reltio licensing agreement.

    Hope this helps.



    ------------------------------
    Bhaskar Nunna
    ------------------------------



  • 5.  RE: ETL usage in Reltio space

    Reltio Partner
    Posted 03-08-2024 07:39

    Hi Baskar,

    Thank you for the inputs, this helps.

    Vinoth



    ------------------------------
    Vinoth Kumar Chittibabu
    Mastech Infotrellis Inc
    ------------------------------