Reltio Connect

 View Only
  • 1.  Data Load

    Posted 06-06-2023 06:32

    Lets say we are processing 1million records in batch via RIH recipe and 20k records fail for some validation. What are the ways to process the failed records and how can we get the list of the failed records? Does the recipe stop if one of the record fails or it moves to the next record in the batch?



    ------------------------------
    Sharmistha Roy
    EY GDS
    BENGALURU
    ------------------------------


  • 2.  RE: Data Load

    Founding Member
    Posted 06-06-2023 16:22

    Reltio's App to create records in bulk provides the list of failed record as a datapill, which can be processed in next step for logging/reprocessing.  For unexpected errors you can use "Handle errors" task 



    ------------------------------
    Ashish Rawat
    Sr. Manager
    Fresh Gravity
    Bangalore
    ------------------------------



  • 3.  RE: Data Load

    Reltio Partner
    Posted 06-07-2023 00:43

    Hi Sharmistha,

    I agree with Ashish on the Failed records, but the errors reported here are the connector errors and not the record level errors.

    If you want to get the record level errors you can look into the successful flag which states true/false and gives complete picture of success and failed records.

    Also, while storing in list or any action, do check out the limitations as List has soft limit of 50K and you have to consider processing it in batches and consolidating externally.



    ------------------------------
    Sheshadri V
    Fresh Gravity
    ------------------------------



  • 4.  RE: Data Load

    Posted 06-07-2023 10:03

    Thanks for your response. How can we export this failed records so that we can sent back to the source for correction?



    ------------------------------
    Sharmistha Roy
    EY GDS
    BENGALURU
    ------------------------------