Reltio Connect

 View Only
  • 1.  Permanent delete all values of nested attribute

    Posted 11-23-2023 13:07

    We have requirement to delete all values from a nested attribute and data volume for this is around 40M .We tried Bulk update UI feature but its only putting ignore button .Another option is Bulk_Update API but with this volume of data it is not feasible option as it requires entity URI.

    Please suggest how we can delete this.

    Thank in advance.



    ------------------------------
    S Gupta
    Humana
    ------------------------------


  • 2.  RE: Permanent delete all values of nested attribute

    Reltio Employee
    Posted 11-27-2023 05:29

    There is also a Clear Attribute option, please try that.



    ------------------------------
    Mukesh Patel
    ------------------------------



  • 3.  RE: Permanent delete all values of nested attribute

    Posted 11-28-2023 02:56

    Clear attribute option is only ignoring the value it is not deleting.



    ------------------------------
    S Gupta
    Humana
    ------------------------------



  • 4.  RE: Permanent delete all values of nested attribute

    Reltio Employee
    Posted 11-29-2023 09:23

    I would suggest you look to see if there is an existing Aha request and vote on it or create an Aha request if one is not already voted on.



    ------------------------------
    Mukesh Patel
    ------------------------------



  • 5.  RE: Permanent delete all values of nested attribute

    Reltio Employee
    Posted 11-29-2023 10:36

    If you go to the Sources view and delete an attribute there, you can see in the browsers developer mode that the API is a delete of the specific URI of the attribute.  However, how this would work for 40M is not clear.  You could bulk export the attribute and write a program to parse the extract for the URI and call the API.  However, I suggest that you work through this with your CSM.

    What you should NOT do is remove the attribute from your data model.  The data will remain in the Reltio database:  you will not have remove it, and it will continue to take up space.  Absolutely don't do that!



    ------------------------------
    Gino Fortunato
    Senior Solution Engineer
    Reltio
    ------------------------------



  • 6.  RE: Permanent delete all values of nested attribute

    Reltio Employee
    Posted 11-30-2023 10:50

    I have been thinking about this most of the day...

    Why do you want to delete the attributes?  If the values are wrong, or they should not have come from the source, the data should be reloaded as if it was originally the new values in the source.  Doing that will automatically correct/overwrite the values as long as you do not use 'partialOverride' in the API call.

    If it is just that they values should not be in the OV, then the 'ignore' should be good enough.  

    Can you expand on the reason why they 'must' be deleted?



    ------------------------------
    Gino Fortunato
    Senior Solution Engineer
    Reltio
    ------------------------------



  • 7.  RE: Permanent delete all values of nested attribute

    Posted 11-30-2023 11:18

    Hi Gina,

    Yes, partialOverride is being used; however, we need to delete values because we will need to add new sub-attributes, and need to add new ones to keyAttributeURIs. Additionally, since three attributes are already included in this parameter, any newly loaded value will always be appended rather than override, and some sub-attributes need to have their values corrected.



    ------------------------------
    S Gupta
    Humana
    ------------------------------



  • 8.  RE: Permanent delete all values of nested attribute

    Reltio Employee
    Posted 12-01-2023 12:29

    I think you have missed my point:  If you do NOT use partial override, the attribute you want to remove will be removed.  When you update a crosswalk without partial override, the effect is to say that 'this is the new version'.  So if the attribute to be deleted is not in the payload, it will no longer be there.  Because you are using partialOverride, the attribute remains as part of the entity.



    ------------------------------
    Gino Fortunato
    Senior Solution Engineer
    Reltio
    ------------------------------



  • 9.  RE: Permanent delete all values of nested attribute

    Posted 12-06-2023 02:28

    Thanks Gina for sharing your input, it works.



    ------------------------------
    S Gupta
    Humana
    ------------------------------



  • 10.  RE: Permanent delete all values of nested attribute

    Reltio Employee
    Posted 12-06-2023 09:54
    Awesome! 

    When you do this, remember the input to the API is an array.  that will allow you to update many records with one API call.  Doing so should speed the performance of the process and not consume as many API calls.

    --