Reltio Connect

 View Only
Expand all | Collapse all

automating the assignment of workflow for potential matches.

  • 1.  automating the assignment of workflow for potential matches.

    Posted 01-17-2022 12:20
    Hi folks,

    I am back to thinking about automating the assignment of workflow for potential matches.

    I had done some experiments a while back with the generateFromQuery api and found I could assign a varying amount depending on the query I used.

    If I wanted to only get the net new workflows since the last time I ran the api  I'm thinking that I need to include in the query either the reltio load date or the last update date.  Then I would need to change that date each time I run to get it from the last time I ran the api.  This would be part of our nightly batch and would run after the delta loads for that day have been loaded.

    I reviewed the workflow community session from December and there was nothing specific about net new matches but just using the generateFromQuery api with a search string.

    Am I thinking in the right direction or is there an easier or better approach to this that I'm just not seeing?

    Thanks!


    ------------------------------
    Michelle Popovits
    Empire Life
    ------------------------------


  • 2.  RE: automating the assignment of workflow for potential matches.
    Best Answer

    Reltio Employee
    Posted 01-18-2022 10:44

    Net new matches can be found by subscribing to the event queue or querying the Activity log, which can be scheduled or done on demand.  So writing an orchestrated process to combine activity events with workflow creation is definitely feasible, but some choreography will be required.  

    Bulk Export Audit API details are available here:

    Searching the activity log details are available here:


    ------------------------------
    Dan Gage
    Principal Solution Consultant
    ------------------------------



  • 3.  RE: automating the assignment of workflow for potential matches.

    Posted 01-18-2022 10:57
    Thanks Dan!

    I will take a look.

    I am having difficulty getting to the first link: https://docs.reltio.com/exportapi/exportactivitylog.html
    shows a blank screen with the message:  "You don't have the permission to access this page"

    No problem with the second link though, so I'll start there for now.


    ------------------------------
    Michelle Popovits
    Empire Life
    ------------------------------



  • 4.  RE: automating the assignment of workflow for potential matches.

    Reltio Employee
    Posted 01-18-2022 12:15
    Hi Michelle,

    Please use this link instead of the first one - https://docs.reltio.com/export/exportactivitylog.html. I think this will work. 

    Best Regards,
    Menka

    ------------------------------
    Menka Puthalath
    ------------------------------



  • 5.  RE: automating the assignment of workflow for potential matches.

    Posted 01-18-2022 13:01
    Thanks Menka,  that links works!  :)

    ------------------------------
    Michelle Popovits
    Empire Life
    ------------------------------



  • 6.  RE: automating the assignment of workflow for potential matches.

    Posted 01-26-2022 15:18

    @Daniel Gage

    I spent some time with the two api's you mentioned previously and posted my observations in another post in this thread.

    I was also wondering...Question - would the generateFromQuery api not accomplish something similar to this (without the extra processing steps) or is there a limitation to what that can do with regard to net new potential matches?

    ------------------------------
    Michelle Popovits
    Empire Life
    ------------------------------



  • 7.  RE: automating the assignment of workflow for potential matches.

    Reltio Employee
    Posted 01-27-2022 13:37
    The activities log search will allow you to find records which have had the event POTENTIAL_MATCHES_FOUND triggered during some specific time frame.

    The generatefromquery API assigns a match review workflow based on searching current characteristics of a record.  So this search does not take into consideration when the potential match was found or whether a past workflow was already triggered.  




    ------------------------------
    Dan Gage
    Principal Solution Consultant
    ------------------------------



  • 8.  RE: automating the assignment of workflow for potential matches.

    Posted 02-01-2022 12:07
    @Daniel Gage

    I think the generatefromquery API (or something like it) could be really useful if some additional functionality could be accessed.  Already there is much that can be included in the filter (ie. potential match count, rule #). If match information associated with an entity had something like potential match date that was present only if a potential match currently existed and removed when there was no potential match and updated to the most recent time a potential match was added....this could be really useful without going the procedural route.  I imagine it's more complicated than this simplification...but perhaps worthy of investigation for the future?  

    The ability to search based on the current state - the other options don't appear to allow the current state to be accessed.  The activities search api and activities export both appear to provide potentially outdated information that would need to be procedurally confirmed with successive calls.  It's likely that we would take this approach in the meantime.

    Thanks Dan for your great feedback


    ​​

    ------------------------------
    Michelle Popovits
    Empire Life
    ------------------------------



  • 9.  RE: automating the assignment of workflow for potential matches.

    Posted 01-19-2022 03:31
    thanks for the post @Michelle Popovits. Something we could consider in our implementation @Jurijus Urbanavicius​​

    ------------------------------
    Loic tordo
    Global customer master data director
    Schneider Electric
    ------------------------------



  • 10.  RE: automating the assignment of workflow for potential matches.

    Posted 01-19-2022 11:57
    I've been working with the two api's and have the following observations:

    The activities search api brings back way more data than needed for the following search string.  It brings back the whole incremental match thread graph of data including all items.data.type regardless of what it is...so long as at least one of them has a potential match thread in it.  In this case the 'filter' really isn't filtering the items...it's just filtering the containing incremental match thread.

    {{tenantURL}}/activities?filter=(gte(timestamp,'1632061607006') and equals(items.data.type,'POTENTIAL_MATCHES_FOUND'))%26max=25


    I ran the export version of the activities api and had a happier result.

    {{tenantExportURL}}/activities?filter=(gte(timestamp,'1632061607006') and equals(items.data.type,'POTENTIAL_MATCHES_FOUND'))

    The exported file contains only potential matches and includes much less data than the activities search api.  The one caveat here is that some items in the list may no longer be a potential match if something else caused an actual merge to take place subsequent to the potential match item being added to the activities log.

    I will continue further investigations of these api's.



    The assumption at this point is that a possible implementation would involve:
    1) running an export api for activities since the last time it was ran
    2) iterate through and process the file (we would likely use PDI) to get the entities affected and use another api call to create a workflow task for each item (possibly checking if they are still a potential match or maybe the api just fail to create the task in that case)



    Question - would the generateFromQuery api not accomplish something similar to this (without the extra processing steps) or is there a limitation to what that can do with regard to net new potential matches?






    ------------------------------
    Michelle Popovits
    Empire Life
    ------------------------------