Alen,
Match tokens are updated whenever an entity update takes place. These tokens are then persisted in our platform for use in candidate selection later. This process does not need a separate API to invoke, it just runs automatically as one of the Async process whenever an entity is updated.
Match tokens are used for direct look ups for candidate selection in the matching process. Let's say we have a match rule which is:
Fuzzy First Name
Fuzzy Last Name
Exact SSN
Exact Address
The above outline is an outline for our comparators, but in order to meet performance needs of the platform at scale, we do not want to run that comparison against every single object in the tenant. This could be hundreds of millions of comparisons. To make this run faster we grab a candidate pool to do this deeper comparison on. That candidate pool is any record that shares 1 or more tokens with the record invoking the match process.
So in our example above if we have tokens on Fuzzy First name (Metaphone Generator) we could do a deep comparison against every single object in the tenant that shares the same metaphone token, but that could also be a lot of objects, so a more ideal scenario would be to just use SSN as the ONLY token here. The rule can't be true if SSN isn't identical, so the pool of people sharing the same SSN (and then doing the comparison of name and address) will be significantly smaller (and thus faster) than comparing against everyone that shares the same metaphone token for first name (mike, michael, michele, michelle, mikhail for example).
Comparators can be thought of as the actual match rule, while tokens are there to improve performance by limiting the candidate pool and excluding things we know won't be a match anyway.
------------------------------
Mike Frasca
------------------------------
Original Message:
Sent: 08-03-2021 02:01
From: Alen Godwin
Subject: Regarding Token Generation
On what basis the match token is generated, and on what scenario it changes? How the match tokens are compared in Reltio.
Thanks,
P. Alen
------------------------------
Alen Godwin
AstraZeneca
Chennai
------------------------------