I have a question and wonder if there is a best practice approach to addressing this issue.
We will soon be adding a few new sources to our organization entity. Here is the scenario:
-
Let's say we currently have 160,000 OVs.
-
The new source has 40,000 records.
-
Of these, let's assume the following:
-
10,000 of these records will be automatically merged.
-
10,000 of these records will not be automatically merged and will not have a potential match identified, therefore are appropriate OV records.
-
20,000 of these will have potential matches to our current OVs.
Let's assume that of the 20,000 records with potential matches, 15,000 will be merged to existing OVs after Data Steward review. The Data Steward review will take some time to get through given the volume. My concern is that if there are 15,000 records that will eventually be merged to an existing OV, I don't want to clutter consuming systems with "duplicates" that will eventually be merged so as to minimize the noise in the data in those systems and to improve user experience e.g., seeing duplicates, unsure of which record to use.
My question from a best practice perspective is how can I "quarantine" these records that are potential matches so that they do not get included in our OV exports until they have been reviewed by a Data Steward and have been determined to be a match or not a match?
------------------------------
Christopher Brandt
Clinician Nexus
------------------------------