Reltio Connect

 View Only
Back to discussions
Expand all | Collapse all

Inquiry on Batching DUNS Numbers for Monitoring Registration Using Offset/Limit in Export Filters

  • 1.  Inquiry on Batching DUNS Numbers for Monitoring Registration Using Offset/Limit in Export Filters

    Reltio Partner
    Posted 20 days ago

    Hi Team,

    We are currently utilizing the D&B Data Block Connector for enrichment purposes. In our environment with D&B version 2.0, we are leveraging the monitoring feature to register all existing DUNS numbers for monitoring. However, we have encountered an issue during this process: the job fails due to the large file size which exceeds 1GB.

    As an alternative, we are considering processing the data in smaller batches. Currently, based on the out-of-the-box (OOTB) recipes provided for monitoring, DUNS numbers are exported from the UI using the filter conditions specified in the D&B recipe properties table.

    To explore possible solutions, we have reviewed the following documentation regarding export filters and batch processing:

    1. Advanced search filter options
    2. Data export operation
    3. Entities API and filtering

    Given this background, we would like to know if it is feasible to send DUNS numbers in batches by applying offset and limit parameters to the filter condition in the export process. If this is possible, we would appreciate your guidance or recommended best practices on how to achieve this efficiently.

    Thank you for your support and assistance.



    ------------------------------
    Avni Kanchan
    Deloitte
    ------------------------------


  • 2.  RE: Inquiry on Batching DUNS Numbers for Monitoring Registration Using Offset/Limit in Export Filters

    Founding Member
    Posted 9 hours ago

    One of the way to handle this is by breaking the monitoring files in s3 into batches of acceptable limits either by owner of the file via automated shell script.



    ------------------------------
    Ashish Rawat
    Associate Director
    Radisson Hotel Groups
    Bangalore
    ------------------------------

    Original Message


Related Content