salesforce writeback batch append question

art_in_sky
art_in_sky Contributor
in Connectors

I have a dataset that has data flowing in batches and every batch group ( has a unique group name (column) , I want to writeback this data as it comes after necessary transformations to the same writeback connector to append only unprocessed records.

While trying to do this, I get " it is illegal to have 2 inputs where only 1 is needed"

How can I make this possible with one single input dataset with different group filters attaching to one single Salesforce writeback dataset to append only new records from batches?

Answers

  • Saheli_Mukherjee
    Saheli_Mukherjee Domo Employee

    Hello @art_in_sky

    Please follow the troubleshooting steps outlined below to resolve the issue:

    1. Filter the Dataset: Create a transformation step to exclude records that have already been processed, using either a processed flag or a timestamp.
    2. Set Up the Writeback Connector: Use a single writeback connector that appends new records, ensuring it is configured to avoid overwriting and is set to perform an upsert.
    3. Update the Dataset: After successfully writing the records, update the processed flag or timestamp to ensure the same records aren’t written back again.
    4. Repeat for Each Batch: For each new batch, filter and process only the unprocessed records and append them to Salesforce.

    If, after following these steps, the issue still persists, it would be helpful to gather more information about the writeback connector and the exact steps you’re following. In that case, please reach out to our support team at support@domo.com, and we’ll be more than happy to assist you further.

Categories