Salesforce Connector Date Filtering

Is there a better way to filter the last 3 FULL calendar years for the Salesforce connectors - that are not using the query option.. I would prefer to use '= LAST_N_YEARS:3' but can only do that on the query's.. any suggestions?

Answers

  • ggenovese
    ggenovese Contributor

    Without using the query option, I don't think so. However, you shouldn't have to load 3 years of data for every load. You can pull 3 years based on transaction date one, then set up a recursive etl, and then finally change your connector to incrementally pull in modified records with whatever window you feel is appropriate, maybe last 30 days. This set up allows you to minimize the number of records you're pulling in on a regular basis.