Handling "Replace vs. Append" Logic with Email Connector
Hello everyone,
I'm seeking advice on configuring the Domo Email Connector for importing reports in a "month-to-date" format via email attachments. I want to a) retain the reports for previous months, but also b) replace the latest "month-to-date" report.
Our goal is to achieve a combination of "Replace" and "Append" logic (if possible):
- Replace Logic: Replace data for the current month during the month.
- Append Logic: Append new data when a new month starts.
Example: During May 1st through 31st, do a replace with the latest "month-to-date' report but also append/retain the month-to-date reports from April 30th, March 31st, etc.
Has anyone implemented something similar or can offer guidance on how to handle this using the Email Connector and DataFlows?
Thanks in advance for your help!
Best Answer
-
I think you'll end up with a couple of different datasets here:
- The email connector dataset, which appends the new data from each email
- A dataset where you run the full email connector dataset through Magic ETL. Here, you would find the max batch date for each month, and then isolate those rows before outputting to the final dataset. This way you get the latest report for the current month, plus the "final" report for each previous month.
To find the max batch date for a given month, I would probably create a "Month" field using the formula tile, then group by that field to find the max batch date. An inner join on month = month and max batch date = batch date back to the data input should isolate the appropriate rows.
0
Answers
-
I think you'll end up with a couple of different datasets here:
- The email connector dataset, which appends the new data from each email
- A dataset where you run the full email connector dataset through Magic ETL. Here, you would find the max batch date for each month, and then isolate those rows before outputting to the final dataset. This way you get the latest report for the current month, plus the "final" report for each previous month.
To find the max batch date for a given month, I would probably create a "Month" field using the formula tile, then group by that field to find the max batch date. An inner join on month = month and max batch date = batch date back to the data input should isolate the appropriate rows.
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 101 SQL DataFlows
- 623 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 748 Beast Mode
- 60 App Studio
- 41 Variables
- 690 Automate
- 177 Apps
- 455 APIs & Domo Developer
- 48 Workflows
- 10 DomoAI
- 36 Predict
- 15 Jupyter Workspaces
- 21 R & Python Tiles
- 397 Distribute
- 114 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 127 Manage
- 124 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 109 Community Announcements
- 4.8K Archive