Appending snapshot data to historical dataset
I am attempting to schedule a dataflow to append the week's data to a historical dataset which contains the previous week's history. The auto-updating dataset, call it: "projects_prod_daily" runs everyday as a replace data update. The historical dataset, let's call it: "projects_append_weekly" contains a history we manually appended in the past. I also created a connector to the USGS Earthquake data which runs on Saturday mornings, called: "recursive_trigger_weekly".
Using a MySQL dataflow, the following queries are what I created to achieve the desired result:
Transform 1:
SELECT
*,
DATE_FORMAT(CURRENT_DATE, "%m/%d/%Y") AS `Date`
FROM projects_prod_daily
Transform 2:
SELECT
*,
STR_TO_DATE(`Date`, "%m/%d/%Y") AS `Date`
FROM projects_append_weekly
UNION ALL
SELECT
*
FROM pull_updated_status_data
My question is: If I initially created the "projects_append_weekly" in a separate dataflow but use the queries listed above to create an output dataset with the same name, will the data continue to append the last week's updates automatically over time?
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 102 SQL DataFlows
- 626 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 753 Beast Mode
- 61 App Studio
- 41 Variables
- 692 Automate
- 177 Apps
- 456 APIs & Domo Developer
- 49 Workflows
- 10 DomoAI
- 38 Predict
- 16 Jupyter Workspaces
- 22 R & Python Tiles
- 398 Distribute
- 115 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 130 Manage
- 127 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 11 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 110 Community Announcements
- 4.8K Archive