Multiple singe day events grouped as single consecutive day events
I am trying to figure out a way, in Magic ETL, to take multiple single day events and group them when there is break in consecutive days.
Example, if the results show the 1st, 2nd, 3rd, 5th, 6th, 9th, 10th and 11th, I need three results, not 8. I want to see begin and end dates of 1st-3rd, 5th-6th, and 9th-11th.
Any thoughts?
Best Answer
-
Walked through how to do it here:
This is modified from what I previously suggested and doesn't require lag and lead functions. Big thanks to @AustinHarrison for the idea of a more simple way to do this using row numbers!If I solved your problem, please select "yes" above
0
Answers
-
Classic gap and island analysis. Here is an article introducing the topic and how to accomplish what you are trying to do:
An alternative way in MagicETL would be to use a lag function and have some logic that if the previous value is not the current value minus one then that current value must be a new start to an island (the 5th in your example). Similarly you could do a lead function and anytime the future value isn't the current value plus one then it is the start of an island (the 6th in your example).
I think the linked article is the cleanest way to do this in a MySQL dataflow.
If I solved your problem, please select "yes" above
0 -
Thank you @ColemenWilson, but could you expand on the MagicETL method? I've been trying to use the Rank & Window with the previous date (lag), but not able to get to the grouping I'm hoping for. I need to somehow carry a constant down the rows until it sees that the datediff is >1, then a new constant until >1, etc.
0 -
Walked through how to do it here:
This is modified from what I previously suggested and doesn't require lag and lead functions. Big thanks to @AustinHarrison for the idea of a more simple way to do this using row numbers!If I solved your problem, please select "yes" above
0
Categories
- All Categories
- 1.7K Product Ideas
- 1.7K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 292 Workbench
- 4 Cloud Amplifier
- 8 Federated
- 2.8K Transform
- 95 SQL DataFlows
- 602 Datasets
- 2.1K Magic ETL
- 3.7K Visualize
- 2.4K Charting
- 695 Beast Mode
- 43 App Studio
- 39 Variables
- 658 Automate
- 170 Apps
- 441 APIs & Domo Developer
- 42 Workflows
- 5 DomoAI
- 32 Predict
- 12 Jupyter Workspaces
- 20 R & Python Tiles
- 386 Distribute
- 111 Domo Everywhere
- 269 Scheduled Reports
- 6 Software Integrations
- 113 Manage
- 110 Governance & Security
- 8 Domo University
- 30 Product Releases
- Community Forums
- 39 Getting Started
- 29 Community Member Introductions
- 98 Community Announcements
- Domo Community Gallery
- 4.8K Archive