BULK UNION in Magic dataflows or Adrenaline

jaeW_at_Onyx
jaeW_at_Onyx Coach
edited December 2023 in Magic ETL Ideas

It would be ideal if there was a Input Dataset tile that would allow me to select multiple datasets and UNION them as part of a dataflow.


A use case would be if I had data arriving from 10 or 30 connectors that all had the same schema

  1. ex. SAP report that was extracted into a new connector every month
  2. YouTube report fed by several different Brands / Accounts
  3. data arriving from several different SQL tables that had the same schema
  4. if datasets were generated via API and needed to be auto-added to a dataflow pipeline.

Ideal state would be to able to configure rules (like with the Bulk Union operator in Enterprise Stacker)

  1. ex. select by name + regex
  2. select by tag
  3. select by report type.
Jae Wilson
Check out my 🎥 Domo Training YouTube Channel 👨‍💻

**Say "Thanks" by clicking the ❤️ in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"
4
4 votes

Active · Last Updated