BULK UNION in Magic dataflows or Adrenaline

jaeW_at_Onyx

It would be ideal if there was a Input Dataset tile that would allow me to select multiple datasets and UNION them as part of a dataflow.

A use case would be if I had data arriving from 10 or 30 connectors that all had the same schema

1. ex. SAP report that was extracted into a new connector every month
2. YouTube report fed by several different Brands / Accounts
3. data arriving from several different SQL tables that had the same schema
4. if datasets were generated via API and needed to be auto-added to a dataflow pipeline.

Ideal state would be to able to configure rules (like with the Bulk Union operator in Enterprise Stacker)

1. ex. select by name + regex
2. select by tag
3. select by report type.