It would be ideal if there was a Input Dataset tile that would allow me to select multiple datasets and UNION them as part of a dataflow.
A use case would be if I had data arriving from 10 or 30 connectors that all had the same schema
- ex. SAP report that was extracted into a new connector every month
- YouTube report fed by several different Brands / Accounts
- data arriving from several different SQL tables that had the same schema
- if datasets were generated via API and needed to be auto-added to a dataflow pipeline.
Ideal state would be to able to configure rules (like with the Bulk Union operator in Enterprise Stacker)
- ex. select by name + regex
- select by tag
- select by report type.
