Can you filter data from input dataset in a MySQL Flow
Hello,
I have a dataset that has data for the past 20 fiscal years. I use it in a flow that only looks at the last two fiscal years and when the flow runs it takes a good 10-20 minutes just to read the data in the dataset and then start transforming it.
I was thinking of expediting the loading process by pre-filtering the last 2 years only. I would have tried with dataset views but these are no accepted yet as input datasets in a flow.
I do not want to create another flow that will populate and additional dataset just with data for the past two years. I am looking for a solution that would leverage the existing dataset and put a filter on it.
Any suggestion is greatly appreciated.
Answers
-
Are you using a MySQL dataflow or a Magic ETL data flow?
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0 -
Hi Grant,
it is a MySQL dataflow
Thank you
0
Categories
- 10.5K All Categories
- 5 Connect
- 915 Connectors
- 250 Workbench
- 459 Transform
- 1.7K Magic ETL
- 69 SQL DataFlows
- 476 Datasets
- 186 Visualize
- 250 Beast Mode
- 2.1K Charting
- 11 Variables
- 16 Automate
- 354 APIs & Domo Developer
- 88 Apps
- 3 Workflows
- 20 Predict
- 5 Jupyter Workspaces
- 15 R & Python Tiles
- 245 Distribute
- 62 Domo Everywhere
- 242 Scheduled Reports
- 20 Manage
- 41 Governance & Security
- 170 Product Ideas
- 1.2K Ideas Exchange
- 10 Community Forums
- 27 Getting Started
- 14 Community Member Introductions
- 55 Community News
- 4.5K Archive