Removing Dataset Outputs from Magic ETL
We have been cleaning up our Domo instance removing unnecessary outputs from Magic ETL flows. I am assuming these datasets aren't truly being deleted, just disconnected from their source to not get updated any more. Is there a way to find these "orphaned" outputs so that they can be properly deleted?
Best Answer
-
I think DomoStats has:
- Dataset ID
- Dataset Name
- Dataflow Name (if the dataset is used as part of a dataflow).
- Input/Output Type (whether the dataset is an input or output for a given dataflow).** Was this post helpful? Click Agree or Like below. **
** Did this solve your problem? Accept it as a solution! **0
Answers
-
Orphaned datasets would be datasets that, when investigated in DomoStats, would not have "In Use in Cards" or "In Use in Dataflows". So you should be able to use DomoStats Connector to connect to DomoStats -Dataset Usage and filter for no references in cards or dataflows, especially with a long "last accessed" timestamp.
CASE
WHEN `In Use in Cards` = 0 AND `In Use in DataFlows` = 0 THEN 'Orphaned'
ELSE 'In Use'
END** Was this post helpful? Click Agree or Like below. **
** Did this solve your problem? Accept it as a solution! **0 -
When I am looking at "in use in dataflows" it seems to be pulling dataflows that are inputs for flows instead of both inputs and outputs.
What I am looking for are datasets that no longer have a dataflow associated with them at all (aka no dataflow is connected to power the dataset). I suppose I misused the term orphaned in this context as the number of cards connected is irrelevant.
Put differently, is there a way to see the input dataflow for my datasets in a report?
0 -
I think DomoStats has:
- Dataset ID
- Dataset Name
- Dataflow Name (if the dataset is used as part of a dataflow).
- Input/Output Type (whether the dataset is an input or output for a given dataflow).** Was this post helpful? Click Agree or Like below. **
** Did this solve your problem? Accept it as a solution! **0 -
Awesome, I was able to join the DataFlow Output Sources from domostats with Datasets from domostats to identify what I need (datasets from import_type = dataflow and Dataflow ID is null)
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 622 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 744 Beast Mode
- 58 App Studio
- 41 Variables
- 686 Automate
- 176 Apps
- 453 APIs & Domo Developer
- 47 Workflows
- 10 DomoAI
- 36 Predict
- 15 Jupyter Workspaces
- 21 R & Python Tiles
- 395 Distribute
- 113 Domo Everywhere
- 276 Scheduled Reports
- 6 Software Integrations
- 125 Manage
- 122 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive