-
Tool to convert MySQL data flows to Magic ETL
In order to take full use of the power Magic ETL v2, it would be great if a tool could be developed to take a MySQL data flow and convert it to Magic ETL
-
Delay Dataflow Trigger
It would be helpful if I could delay a trigger to run 5, 10, 15 minutes after the dataset updates. Use case: My daily data upload process is completed, kicking off the updates of many datasets in Domo. One such dataset could be updated by a single dataflow, which could have six different datasets combined. Some of these…
-
Enable Preview Up to Point in ETL
Most of the time I don't need to preview the entire ETL. It would be nice to be able to drag/select the tiles of the ETL that I would like to preview up until.
-
ETL snap to grid
I like to keep very neat or orderly ETLs. Would love the ability to align ETL tiles horizontally or vertically or snap to grid or something. I think that would help keep a clean workstation.
-
Options for Preview Run Limits in Magic ETL
The Magic ETL currently only max out at 400k row for the preview run from your input datasets. This is limiting the test preview in your flow as it only picks (from my understanding) the first 400k row of your dataset. So if you're trying to preview your actions (such as filtering) you may not get anything showing in the…
-
Magic ETL Checklist Enhancement Idea
Hello, It would be helpful if we had the option to add items to the Magic ETL Checklist. This would allow for each organization to be able to make sure everyone is designing their ETLs per their procedure/guidelines. For example, if we are requiring the designers to 'label' all tiles, then we could add a checklist item;…
-
Magic ETL Tiles groups for clearer organization and visibility/observability :D :D :D
Although similar to the "Allow users to specify the color of Magic ETL tiles", we sometimes (okay, often) have extremely long and complex Magic ETL's that are difficult to comprehend, especially if you're inheriting them or exploring for replication or use. Being able to "group" your tiles in some fashion would greatly…
-
Show "Output Rows" by Action in ETL run details
Currently when you view the run details of a MagicETL dataflow, we can see the rows processed, duration, and status of each action in the ETL canvas. It would be very helpful to see an additional column that shows the number of output rows of each step, similar to how we can see the output of each transform in MySQL…
-
Ability to remove unnecessary columns directly in the input DataSet before loading all its rows
The functionality I require is already available in the MySQL and Redshift DataFlow… …in this example deselecting "department" and "state" columns. This option would make it possible not to load all columns for all rows in the DataSet. I hope it will be available in the Magic ETL input DataSets as soon as possible. Thank…
-
View all values in a column in preview
Troubleshooting would be improved by the ability to click on the header of a preview column to see all distinct values in the column, similar to tables in Excel.
-
ETL Field Search Capability
It would be helpful in an ETL to be able to search for a field name and have the tiles that directly reference that field name be highlighted. Many times when supporting dataflow development we are looking for a field and we have to open every tile to see where that field is referenced - in join, in formulas, in filters,…
-
Get MySQL on latest version
Currently, Domo's MySQL is on version 5.6, which is approaching end of support. There are also a number of commonly used features that people want to use in MySQL, but can't because it is still on version 5.6. Please upgrade to the latest version.
-
Appends Should Default to Include All Rows
Appends should default to "Include All Rows" and not change every time inputs are added/removed. Huge quality of life upgrade!
-
Undo button in Magic ETL
The addition of the undo button in the Analzyer has been extremely helpful. I would ask that an undo button be added to Magic ETL as well. This would help people who accidentally delete a tile that had a lot of configuration in it. Or if you made a number of changes that don't work and you want to step backwards to get…
-
Templated ETLs
I would love to be able to create an ETL and save that to use in other flows. A "save as template" button would be amazing. It would only save the tiles, not the columns, so you wouldn't have to delete everything before you start. We use recursive dataflows a lot, so it would be amazing if I could save that flow, and then…
-
Allow users to specify the color of Magic ETL tiles
This would be a small change that could help organize extremely busy dataflows. While you can currently change the color of the line
-
Show Configuration AND Notes panels on Magic ETL tile simultaneously
Currently, a user can see either the configuration of an ETL tile OR they can tab over to the notes section. It would be nice to see both views at once when writing notes on the configuration or editing the configuration based on the existing notes.
-
Preview Window Limits in Magic ETL
There is currently a 100 rows preview window limit when you do the preview run on the ETL. We need to increase this as it can help drastically with further work in the MagicETL.
-
Use Case for Recursive CTE -- Or is there an alternative?
I am pulling DomoStats data sets for: DataFlow Input DataSets DataFlow Output DataSets First Step - Combining input_output defined as: Select dfin."Dataflow ID" as dfid , dfin."Datasource Input ID" as dsin , dfout."Datasource Output ID" as dsout from "dataflow_input_datasets" as dfin join "dataflow_output_datasets" as…
-
Maintain Input DataSets when Pasting Copied Magic ETL Tiles
Currently, when copy and pasting Magic ETL tiles between flows, input tiles are scrubbed and become a plain input tile without a DataSet selected. I understand why you'd want to scrub this if pasted in the same flow, but it should be maintained when pasting in a different flow. This should be relatively easy to implement…
-
Dynamic Pivot
I love the functionality of dynamic unpivot for transforming my data vertically, I would love to see a similar functionality for adding columns
-
Filter Rows Tile | Option to include or exclude NULL
Currently if you use a filter such as <> or != "xyz", this will also filter out any NULL values in the column as well. This is default behaviour for SQL, and I do understand that the reason it's filtering out NULL is because it cannot compare a value to a NULL. So it implicitly excludes NULLs, just as SQL would. The…
-
Allow lag/lead on multiple columns at once
I think it would be helpful to be able to lag/lead on multiple columns at once, as long as the partition and ordering are the same. We have multiple ETLs where we have to lag/lead many columns, and having to create a tile for each column doesn't feel very efficient. Thanks!
-
row count at each step
You should be able to see the # of rows output after each step of the etl flow.
-
Magic ETL | Remove Duplicates Tile | Select all fields option
It would be good to have a "Select All Columns" option for the remove duplicates tile in magic
-
Magic ETL Organization Tools
Thinking it would be great if Domo implemented some organizational tools within the Magic ETL. We've got some rather large ETL's, that get quite complex, and organizational tools (organizing tiles into buckets, with ability to minimize bucket, add descriptions to bucket, etc.) would help my team and company scale. Having…
-
Select All Columns in Remove Duplicates ETL Tile
Instead of having to add each column individually, it would be great if there was a select all columns feature for the remove duplicates step in the ETL.
-
Maintain tile position when copy and pasting Magic ETL tiles
When working with large enough groupings of tiles, or groupings near the bottom of the canvas in Magic and copy/pasting, there is a tendency for tiles being pasted on the canvas to be squished into the bottom. This can be a pain to untangle and reposition the grouping. It would be helpful if by default or through maybe a…
-
Ability to Search ETLs
It would be great if we could search key phrases in ETLs. I have a field called "Item" and I want to see every tool in which the column "Item" is impacted. For example, if I search "Item" and it's included in a select columns tool or an add formula tools, those tools should be highlighted when I search the key word/phrase.…
-
Share DataFlow (all input datasets)
It'd be great to have a Share Dataflow button which would allow users to share all of the input datasets with a user instead of having to track down all of the multiple dataset inputs and share each of those individually which is quite time consuming.