-
Estimate processing time of each step in Magic ETL v2
When creating any ETL the user interface is unable to alert you the impact of the change will make on the dataflow. If I create a transformation that is not optimized I should be alerted this will increase process time. It would be helpful to have a time estimation in Magic ETL itself as to how long each step will take…
-
View older ETL version without making that version the active version
I would like to be able to view older versions of ETLs without needing to make them active first. The way I envision it you would go to the Versions tab of an existing ETL and see a new menu item when you click on a version's ellipsis: View Version. Choosing this would open up that version of the ETL in read-only mode,…
-
Global Formulas in ETLs
I would like to have a way to create complex formulas, save them (similar to the Beast Mode Manager) , and then have them available for use in ETLs; when an ETL that contains one of these formulas is executed the current version of the formula would always be used. This would have two use cases (for me): If there is a need…
-
ETL Notation
Ability to highlight multiple tiles in an ETL and notate the collective function that they are accomplishing
-
Option to align Magic ETL functions to a grid
I'd like to be able to have my ETL functions precisely aligned in the Magic ETL editor so that they're easier to read quickly. When I'm creating an ETL, I tend to place functions where it makes the most sense to me, but if a function is a little bit off-centre it's not obvious which function it's supposed to be next to…
-
Create a SQL tile within Magic ETL
It would be great to have a SQL tile within Magic ETL where users can write SQL much like what users can do with the Python tile. This would open up the ability to do conditional joins and looping in Magic ETL. It would also remove some of the dependencies on MySQL, Redshift dataflows which can be very slow to run.
-
ETL Group By Tile - Move "Add Formula" option to the aggregation drop-down
The Group By tile in ETL currently has two options for adding aggregated columns: Add Column and Add Formula. I've run into situations where I have a grouped column configured using the pre-defined aggregations from the "Add Column" option, and later realize I need to use a formula instead. When this happens, there is no…
-
Load an dataflow from Magic ETL
Hi, I think it would be helpful to be able to choose a previously created data set and load it into Magic ETL from a blank ETL screen. Thanks, Damen
-
MetaData for datasets in Magic ETL
It'd be nice to have some basic metadata like last updated, row count etc on the datasets to better align data based on the dates or to do validation to check against missing data
-
Regex in Formulas in Views and in Formula ETL Tiles
I would like to be able to use regex to match values in formulas. Both in views and ETLS Such as this. I am using this to validate some data in a view formula CASE when `Field` like '[0-9]{4}\-[0-9]{4}\-[0-9]{3}' then 0 when `Field` = '' then 0 else 1 end
-
Magic ETL
-
Partition UI Feedback - delete and merge partitions in the Domo UI.
Currently, there's a limit of 400 partitions in a dataset produced by Magic ETL. Setting aside that 400 feels like a very arbitrary number (and entirely too low given that most partition schemes are by date, it would be ideal if Domo added buttons, tools within the Partition UI to allow users to manage them. Users need the…
-
BULK UNION in Magic dataflows or Adrenaline
It would be ideal if there was a Input Dataset tile that would allow me to select multiple datasets and UNION them as part of a dataflow. A use case would be if I had data arriving from 10 or 30 connectors that all had the same schema ex. SAP report that was extracted into a new connector every month YouTube report fed by…
-
Enhancement on Xero Connector
Domo currently are not using the periods and timeframe parameters included in the below example for the P&L table. This has resulted the table line items being unable to pull through by month_year. The only work around at the moment is to pull through data 1 month at a time and adding this to the previous data. This…
-
Links to Input/Output Datasets in Magic ETL Editor
Oftentimes I find myself having to open a new tab to navigate to the various input and output datasets when in the editing canvas for a Magic ETL. It would be nice if there were a link that would open the dataset in a new tab somewhere on the configuration dialog that appears after selecting the tile.
-
Disable/Hide Tiles
Sometimes when in development I have a need to hide/disable a tile or group of tiles that I am working on but have a need to run the flow in order to check other things but the flow won't run until all tiles are configured correctly. Sometimes I don't want to complete the tile (maybe it is having errors) and I need to…
-
Settings for Magic ETL - only owner & admins can edit this Dataflow
I just saw that the redshift and mySQL dataflows have an option under settings for "Only the owner and administrators can edit this DataFlow". This should also be available in Magic ETL 2.0
-
ETL: allow existing dataset to be used as output
There are situations where it would be useful to have more than one ETL be able to modify an existing dataset. For example, I sometimes need to make a one-time fix via a query to a dataset. As it stands today, this is nearly impossible; the only way to do it is to hijack the existing ETL, comment out all of the code, put…
-
Relative Date Filter in ETL?
Currently you can filter by Current_Date in ETL and in many connectors you can use relative date filters to pull last 7 days or between 2 relative dates to get a rolling report that doesn't require constant modifications. Can we add this feature for date filters in ETL? It would make things much easier if we can filter to…