-
Maintain Input DataSets when Pasting Copied Magic ETL Tiles
Currently, when copy and pasting Magic ETL tiles between flows, input tiles are scrubbed and become a plain input tile without a DataSet selected. I understand why you'd want to scrub this if pasted in the same flow, but it should be maintained when pasting in a different flow. This should be relatively easy to implement…
-
Dynamic Pivot
I love the functionality of dynamic unpivot for transforming my data vertically, I would love to see a similar functionality for adding columns
-
Filter Rows Tile | Option to include or exclude NULL
Currently if you use a filter such as <> or != "xyz", this will also filter out any NULL values in the column as well. This is default behaviour for SQL, and I do understand that the reason it's filtering out NULL is because it cannot compare a value to a NULL. So it implicitly excludes NULLs, just as SQL would. The…
-
Can I see the basic dataset length between different steps of an etl flow?
For example, I want to know how many rows are in the table before and after a pivot.
-
Magic ETL Organization Tools
Thinking it would be great if Domo implemented some organizational tools within the Magic ETL. We've got some rather large ETL's, that get quite complex, and organizational tools (organizing tiles into buckets, with ability to minimize bucket, add descriptions to bucket, etc.) would help my team and company scale. Having…
-
Select All Columns in Remove Duplicates ETL Tile
Instead of having to add each column individually, it would be great if there was a select all columns feature for the remove duplicates step in the ETL.
-
Maintain tile position when copy and pasting Magic ETL tiles
When working with large enough groupings of tiles, or groupings near the bottom of the canvas in Magic and copy/pasting, there is a tendency for tiles being pasted on the canvas to be squished into the bottom. This can be a pain to untangle and reposition the grouping. It would be helpful if by default or through maybe a…
-
Domopalooza Cloud Amplifier & Magic ETL Feature Release
We are excited to announce enhancements to Domo's Magic ETL and Cloud Amplifier tools. Magic ETL Magic ETL is Domo’s secret weapon for building data pipelines with ease. With a simple drag-and-drop interface, Magic ETL makes it easy to clean and combine data without knowing SQL. In this release, enhancements have been made…
-
Change Number format in dynamic concat statement
I have create a concat statement to dynamically highlight a certain metric. Essentially it changes as the time period and other categories change. The number is showing in the format in the above picture and I am hoping I could abbreviate in Billion or at least show the number in account format. I would really appreciate…
-
How do I search for rows containing specific text and replace the information in that row?
I have a column in my ETL dataset that is named "City", in that column there are multiple city names however they have been put in in all different ways (ie: st george, St. George, ST George). I would like to search that column for rows containing 'george' and replace the information in that row with 'St. George'. I've…
-
Group By Question
Im trying to do a group by to get a new column with total sum of charges by bill ID. I want the total sum to be constant all for every day associated with Bill ID. When I do a group by I am not getting the new column to sum the charges. Bill ID Date Charge 502 4/10/2023 $85 502 4/11/2023 $76 502 4/12/2023 $110 502…
-
Ability to Search ETLs
It would be great if we could search key phrases in ETLs. I have a field called "Item" and I want to see every tool in which the column "Item" is impacted. For example, if I search "Item" and it's included in a select columns tool or an add formula tools, those tools should be highlighted when I search the key word/phrase.…
-
Allow Window Functions in MagicETL Formula Tile
It would be helpful to be able to write MagicETL formulas using window functions, similar to in beast mode. While the Rank & Window tile is often sufficient, there are some use cases where having this feature in the Formula tile would simplify the dataflow steps: Using a sum window function with unbounded rows This does…
-
Block tiles in Magic ETL to simplify complex dataflows
"Block Tiles" are larger tiles that contain a string of tiles inside. Block tiles could make large Magic ETLs (100+ tiles) easier to document, and much easier to read and understand. These tiles would contain a group of tiles that have a single output tile (not an output dataset) to make for an easy way to connect block…
-
Appends Should Default to Include All Rows
Appends should default to "Include All Rows" and not change every time inputs are added/removed. Huge quality of life upgrade!
-
Magic ETL - Allow group by without a grouping column
There are times when I want to calculate aggregated metrics across the entire dataset. Currently this isn't possible without adding a constant value column to group on which I then have to remove later in my pipeline. It'd be much smoother if the Group By tile allowed us to group across the entire dataset without having to…
-
Assign colors to tiles
I would like to be assign colors to tiles: this would make troubleshooting and code reviews much easier. A stretch goal would be to add setting the color of tiles to the options when you select more than one tile in addition to Delete, Duplicate, and Copy To Clipboard. Using this to visually indicate functional sections of…
-
ETL Field Search Capability
It would be helpful in an ETL to be able to search for a field name and have the tiles that directly reference that field name be highlighted. Many times when supporting dataflow development we are looking for a field and we have to open every tile to see where that field is referenced - in join, in formulas, in filters,…
-
Ability to remove unnecessary columns directly in the input DataSet before loading all its rows
The functionality I require is already available in the MySQL and Redshift DataFlow… …in this example deselecting "department" and "state" columns. This option would make it possible not to load all columns for all rows in the DataSet. I hope it will be available in the Magic ETL input DataSets as soon as possible. Thank…
-
Add Formula Rule to Join Tile in ETL
It has been extremely useful in Magic ETL 2.0 to have the Add Formula Rule available in certain tiles such as the Filter tile or Group By tile. I would like to see it be available in the Join tile as well. This would make it operate more like a SQL join. For example, if I need to use a BETWEEN statement for my join key, I…
-
Magic ETL Organization Tiles
Would be nice to have a feature to add a box around several tiles in order to organise better the dataflow. Sometimes we have a complex dataflow with several business logic and a lot of tiles, and it would be easier to identify the several steps with that boxes. An example of that is like the one in Unreal Engine:
-
Comment out tiles in MagicETL
When building complex ETLs it would be handy to be able to "comment out" tiles so they are ignored for execution. For bonus points, I'd like to be able to have an unterminated chain of commented-out tiles not block the ETL's execution.
-
More Dataflow suggestion: When I "cancel" out of a data flow don't dump me back to the Dataflow page
It doesn't always happen, but when it does, UGH. I hit cancel when in an ETL and then I go all the way back to the All Dataflows page. I don't want to go that far back. That's not even where I started. It seems to depend on how I get to the ETL. In this case I can be in the Overview page, click edit etl, once in the etl I…
-
Display Row count at every step in Magic ETL
Currently if you want to know your row count in Magic ETL at any stage other than the out put, you have to place a few temporary tiles to get there. I.E. add a rank and window tile to establish a Row Number column then aggregate with a group by to get the max row. Would really love if each tile could show the rows…
-
I need to make a bar chart that combines multiple columns based on date
Simply put, I want to display how many users completed each program in Q4 2023, and I want to later be able to select a different date (so later, for example, I can see how many people completed programs in Q1 2024). I want my users to see the most popular progams during a given time period. I think a bar graph will…
-
Different time zone
Hi! I'm trying to configure the time zone in ETL but my query is resulting in different times when the function calculates the difference, for the same column. ETL time zone function: Imported table from SQL Server: Result after time zone changes: The date range of the table is from Feb 24 to Mar 12. From Feb 24 to Mar 8…
-
Nested Case and Concat Statement
Hi, I am trying to figure out how to create an Etl that expresses: If a particular year has a result then concat that with another column's result. Something like: CONCAT(case WHEN 2015= 1 then '2015', '-', Virtual vs In-Person else '' end) 2015 has a 1/0 constant and I want the result to be if they attended in person (so…
-
Is it possible to batch edit source data?
I have a large dataset that needs some cleaning. We have appended to this dataset daily over several years and some of the data values have drifted over time as users have renamed what are essentially labels for different entities. If this were SQL, I could write an update statement and quickly replace the values in label…
-
how to combine mutiple rows into one separated by ','? Form builder muti selection data handling
I used form builder and there are couple fields are multisection dropdowns, in the response dataset, it separates the selections into different rows, but I want them to show as a,b,c together not a(next row), b(next row),c. Does anybody know how should I use the magic ETL to do that? I used my old way to transform the…
-
Renaming Columns and NOT breaking cards
I am barely getting started with the vast DOMO world so forgive me if this is an obvious thing. I was recently creating a dataflow and some cards from that dataflow and decided to test something out. I created the card using a column from that dataflow and then proceeded to change the name of that column in the dataflow.…