-
Issues with changing cast dataset to date
Hi! I am trying to change the data created column to date, but when I check append rows, it says the column is changing to timestamp. I am not sure what I am doing wrong.
-
routing ETL failures through zapier
Is it possible to send ETL failure messages to Slack using Zapier or a similar service?
-
WEEKOFYEAR is not aligning to ISO-8601, is this correct?
Hi, I recently utilised the Week of Year function for a date column. I'm unsure if this is incrementing from 0, but the value for the 12th of Feb 2024 returns 6. I would expect it to return 7. . Can someone confirm if this is intended? It looks to use Sunday as the start of the week in this function. Best, Sam
-
MAGIC ETL/DATAFLOWS Q&A from Domopalooza
The product team enjoyed answering questions from the audience during the final session at Domopalooza. Below you will find the answers to all questions related to Magic ETL and Dataflows (including those that weren't mentioned on stage). Q: When are you going to upgrade the MySQL version in MySQL DataFlows? A: We do not…
-
Group By issue
I am doing a group by tile in magic etl. i have different values for different ID's and need to sum up all the values in each ID. For some reason some of the ID's are not summing and I get null in column for the ID. I did formula to make sure all null values before grouping are 0 thinking that would fix it but for some…
-
Templated ETLs
I would love to be able to create an ETL and save that to use in other flows. A "save as template" button would be amazing. It would only save the tiles, not the columns, so you wouldn't have to delete everything before you start. We use recursive dataflows a lot, so it would be amazing if I could save that flow, and then…
-
Allow users to specify the color of Magic ETL tiles
This would be a small change that could help organize extremely busy dataflows. While you can currently change the color of the line
-
Show Configuration AND Notes panels on Magic ETL tile simultaneously
Currently, a user can see either the configuration of an ETL tile OR they can tab over to the notes section. It would be nice to see both views at once when writing notes on the configuration or editing the configuration based on the existing notes.
-
Reloading Recursive Dataflow Data
Hello, I have a recursive data flow running daily adding on and updating our sales data. It was discovered that the join wasn't using a fully unique identifier so some rows of data have been cut out over time. I want to clear out the data and resend it all to domo so that I make sure I have it all. Is there a way to clear…
-
Can I see the basic dataset length between different steps of an etl flow?
For example, I want to know how many rows are in the table before and after a pivot.
-
Preview Window Limits in Magic ETL
There is currently a 100 rows preview window limit when you do the preview run on the ETL. We need to increase this as it can help drastically with further work in the MagicETL.
-
Maintain Input DataSets when Pasting Copied Magic ETL Tiles
Currently, when copy and pasting Magic ETL tiles between flows, input tiles are scrubbed and become a plain input tile without a DataSet selected. I understand why you'd want to scrub this if pasted in the same flow, but it should be maintained when pasting in a different flow. This should be relatively easy to implement…
-
Dynamic Pivot
I love the functionality of dynamic unpivot for transforming my data vertically, I would love to see a similar functionality for adding columns
-
Filter Rows Tile | Option to include or exclude NULL
Currently if you use a filter such as <> or != "xyz", this will also filter out any NULL values in the column as well. This is default behaviour for SQL, and I do understand that the reason it's filtering out NULL is because it cannot compare a value to a NULL. So it implicitly excludes NULLs, just as SQL would. The…
-
Magic ETL Organization Tools
Thinking it would be great if Domo implemented some organizational tools within the Magic ETL. We've got some rather large ETL's, that get quite complex, and organizational tools (organizing tiles into buckets, with ability to minimize bucket, add descriptions to bucket, etc.) would help my team and company scale. Having…
-
Select All Columns in Remove Duplicates ETL Tile
Instead of having to add each column individually, it would be great if there was a select all columns feature for the remove duplicates step in the ETL.
-
Maintain tile position when copy and pasting Magic ETL tiles
When working with large enough groupings of tiles, or groupings near the bottom of the canvas in Magic and copy/pasting, there is a tendency for tiles being pasted on the canvas to be squished into the bottom. This can be a pain to untangle and reposition the grouping. It would be helpful if by default or through maybe a…
-
Domopalooza Cloud Amplifier & Magic ETL Feature Release
We are excited to announce enhancements to Domo's Magic ETL and Cloud Amplifier tools. Magic ETL Magic ETL is Domo’s secret weapon for building data pipelines with ease. With a simple drag-and-drop interface, Magic ETL makes it easy to clean and combine data without knowing SQL. In this release, enhancements have been made…
-
Change Number format in dynamic concat statement
I have create a concat statement to dynamically highlight a certain metric. Essentially it changes as the time period and other categories change. The number is showing in the format in the above picture and I am hoping I could abbreviate in Billion or at least show the number in account format. I would really appreciate…
-
How do I search for rows containing specific text and replace the information in that row?
I have a column in my ETL dataset that is named "City", in that column there are multiple city names however they have been put in in all different ways (ie: st george, St. George, ST George). I would like to search that column for rows containing 'george' and replace the information in that row with 'St. George'. I've…
-
Group By Question
Im trying to do a group by to get a new column with total sum of charges by bill ID. I want the total sum to be constant all for every day associated with Bill ID. When I do a group by I am not getting the new column to sum the charges. Bill ID Date Charge 502 4/10/2023 $85 502 4/11/2023 $76 502 4/12/2023 $110 502…
-
Ability to Search ETLs
It would be great if we could search key phrases in ETLs. I have a field called "Item" and I want to see every tool in which the column "Item" is impacted. For example, if I search "Item" and it's included in a select columns tool or an add formula tools, those tools should be highlighted when I search the key word/phrase.…
-
Allow Window Functions in MagicETL Formula Tile
It would be helpful to be able to write MagicETL formulas using window functions, similar to in beast mode. While the Rank & Window tile is often sufficient, there are some use cases where having this feature in the Formula tile would simplify the dataflow steps: Using a sum window function with unbounded rows This does…
-
Block tiles in Magic ETL to simplify complex dataflows
"Block Tiles" are larger tiles that contain a string of tiles inside. Block tiles could make large Magic ETLs (100+ tiles) easier to document, and much easier to read and understand. These tiles would contain a group of tiles that have a single output tile (not an output dataset) to make for an easy way to connect block…
-
Magic ETL - Allow group by without a grouping column
There are times when I want to calculate aggregated metrics across the entire dataset. Currently this isn't possible without adding a constant value column to group on which I then have to remove later in my pipeline. It'd be much smoother if the Group By tile allowed us to group across the entire dataset without having to…
-
Assign colors to tiles
I would like to be assign colors to tiles: this would make troubleshooting and code reviews much easier. A stretch goal would be to add setting the color of tiles to the options when you select more than one tile in addition to Delete, Duplicate, and Copy To Clipboard. Using this to visually indicate functional sections of…
-
Add Formula Rule to Join Tile in ETL
It has been extremely useful in Magic ETL 2.0 to have the Add Formula Rule available in certain tiles such as the Filter tile or Group By tile. I would like to see it be available in the Join tile as well. This would make it operate more like a SQL join. For example, if I need to use a BETWEEN statement for my join key, I…
-
Magic ETL Organization Tiles
Would be nice to have a feature to add a box around several tiles in order to organise better the dataflow. Sometimes we have a complex dataflow with several business logic and a lot of tiles, and it would be easier to identify the several steps with that boxes. An example of that is like the one in Unreal Engine:
-
Comment out tiles in MagicETL
When building complex ETLs it would be handy to be able to "comment out" tiles so they are ignored for execution. For bonus points, I'd like to be able to have an unterminated chain of commented-out tiles not block the ETL's execution.
-
More Dataflow suggestion: When I "cancel" out of a data flow don't dump me back to the Dataflow page
It doesn't always happen, but when it does, UGH. I hit cancel when in an ETL and then I go all the way back to the All Dataflows page. I don't want to go that far back. That's not even where I started. It seems to depend on how I get to the ETL. In this case I can be in the Overview page, click edit etl, once in the etl I…