Magic ETL
Discussion List
-
What happens to my ETL output with an Append update method if the input dataset columns are edited?
I have a dataflow that is appending data onto itself daily to see trends over time. One of my columns in the input got merged with another column for a different project to help with some data cleanliness. While this was a good change from that perspective, it appears the old column (and the 16 months of history that was…
-
Removing corner (X) on Magic ETL tiles?
Can we please bring back the one click removal of Magic ETL tiles with a top left corner (X)? Adding an extra click to open a sub menu to remove a tile seems counter intuitive to making the tool more user friendly. At least let us toggle the functionality in the Magic ETL user settings. This may be only an update in Beta…
-
JSON Canvas Pasting Documentation / Markdown File
Provide documentation, and example JSON file including all needed examples, or a markdown file of how JSON should be formatted for pasting directly into a canvas to be used by external AI models. I've worked with Claude a lot on how to provide JSON files for me to paste into Domo, and it's been a lot of trial and error,…
-
How to find anyway to Report on Column Usage in Cards
We're currently reviewing our datasets to eliminate redundant and unused columns. Is there a way, through DomoStats or a Governance report to determine which columns are being used by cards and which columns have no usage across the platform?
-
Domo Community Declining - Oliver to Blame?
Hi my fellow Domo Sapiens, I've noticed a drastic drop in community activity now that the chat agent, Oliver, is present on the landing page and able to help answer questions. "Softball" questions (easy ones that I could answer) are less common now that Oliver handles the easy ones. While I do appreciate the efficiency of…
-
Sandbox repository support for dataflows with split filter or split join tiles
Currently sandbox doesn't support promoting repositories with dataflows that contain either a split filter or a split join tile. This makes the sandbox unusable with dataflows that contain these features. Please update the sandbox to be able to function with dataflows with the split filter and split join features.
-
Uploading PDP Output into an Existing ETL
I have full editing and PDP access to an ETL output. However, I need to include this output into one of my existing ETLs. When I make a brand new ETL it allows me to include it as an input, however, if it's in my existing ETL is will not allow me. I've never had this issue before. New ETL: Works to Pull In Existing ETL:…
-
Any Cool Hacks lately?
I was lurking in some threaded chats with Domo users this morning and was impressed again with how ingenious people are with making Domo deliver unique solutions for very specific situations. Sometimes "Working as Designed", isn't always the way to respond to specific data or business needs. What is something you've done…
-
Magic ETL - Selectable Preview
While you expanded the amount of rows that can run for a preview, what would be even better is being able to select data that is previewed, even if it's something like most recent 400K rows. Changes that we generally make to an ETL is due to updates in the data flowing through but it's difficult to test that logic when the…
-
Magic ETL Preview Single Tile
While you implemented a Run To Here option as @garetthansen requested back in September 2024 (https://community-forums.domo.com/main/discussion/68206/magic-etl-preview-single-tile-run-to-here?utm_source=community-share), what is still needed is the ability to run a single tile. When making a small change to a tile and…
-
Can an "orphaned" output dataset be re-added to a dataflow?
Prior to the ability to disable tiles, I would sometimes add another output dataset to a dataflow for quick testing/validation purposes. Then, when I didn't need it, I would remove it from the dataflow. The result is that I have quite a few output datasets no longer associated with a dataflow. Is it possible to pull these…
-
Split Filter breaks when Promoting
We are running into an issue when we promote any ETL utilizing split filters from our Dev environment to our Prod one. They break and then its not just a simple reconnect them. We have to replace the split filter plus the tiles before and after for the ETL to work correctly. We use the normal sandbox commit and promote…
-
identifying which etls and join tiles reference a certain column
Does anyone know of a relatively quick way to identify any ETLs and join tiles that are using a specific column? Is this perhaps an AI use case? Thanks
-
Need to display total count to be displayed on Grouped bar chart.
How to display a total rows count for each individual. Our major need to show the total inside the same chart.No option in chart properties to select show total rows count under data label settings.Is it possible to display a total for each series in a domo grouped bar chart.
-
Variables inside Magic ETL
It would be nice to be able to declare a variable inside the ETL whose value could be used elsewhere like you would in a TSQL script declare @Date as date set @date='20260712' then for anyplace you want to reference a date you can drop in @Date. This would help make using the date tiles so I can have a single branch to…
-
Magic ETL: AI Text Generation Tile
Has anyone noticed a pattern in the AI Text Generation Tile regarding run time? Two days ago, I passed through 100 rows to test the prompt and my ETL ran successfully in 10 minutes. Then I passed through 23k rows and it ran in about 55minutes. However today, processing 23k rows again after 9 hours with an "unknown error"…
-
Semantic modeling - support for repositories needs to be added
We are taking part in the semantic modeling beta. The feature is coming together nicely and we were looking forward to using it behind some of our dashboards. However, we're running into problems on this front: it's currently not possible to use repositories to deploy a semantic model from one environment to another. On…
-
Can we use a semantic model as a data source in Magic ETL?
I'd like to use one of our semantic models as the basis for a new dataset, rather than having to recreate all of the joins in Magic ETL. Is it possible to use a semantic model as the input to an ETL? The only workaround I've come up with is creating a table card from the semantic model and exporting the data from that, but…
-
Any way to view schedule for dataflows?
Hi y'all! Hope everyone's having a good Monday so far. I'm trying to create a table card with a row for each DataFlow that has a trigger to run on a schedule. I looked through the DomoStats DataFlow History Dataset and Domo's Dataflow Details, but I can't find it. Is it accessible anywhere? I also looked through the API…
-
Run only when all input datasets have been updated
Please add a run trigger that will trigger only when ALL the input datasets I selected have been updated. That applies to both Magic ETL and Jupyter notebook. Currently, when setting a run trigger and adding a condition to run when selected input datasets have been updated since the last successful run, the dataflow will…
-
SQL Script
In standard SQL, aggregate functions such as SUM(), AVG(), COUNT(), MIN(), and MAX() are typically used in conjunction with a GROUP BY clause when selecting non-aggregated columns. This ensures that the output is deterministic and logically grouped. In the Domo SQL Script tile, it appears that aggregate functions can be…
-
Control ETL Trigger Refreshes Based On Root Datasets Or a SQL Query Result
Currently we have a Domo view that is comprised of 4 or 5 different datasets. These datasets individually refresh the time between the first dataset updates and the last one updates is about 5-10 minutes. I have ETLs that have this singular view as my source input, if I put a trigger condition on it for when datasets…
-
Mini Window gone
I don't know why but for about a week now, my ETLs don't have that little mini window you can use to move around the ETL. I'm thinking I must have toggled that feature off, but is that even possible? Thank you
-
Dataset Deletion - Disable Upstream Dataflow Branch / Allow Upstream Dataflow to Still Run
When viewing a dataset, you can see the downstream impact of deleting that dataflow. The problem is, if you delete a dataset that is an output of a dataflow, it makes it so that dataflow can't run. This is an issue if that dataflow has multiple outputs and other outputs are still needed. It would be nice to have the option…
-
How To Use DomoGPT Large V2.2 AI Service Layer In Text Generation Tile
I can't find the DomoGPT Large V2.2 AI service layer in the text generation tile, is it not available in the beta program?
-
Same period last year measure
Is there a way I can get the data for the same period last year? Example, I am comparing the sales of a salesperson for the first 3 months of 2026 and trying to see what the same sales would be for the first 3 months of 2025.
-
Field contains apostrophes(') likely introduced through HTML encoding, showing differently in hover
Field contains apostrophes (') introduced via HTML encoding, causing inconsistent rendering between table cards (which display values as-is) and bar charts (where apostrophes are missing or altered in hover text/tooltips). Beast Mode REPLACE functions did not resolve. How to solve this functionality. eg: " "
-
Allow Groups as Owners of DataFlows
Today, groups cannot be assigned as the owner of any dataflows. This means, that any output of a given dataflow is by default set as the same owner. It also means that by default, error alerts are only sent to one person instead of a team. We have a use case involving a development team who cannot be granted the manage…
-
beastmode versus ETL formula - same formula, different result
In my screenshot, the "charge_hour_test" column and "test3" column are the exact same copy and pasted formula, but the "charge_hour_test" is being performed in the ETL and is incorrectly showing 7.0.00 whereas the "test3" is a beastmode and correctly showing 7.00. I can't figure out why they are mismatching each other. The…
-
Long Running Dataflow Alerting/Auto-Restart
We need to have the ability to understand when dataflows are running longer than the average duration. We would like to set user defined alert criteria based upon the dataflow's duration. For example: alert when dataflow has been running 15min, 1hr, etc. longer than the average for the dataflow. Having the functionality of…
Upcoming Events
-
New User Launch Webinar
Whether you’re new to Domo or adding new users to your team, we want to help your team get up and running faster and make it easier to find the resources available to support your success. Why attend? Get oriented faster and avoid common early roadblocks Learn where to find answers, training, and support Discover ways to…