Magic ETL

This is the current return block of the domo function for Extract Dataflow Logic: return { dataFlowID, dataFlowName, parentObjects, enrichedActions, triggerSettings: metadata?.triggerSettings }; } When I pass a dataflow id that doesn't have a trigger I get an error in my workflow Function output results had the following…

Hi everyone, I am excited to announce the release of the Datasource Swapper! Whether you are building new datasets because you are moving to a new data provider, transitioning away from materialized datasets in favor of Cloud Amplifier, or dealing with forced changes caused by vendor API deprecations, this tool was created…

I have an ETL that runs every morning at ~3:30 AM. It usually runs about 1.5 hrs, then outputs 3 datasets. The ETL shows that is ran successfully. Two of the three datasets are updated to show the new data in the dataset. The 3rd (and most important) is still showing the data from the previous day and the time stamp on the…

I created a Magic ETL using a Editable Dataset as an Input. When I run pre-view for the ETL, it show "Failed to get details for required DataSet 'editable_dataset_id' But when I click on the Tile "Input Dataset" in the ETL, go to "Data" Tab, I can see the column populated in there. Does anyone know why? And how to fix this?

I am trying to join form responses on a dataset to update the approval status of some journal entries, but don't want to create a completely new dataset. There are cards built to show statuses based on the input dataset, so the idea is that the form responses approving the entries would just update the status instead of…

The current ETL search functionality is useful, but it becomes limiting in complex pipelines where column names include prefixes and suffixes. In large-scale ETLs with multiple datasets, joins, and transformations, locating specific columns during logic updates is time-consuming and inefficient. Requesting a wildcard-based…

When using dark mode and using "Generate Formula" in Formula Editor, the text typed in is also black so you can't see what you type.

I love magic and a lot of the new upcoming beta's like add node from tile will be a big help. I've created a custom chrome extension that I use to add features/fix bugs in Domo. I've got a few ideas from it that I think would fit within the ideas for power users. - Easier Re-order Select Columns Allow for the re-ordering…

Something really helpful is to add which dataset triggered a run on the details view of a Magic ETL run. A lot of times flows have many triggers and being able to quickly figure out which one can be valuable to make sure that run has the data needed or if it has ran due to some other dataset, etc.

My coworker, Nathan, sent me this meme which I think explains things pretty sufficiently. I imagine this is just a case of rounding up vs rounding down leading to the discrepancy. I doubt this would happen very frequently, but 1,000K does require a bit more mental effort to process 😂

Add the "Write with AI" feature to the Formula tile in Magic ETL, similar to what's in the beastmode editor

Has anyone had luck pulling in creative assets (links to content or embeddable content) from Facebook? I've tried many different configurations on the Facebook Ads Advanced connector and I assume I need a few different tables and some ETL work - but if anyone has some pointers on what components to grab I would be…

I need to move some beast modes into Magic ETL to help solve a total/subtotal issue. In my attempts to do that I've come across an unusual issue. I have a formula that doesn't seem to want to work. Budget SFM/LB (SUM(Budget Sales Dollars) - SUM(Budget COGS)) / SUM(Budget Pounds) This beast mode works just fine in a card…

It would be awesome to have a "repository" of sorts, similar to GitHub, for JSON files for magicETL dataflows, paired with mapping instructions for inputs. This would be great for commonly used / needed dataflows, for example, anything having to do with governance that utilizes the out-of-the-box domostats and…

I am trying to use the data from an Editable Table in MagicETL, but it keeps getting an error. I copy/pasted about 2000 rows of 2 columns into the Editable Table. Is there something special I need to do to use the Editable Table in MagicETL?

I am trying to use actual values to project forward. For example, I have a table that has Month (12 rows: January 1, 2026 - December 1, 2026) and a column 'Actuals' that is filled in For January, February and March. I can join that table to an Assumptions tile that has month over Month factor for all twelve months in the…

Hi, I’m working with a dataset that is updated monthly through a Magic ETL, where new data gets appended to the historical dataset. I now need to make a one-time correction to the existing historical data in that output dataset. However, when I try to create a new Magic ETL for this, it generates a separate dataset instead…

In DOMO, I have: Dataset A: Sales $ at order level, daily (millions of rows) Dataset B: Sales $ at order level daily (millions of rows) Dataset C: Sales $ by Month (100 rows) Goal: I want to compare the Sales $ between these 3 sources quickly. Option 1: Create ETL, grouping Sales $ by Month for Dataset A and B, then join…

Currently, when multiple users work on the same Magic ETL/Dataflow, changes made by one user can unintentionally impact others. It would be helpful to have: A notification when a dataflow is being edited by another user A locking mechanism to prevent simultaneous conflicting edits An option to rerun or restore ETL data…

A recent question posted hours clocked using a bar chart. Just as I was reading their question, I had a similar need. I thought possibly others might benefit from the way I choose to handle this. We were counting hours a doctor was working vs hours the staff was working to identify whether we had areas over staffed. In…

I have a dateset that is received with field headers in column 1 and data in column 2-X (varable amount of data elements). I need to be able to dynamically transpose that dataset (flipping columns and rows) so the data elements are stored in rows and the field headers are Row 1 allowing me to easily append data refreshes…

Noticed a few weeks ago that the constrained join feature on the join tile (one-to-many and many-to-one) in Magic ETL does not work, allowing joins that should fail to process. This is a big deal for us as we use the join constraints to ensure we don't have any cartesian joins in our data. This bug has huge implications…

I need to know if there is an easy way to create, either within Analyzer or using an ETL, that will allow me to create a financial report showing an Annualized trailing twelve pivot table (or just a table). The attached example is showing a trailing twelve months (one month per column), but I want the columns to show the…

First, I want to share that the search functionality within Magic ETL has been very useful. I would like to propose an enhancement to further expand this capability. Currently, when searching for a value such as a Product ID or specific field name, the results return locations where the string explicitly appears. However,…

When a dataflow runs, whether it's a SQL or ETL dataflow, if there are multiple outputs, the dataflow will say it has completed its run when the first dataflow output completes. So even if another output is still processing, the dataflow looks like it's complete. It makes it difficult to know when a dataflow output has…