Magic ETL
Discussion List
-
Field contains apostrophes(') likely introduced through HTML encoding, showing differently in hover
Field contains apostrophes (') introduced via HTML encoding, causing inconsistent rendering between table cards (which display values as-is) and bar charts (where apostrophes are missing or altered in hover text/tooltips). Beast Mode REPLACE functions did not resolve. How to solve this functionality. eg: " "
-
Allow Groups as Owners of DataFlows
Today, groups cannot be assigned as the owner of any dataflows. This means, that any output of a given dataflow is by default set as the same owner. It also means that by default, error alerts are only sent to one person instead of a team. We have a use case involving a development team who cannot be granted the manage…
-
beastmode versus ETL formula - same formula, different result
In my screenshot, the "charge_hour_test" column and "test3" column are the exact same copy and pasted formula, but the "charge_hour_test" is being performed in the ETL and is incorrectly showing 7.0.00 whereas the "test3" is a beastmode and correctly showing 7.00. I can't figure out why they are mismatching each other. The…
-
Long Running Dataflow Alerting/Auto-Restart
We need to have the ability to understand when dataflows are running longer than the average duration. We would like to set user defined alert criteria based upon the dataflow's duration. For example: alert when dataflow has been running 15min, 1hr, etc. longer than the average for the dataflow. Having the functionality of…
-
Update Extract Dataflow Logic
This is the current return block of the domo function for Extract Dataflow Logic: return { dataFlowID, dataFlowName, parentObjects, enrichedActions, triggerSettings: metadata?.triggerSettings }; } When I pass a dataflow id that doesn't have a trigger I get an error in my workflow Function output results had the following…
-
Announcing the Datasource Swapper: Move your existing Cards, Views, and ETLs to new datasets in bulk
Hi everyone, I am excited to announce the release of the Datasource Swapper! Whether you are building new datasets because you are moving to a new data provider, transitioning away from materialized datasets in favor of Cloud Amplifier, or dealing with forced changes caused by vendor API deprecations, this tool was created…
-
MagicETL Completing, but Dataset not showing as updated. Fixes?
I have an ETL that runs every morning at ~3:30 AM. It usually runs about 1.5 hrs, then outputs 3 datasets. The ETL shows that is ran successfully. Two of the three datasets are updated to show the new data in the dataset. The 3rd (and most important) is still showing the data from the previous day and the time stamp on the…
-
Editable Dataset use as an input dataset in Magic ETL error
I created a Magic ETL using a Editable Dataset as an Input. When I run pre-view for the ETL, it show "Failed to get details for required DataSet 'editable_dataset_id' But when I click on the Tile "Input Dataset" in the ETL, go to "Data" Tab, I can see the column populated in there. Does anyone know why? And how to fix this?
-
Can output dataset be the same as an input/existing dataset in Magic?
I am trying to join form responses on a dataset to update the approval status of some journal entries, but don't want to create a completely new dataset. There are cards built to show statuses based on the input dataset, so the idea is that the form responses approving the entries would just update the status instead of…
-
Enhancement Request: Wildcard Column Search in ETL
The current ETL search functionality is useful, but it becomes limiting in complex pipelines where column names include prefixes and suffixes. In large-scale ETLs with multiple datasets, joins, and transformations, locating specific columns during logic updates is time-consuming and inefficient. Requesting a wildcard-based…
-
Add which dataset triggered the Magic ETL to the execution details
Something really helpful is to add which dataset triggered a run on the details view of a Magic ETL run. A lot of times flows have many triggers and being able to quickly figure out which one can be valuable to make sure that run has the data needed or if it has ran due to some other dataset, etc.
-
Add AI in Formula
Add the "Write with AI" feature to the Formula tile in Magic ETL, similar to what's in the beastmode editor
-
Creative assets from Facebook
Has anyone had luck pulling in creative assets (links to content or embeddable content) from Facebook? I've tried many different configurations on the Facebook Ads Advanced connector and I assume I need a few different tables and some ETL work - but if anyone has some pointers on what components to grab I would be…
-
The Math Isn't Mathing
I need to move some beast modes into Magic ETL to help solve a total/subtotal issue. In my attempts to do that I've come across an unusual issue. I have a formula that doesn't seem to want to work. Budget SFM/LB (SUM(Budget Sales Dollars) - SUM(Budget COGS)) / SUM(Budget Pounds) This beast mode works just fine in a card…
-
Community JSON Template Library with Input Mapping
It would be awesome to have a "repository" of sorts, similar to GitHub, for JSON files for magicETL dataflows, paired with mapping instructions for inputs. This would be great for commonly used / needed dataflows, for example, anything having to do with governance that utilizes the out-of-the-box domostats and…
-
Lag to set a forecast
I am trying to use actual values to project forward. For example, I have a table that has Month (12 rows: January 1, 2026 - December 1, 2026) and a column 'Actuals' that is filled in For January, February and March. I can join that table to an Assumptions tile that has month over Month factor for all twelve months in the…
-
How to Update Historical Data in an Append-Based Magic ETL?
Hi, I’m working with a dataset that is updated monthly through a Magic ETL, where new data gets appended to the historical dataset. I now need to make a one-time correction to the existing historical data in that output dataset. However, when I try to create a new Magic ETL for this, it generates a separate dataset instead…
-
3 Datasets for Sales $ - how do I connect those 3 so that I can add a variance column quickly
In DOMO, I have: Dataset A: Sales $ at order level, daily (millions of rows) Dataset B: Sales $ at order level daily (millions of rows) Dataset C: Sales $ by Month (100 rows) Goal: I want to compare the Sales $ between these 3 sources quickly. Option 1: Create ETL, grouping Sales $ by Month for Dataset A and B, then join…
-
Add Concurrent Editing Lock / Notification for Magic ETL Dataflows
Currently, when multiple users work on the same Magic ETL/Dataflow, changes made by one user can unintentionally impact others. It would be helpful to have: A notification when a dataflow is being edited by another user A locking mechanism to prevent simultaneous conflicting edits An option to rerun or restore ETL data…
-
Add a Dynamic Transpose Tile to Magic ETL
I have a dateset that is received with field headers in column 1 and data in column 2-X (varable amount of data elements). I need to be able to dynamically transpose that dataset (flipping columns and rows) so the data elements are stored in rows and the field headers are Row 1 allowing me to easily append data refreshes…
-
BUG - Constrained Joins not working
Noticed a few weeks ago that the constrained join feature on the join tile (one-to-many and many-to-one) in Magic ETL does not work, allowing joins that should fail to process. This is a big deal for us as we use the join constraints to ensure we don't have any cartesian joins in our data. This bug has huge implications…
-
Annualized Trailing Twelve Months Financial Reporting
I need to know if there is an easy way to create, either within Analyzer or using an ETL, that will allow me to create a financial report showing an Annualized trailing twelve pivot table (or just a table). The attached example is showing a trailing twelve months (one month per column), but I want the columns to show the…