-
Dynamic Pivot
I love the functionality of dynamic unpivot for transforming my data vertically, I would love to see a similar functionality for adding columns
-
MTD and YTD TOGGLE
HI Team, I have a date field and what I'm trying to do is write a beastmode that looks at YTD and MTD without years. I have successfully done that in 2 separate beastmodes to give my a 'Y' or 'N' toggle. However when I try to combine them into one where the user can toggle 'YTD' or 'MTD' the 'MTD' isn't the issue.. it's my…
-
CTRL + Z undo in Magic ETL
Love the new undo/redo in Magic! Would love to have undo/redo keyboard shortcuts.
-
Magic ETL - 'REM' out work streams or individual Block from production
An ETL can have several workstreams. We may have a workstream we do not want to remove, but do not want running anymore. Today this is a challenge solved with copy or versioning, but what if you could 'REM' out a workstream or block. Example: I have a temporary filter I set or testing. Hate adding and deleting every single…
-
Magic ETL - Selectable Preview OR EXCLUDE from Preview
The ability to select specific blocks to run as a preview. Case: In an ETL we have several workstreams and outputs. I want to be able to select a specific area to exclude or include from a preview. Considerations: Will always need to have the source data to preview, but select a path to only preview.
-
Overage Execution Rows Protections
Just had a user accidentally do a join that we identified 7 hrs after the process started that was up to 72 billion rows. It was going to top out over 300 billion, but we hit cancel. However, that overflow credit usage topped out over 3,000 credits, which is not the kind of mistake you'd like your team to be making. So,…
-
Conditional Gateway Tile
Greetings, I would like to propose the addition of a tile that enables early termination of a dataflow without writing to the output dataset when specific conditions are met. A key use case for this feature would be terminating the dataflow if the input dataset contains zero rows. In such cases, the process should end, and…
-
Calculating YTD for each week in table
Hi, I want to replicate a table that looks like this: My dataset currently has date, impressions, and goal, and in ETL I've mapped the dates to a week by joining with another table. How would I use beast mode to find the impressions to date for each week, as well as the delivery percentage of goal?
-
Previous Month Last Year value Formula
Hi Everyone I'm trying to calculate a sum of values for the previous month for the previous year (February 2024 in this case) so that I can compare the difference to previous month for this year I've made a few attempts but have had no success What is the best way to do this calculation for last year previous month? Thanks…
-
Multi-Select/Checkbox Functionality in Search Bar for 'Select Columns' Tile (MagicETL)
When using the 'Select Columns' feature with a dataset that has many columns, it becomes a time-consuming process to search for and add each column individually. It would be incredibly helpful if we could implement a multi-select or checkbox functionality during the search for columns. For example, as shown in the image…
-
Magic ETL Canvas Settings in bulk
The ability to turn on Larger Grid and Grid Lines to all of a user's ETLs (my preference) or user selected ETLs in Magic. Currently users have to do this ETL by ETL. My belief is that if a user wants the grid enabled for one of their ETLs, they would probably want it enabled for all of them.
-
Group By tile not working with large dataset
Hi, I have a dataset of about 4.7M rows. When I try to use the Group By tile in Magic ETL to find a sum of values across IDs, and then join back on the ID, the new sum column is blank. However, in testing, when I filtered the dataset down to about 50K rows to see what was wrong, the example ID I was checking now had the…
-
Integer-Based Column Reordering in Select Columns Tile
Please add an option to manually reorder columns in the Select Columns tile by entering an integer position value next to each column—similar to reordering mechanisms seen in interfaces like Steam’s Wishlist or Spotify's playlist editor. This would allow users to explicitly control column output order by position, not just…
-
Comment out tiles in MagicETL
When building complex ETLs it would be handy to be able to "comment out" tiles so they are ignored for execution. For bonus points, I'd like to be able to have an unterminated chain of commented-out tiles not block the ETL's execution.
-
Fix ROUND() in ETL
It was noticed that ROUND() function rounds down in ETL when the last decimal is 5. It acts correctly in the card's beast mode.
-
Magic ETL Dataflow Schedule: add trigger for Dataset has not updated
The Dataflow schedule has a setting to trigger when input datasets have updated. It would be helpful if there was a way to schedule it run at a certain time if an input has not updated. There are occasionally issues with Workbench that cause input datasets to not run, but in some cases we have recursive dataflows…
-
Joins: Automatic Identification of Relationship Direction
Please add: Automatic identification of relationship direction within a Join tile. An option to amend this relationship direction (where appropriate) within the Join tile. E.G A drop-down with 1-2-1,1-2-Many, Many-2-1, Many-2-Many (inc warning) e.t.c A visible representation of this relationship direction with ERD arrows…
-
Options for Preview Run Limits in Magic ETL
The Magic ETL currently only max out at 400k row for the preview run from your input datasets. This is limiting the test preview in your flow as it only picks (from my understanding) the first 400k row of your dataset. So if you're trying to preview your actions (such as filtering) you may not get anything showing in the…
-
Prevent 2 People form Editing Same ETL at Same Time
When someone is editing an ETL, so no let another person enter edit mode on that same ETL.
-
Magic ETL Filter Question
Hi, I have two columns: Academic Plan (ACAD_PLAN) and Effective Date (EFFDT). Currently, I am using the Rank & Window and Filter tiles to retrieve the most recent EFFDT and, consequently, the latest ACAD_PLAN. However, when I apply the Rank & Window tile, sort EFFDT in descending order, and filter for Row Number = 1, I…
-
pivot tile?
hi I am working in Magic ETL and am having a tough time knowing how to do what I am trying to do. Below I have a dataset with 3 columns shown that I need. What I need to be able to do is keep the msp last run date on the left hand side but then pivot the `delinquent payment 2` into column names then show the loan count So…
-
Can I use Python libraries in Domo?
Hey everyone, I’d like to use scipy.optimize in Domo to perform optimization calculations (similar to Excel Solver). Since MagicETL has a Python Tile, is this where I should implement it? Thank you!
-
Equivalent to Excel Solver in Domo MagicETL?
Hi everyone, I'm working on a hotel lodging analysis and need to find something in Domo MagicETL with comparable capabilities to Excel’s Solver function. In Excel, we’ve used Solver to optimize the number of daily hotel room blocks (reservations made in advance) to minimize last-minute (adhoc) room bookings, reducing extra…
-
How to Filter for "Today AND Last 7 Days" in Domo Visualizer?
Hi everyone, I’m trying to implement a date range in Domo (using `Reservation Start Date`) that includes both Today AND the Last 7 Days at the same time. This will be for a weekly scheduled send. I know Domo has built-in filters for "Last 7 Days" and "Today," but I can't find a way to combine them in a single filter within…
-
New ETL Tile
It would be great to see an etl tile which can be placed before outputs of ETL which give the option to set different update frequencies for different outputs of the same ETLs.
-
Extract multiple sets of numbers from a single string
I am trying to extract two different sets of numbers from a string. I have tried substring and Regexp, but to no avail. Examples of the stringss- Possible string format #1 Company Name - 2024-07-01-2024-07-31 - GPPC - YTUBE - VYT - 63784 - 2782837 - 458573682 - [745-000121-003] Possible string format #2 Company Name -…
-
Help figuring out how to get a data set to work with a funnel
For context the data set image linked is a representation of the data I am working with to protect our real customer data. I do not have the ability to reformat the data coming in, only use magic ETL and SQL transformations to convert this data into the format it needs to be in. I can not find a way to make the funnels…
-
ETL fails due to "This data set does not support data version filtering."
I have my SQL raw dataset set to merge new rows which is working correctly: This SQL dataset is the input for my ETL attempting to process New rows then Upsert in the output dataset: However my ETL fails to run due to the stated error: Am I setting something up wrong? My raw SQL data is not partitioned but it is using the…
-
Magic ETL Column Search Improvements
The new Column Search feature is a godsend. But … it could be better with two modifications: Add a Match String checkbox to limit the search to match the text string exactly. I was searching for the source of a field in a very large ETL. It turned out that the name of the one I wanted (countAsCar, for example) is included…
-
Data Join Confusion - Magic ETL
Hi, I'm trying to join two sets of data together (assignments submission data & assignment summary data) For the output, I am trying to get a list of all assignments with a due date in a date range that have not been submitted by the students. The assignment submission data has a row for every student that lists every…