-
Disable Outputs During Testing
An essential part of any workflow is seeing the entirety of the output dataset. However, with the consumption model, ETLs with multiple outputs have become more expensive and more inconvenient to test. I think it would be a good idea to be able to right click on a line leading to an output and disable it to prevent that…
-
Unpivot
Say my raw dataset looks like this: And I would like to unpivot any column that has a month name is it, so in this example, it's 'Jan 2024 Total Pts Earned' and 'Jan 2024 Pts Redeemed', and the dataset would look like this (add a date column, total pts earned and total pts redeemed column): How can I do this with Magic…
-
Adding source column in appended datasets using Magic ETL
Hello, I am trying to append a 8 datasets together and add a new column to the resulting output that is the source dataset for that row. That column is obviously not present in the original dataset. I just need to know where the data for that row originated so I can filter if needed. I have tried a few things but cannot…
-
How to compare to the entire dataset, and not just the filtered part of the card?
Hi, so I have a beast mode calculation in one of my datasets that looks like this: CASE WHEN SUM(SUM(1)) OVER (PARTITION BY TRACK: Title,LIBRARY: Name,TRACK: Version) > 1 and TRACK: Version = 'Full Mix' THEN 'YES' WHEN TRACK: Version <> 'Full Mix' THEN null else 'NO' end The purpose is to make sure that there aren't…
-
Save ETL With Error
I want to be able to save my ETLs regardless of what state they are currently in. I am frequently in a situation where I can't resolve an issue in the moment but want to save the ETL so my other changes don't get lost in the meantime.
-
Delimiter issue
Hello Team, I am trying to do a ETL in domo but unable to get desired result please suggest. In my input, i have a few columns, the lowest grain in Employee id, I have a column called Value, In this values are given using delimiter "|". In my below example there are 2 instances on "|" but in my data it can come any no. of…
-
Duplicate column feature name change in Magic ETL
The current duplicate column title is a bit confusing. I thought it would create another similar duplicate column like the existing one. However, it only replaces the values of an existing column. It would be nice if you could also allow someone to create a duplicate column without affecting the existing columns.
-
Beast Modes Affecting Card Performance
Hello, I'm curious if anyone else has noticed degraded performance making and editing cards due to the amount of beast modes on the dataset/card? We are trying to isolate this issue with some of our datasets, and try moving calculated field logic down to the ETL to come through as a column. Has anyone else experienced or…
-
Add ORDER BY to GROUP_CONCAT Function in Magic ETL v2
Currently, Magic ETL v2 supports the aggregate function GROUP_CONCAT in its Group By tile. While clauses inside the GROUP_CONCAT function like DISTINCT and SEPARATOR are available, the ORDER BY clause doesn't work and causes the tile to fail. SQL DataFlows currently support using the GROUP_CONCAT function with the ORDER BY…
-
ETL Fails = "Illegal Number of Inputs"
I have an ETL that is scheduled to update once per day, but every time it runs automatically, I get a failure after about 10 seconds stating: "Failed while executing. Illegal number of inputs. Expected one but got zero." I usually can rerun it around 2-3 times manually and then it works. There are no errors that I can see…
-
Calculating Time difference in Seconds Beast Mode
Hello, Is there any way to do the difference between 2 timestamps in seconds using a lead function in beast mode. For example in below table take the first 2 rows 9:51:47 seconds subtracting with first row that is 9:51:14 seconds and output should be 33 seconds. The column is in String datatype. Can I achieve this using…
-
Move output dataset from one ETL to another
I'm writing a new version of the ETL that generates our Employee Directory. The existing output dataset from the existing ETL feeds dozens of other ETLs, hundreds of cards, and quite a few external systems via either the SFTP connector or directly through API calls. When I've got my new version all set I'm going to have to…
-
View older ETL version without making that version the active version
I would like to be able to view older versions of ETLs without needing to make them active first. The way I envision it you would go to the Versions tab of an existing ETL and see a new menu item when you click on a version's ellipsis: View Version. Choosing this would open up that version of the ETL in read-only mode,…
-
Previous day status from snapshot data
I have snapshot data everyday that has customers and their statuses. I want to create a formula that looks back one day and reports the status (previous day status) How would I do that in Magic ETL?
-
Point ETL Output to Existing Dataset
I want to be able to point the output of an ETL to a pre-existing dataset. If, as part of a fix or as part of development, I need to make alterations to the ETL to get a desired output that I don't want to be the final ETL, it would be great to be able to make the changes and then point the final ETL to the preexisting…
-
Fill in gaps in data
I have rows of data that look like this: Customer: ID: 12 NULL 12 NULL 12 NULL 12 NULL 12 NULL 12 56 How do I fill in the above rows with the customer ID, 56, Using ETL?
-
Have Domo GPT help with ETL errors
I just spent 30 minutes in an ETL trying to figure out what was wrong. I get the basic errors like "Failed to turn a string into a date", but when I open the ETL and see which tile the error occurs in, I have no clue which specific formula or row is causing the issue. Especially because I will open the root datasources and…
-
Undo button in Magic ETL
The addition of the undo button in the Analzyer has been extremely helpful. I would ask that an undo button be added to Magic ETL as well. This would help people who accidentally delete a tile that had a lot of configuration in it. Or if you made a number of changes that don't work and you want to step backwards to get…
-
Combine 2 data set (One to many)
Hi Community, I am struggling with combining two data set like below As you can see we have one campaign but has many views. When I combine these two, spend would get allocated to all the rows in table 1. How can I join these two table without overcounting the data on table 2?
-
How to Duplicate Rows
I have a dataset that represents order information. Each row is a unique order ID. One of the column values shows the quantity. I would like to duplicate (or replicate) the rows based on the value in the quantity field. Example OrderID 12345 has a Quantity value of 5, so in the output dataset, I want 5 replicated rows for…
-
size of dataset
Is there a way in Domo to understand the actual size of the dataset? I know we can find the row count, but I am not sure how to find the size in GB/TB.
-
Many rows
I need to find a way to pull in many rows of data. I have two months worth of data which is essentially 110M rows. I need to pull in at least a year. Is there a way to do this? I tried the ETL partitioning method but it said 'too many rows of data'. Would workbench work with partitioning here or would I get the same error?…
-
Allow Group Ownership of Magic ETLs in DOMO
Currently only Datasets can have group ownership, however it would be a great timesaver if a group can have ownership of an ETL in Domo. It would make ownership more streamlined and controlled.
-
Sub-Category of a Category?
Hi All, We are working on a report that has a few different program_namesthat are summed up in a pie chart using orig_loan_amount. I have been tasked with trying to sub categorize our bonds using a taxable/tax-exempt designation The problem I am trying to overcome is that our bonds (identified by pool_name) are actually…
-
Logic - link original submit date to all subsequent back orders
Hello. I'm wondering if anyone has ever had a similar scenario/concept and have come up with good ways to achieve the desired outcome. I've attached a screen shot of real data. The goal is to get the submitted date of 7/5/2024 (A6) linked to orders in rows 7 and 8. The story of this data is that order id 16403748 was…
-
How to Use Partitioning to Retain Data in a Monthly Rolling Window Dataset
Hi Domo Community, I’m currently working with a dataset (via MongoDB Connector) that operates on a 12-month rolling window, where data older than 12 months is deleted on the 1st of each month. Long story short, I cannot change this configuration. But, I would like to retain some of this older data using partitioning before…
-
Extract the string values in between stroke and question mark in a URL
Hi Domo, I am looking for a way to extract the string values in between stroke and question mark in a URL Example URL: https://dam-bc.com/content/67-making-AI-trustable.pdf?_gl=1*ckt29z I want to extract this part of URL: "67-making-AI-trustable.pdf" Ideally if I can do that with a beast mode formula would be great. But if…
-
COLUMN NAME CHANGE - PUSH TO BEASTMODES / BEASTMODE SEARCH AND REPLACE
I think a good option would be that if a column name is changed in the Column select tile that if that old column is being used in beastmodes that we can push that change to all affected beastmodes. When managing 100's or thousands of beastmodes it makes it difficult to go back and correct if we have to change a column…
-
Selecting prefix for conflicting field names
When joining datasets, Domo alerts you to any conflicts in the naming. Specifically, any common field names have to be renamed. It defaults to using the name of the originating dataset as a prefix. We use longish, descriptive dataset names, and the narrow, static width of the editing line makes renaming very tedious. Is…
-
Templated ETLs
I would love to be able to create an ETL and save that to use in other flows. A "save as template" button would be amazing. It would only save the tiles, not the columns, so you wouldn't have to delete everything before you start. We use recursive dataflows a lot, so it would be amazing if I could save that flow, and then…