Magic ETL

I am working with a dataset that pulls in sales and inventory data for items on a daily basis. In data analyzer, I created a table with the data grouped by week. After grouping by week, most of the fields in my card (i.e. Revenue, Units Sold, etc.) are aggregated by SUM because I would like to know the sum of all of the…

Hi all, I need to split a column that contains both a client name and number into 2 separate columns. Some client names themselves contain whitespace, so I cannot split on whitespace and am looking at Regex, though it's been a while since I've used it. All the client numbers are 5 digits long, though they are randomly…

Greetings! I am sending csv reports to box and using the Advanced box connector to retrieve the files and add them to a magic ETL. The reports from the current and previous years work great. I would like to set up this process to run through 2026 so I am sending empty reports for 2024-2026. They currently populate box with…

Greetings Domo Community, I have currently been refactoring Magic ETL tiles and have been attempting to use Python and R scripts to test for equality before finalizing the refactored tile components. Using both approaches with Python and R I have had significant difficulties in completing this task, which I will outline…

What are the est practices to maximize speed and minimize data storage when updating a large dataset? I have an example but any tips on performance I'm willing to hear. We have a dataset that consists of an initial load (~ 1 million records) and a daily* update of ~ 20k records (and growing). Within the first year we…

Hi All, I'm currently trying to recreate a MySQL flow in Domo to ETL. One of the first things we are doing in a table is taking out extra characters from a column to create a new trade_id Here is how we are doing it. when I go to add the formula tile and copy and paste this syntax, ETL is saying it doesnt recognize the…

I've been trying to do the following but can't figure out the best way to do it. I have a table that looks basically like this: user_id|ticket_id|inquiry_type I want to filter out rows for a specific user_id when ALL of the rows for that user_id have a value of "false_inquiry" in the inquiry_type field. But if the user has…

Hi, I wanted to rename App to Web for this campaign, and I tried using a formula to achieve this in the ETL. Here is my formula CASE when campaign = 'CM1' then 'Web' else channel END But this is not giving me the expected output. Could anyone please help me with this? I actually wanted to achieve this in ETL only, not in…

Greetings DOMO, Does anyone know how to find the first non-null value of a column in a formula tile. Tried using Coalesce along with a few tricks and couldn't get anything to work. All help would be appreciated. Cheers, Will

I am trying to create a pass/fail test in magic ETL. There are four test it needs to go through to pass or fail. Once a row is listed as fail I would want all the rows matching that submission ID to fail as well how would I go about this or what is the correct formula to use? for example It failed the first test but passed…

Im having some issues with my dataflow,i cant edit the ETL beside im the owner, i dont now what i have to do to solve the issue

To work out the success rate I need to (a) count number of rows where 'Status' column has 'Application Granted' and divide this by (b) count number of rows where there is a value in 'Determination Date' column. A / B = Success rate Any help would be much appreciated, cheers

I am working on setting up some recursive data structures to capture the data I need for this instance it charges in a period. We can call this resident's charges. Charges are accumulated until a post date which is most of the time the 21's day of the month with some exceptions. I have a small web form that lists these…

I am using the Domo Dimensions Calendar as an input to a Python script that updates an dataset of the next 365 days as columns |2023-01-27 | 2023-01-28 | 2023-01-29 | 2023-01-30 | ........ | 2024-01-27 So, when the script runs tomorrow the first column will be 2023-01-28, and so on. It works, to a point. The first daily…

I have a start date and an end date. How do i have those dates in between appear? (ETLs/Codes)

For some reason I am getting a self referencing value rather than a NULL. In this example, I was expecting the Next Row Column to be NULL for the last row. Instead, it seems to be self referencing the student enrollment # column. The first 5 rows in the example are correct. Is this the default behavior of this…

Hi, I'm trying to take the 'DUE DATE' column below (covered by the mouse) and turn those numbers into dates. 20123 is supposed to be 02/01/23 The solution I first thought of was to just split the columns but because it is showing up as text, it wont do that. Is there a beast mode to just pull the last two, the middle two…

I've got a requirement to change the appearance of articles and prepositions in words in a column to be displayed as lowercase after running a Title Case on the rest of the phrase. Right now, I have an extensive list of text replacements in Magic ETL to do this, but I was wondering if there might be a way to do this with a…

Is it possible to conduct a correlation analysis in Domo using ETL (or other means)? If so, how? P.S. my analysis will include 3+ variables

Hi community, I'm not sure if this is by design or if this is a bug. Filtering data within a field will completely filter out the blank values as well. It looks like Domo won't recognize the Blanks as a value. This is an scenario: FieldA, FieldB CategoryA,12345 CategoryB,58679 ,89658 CategoryD,97865 CategoryY,74935 Filter:…

Hello, I'm trying to do a regex replace to grab a combination of letters and digits but throw out the rows where I don't get anything. Here is my formula: case when REGEXP_LIKE(`Asset name`,'^.*([a-z]{4,5}\d{6}).*$')=1 THEN REGEXP_REPLACE(`Asset name`,'^.*stc=?([a-z]{4,5}\d{6}).*$','$1') else NULL end To explain, I'm…

Is there an equivalent to search and replace in ETL? i have a data set that I need to change the word 'Not' to something else - the problem is i only want to change that word and only that word. Any suggestions?

I think I made a a mistake of having 1 ETL facilitate some simple transformations for several input datasets. I have the ETL triggered to run whenever any of them update... but now it occurred to me that the ETL is going to keep running every time one of them updates - and I'm afraid it won't pull in the latest updates…

I have HR data that has Start Date and End Date (or null) for each employee. I am looking to be able to see the number of active employees at any given date. I have added the Domo Date Dimension table to my data set, but I can't figure out how to join so that for any date I can get the count of employees who's start date…

As part of my ETL, I'm trying to REMOVE rows that meet the following criteria: column 1 is NOT NULL AND column 2 is NULL So if column 1 has any value in it AND column 2 is empty, then remove those rows from the data set. I was trying to figure out how to create a Filter Formula for this, but it seems to be designed for…