-
String to date
Hi, I'm trying to take the 'DUE DATE' column below (covered by the mouse) and turn those numbers into dates. 20123 is supposed to be 02/01/23 The solution I first thought of was to just split the columns but because it is showing up as text, it wont do that. Is there a beast mode to just pull the last two, the middle two…
-
Any Way to Use Regular Expressions to Change Case of Specific Words
I've got a requirement to change the appearance of articles and prepositions in words in a column to be displayed as lowercase after running a Title Case on the rest of the phrase. Right now, I have an extensive list of text replacements in Magic ETL to do this, but I was wondering if there might be a way to do this with a…
-
Correlation analysis in Domo?
Is it possible to conduct a correlation analysis in Domo using ETL (or other means)? If so, how? P.S. my analysis will include 3+ variables
-
Splitting up multiple-value fields into multiple rows
Hello, I have a dataset like this: ID Num 1 10 2 20, 30 3 40, 50, 60 I want to use Magic ETL to break these out so each row has one "Num": ID Num 1 10 2 20 2 30 3 40 3 50 3 60 Thank you
-
Filtering data will completely remove blank values
Hi community, I'm not sure if this is by design or if this is a bug. Filtering data within a field will completely filter out the blank values as well. It looks like Domo won't recognize the Blanks as a value. This is an scenario: FieldA, FieldB CategoryA,12345 CategoryB,58679 ,89658 CategoryD,97865 CategoryY,74935 Filter:…
-
Regex Replace Issue
Hello, I'm trying to do a regex replace to grab a combination of letters and digits but throw out the rows where I don't get anything. Here is my formula: case when REGEXP_LIKE(`Asset name`,'^.*([a-z]{4,5}\d{6}).*$')=1 THEN REGEXP_REPLACE(`Asset name`,'^.*stc=?([a-z]{4,5}\d{6}).*$','$1') else NULL end To explain, I'm…
-
search and replace
Is there an equivalent to search and replace in ETL? i have a data set that I need to change the word 'Not' to something else - the problem is i only want to change that word and only that word. Any suggestions?
-
separating Output datasets from ETL
I think I made a a mistake of having 1 ETL facilitate some simple transformations for several input datasets. I have the ETL triggered to run whenever any of them update... but now it occurred to me that the ETL is going to keep running every time one of them updates - and I'm afraid it won't pull in the latest updates…
-
Adding data that matches a date to a date dimension table.
I have HR data that has Start Date and End Date (or null) for each employee. I am looking to be able to see the number of active employees at any given date. I have added the Domo Date Dimension table to my data set, but I can't figure out how to join so that for any date I can get the count of employees who's start date…
-
Magic ETL: How to REMOVE Rows Meeting a Two-Column Criteria?
As part of my ETL, I'm trying to REMOVE rows that meet the following criteria: column 1 is NOT NULL AND column 2 is NULL So if column 1 has any value in it AND column 2 is empty, then remove those rows from the data set. I was trying to figure out how to create a Filter Formula for this, but it seems to be designed for…
-
Can someone help with a simple join?
This is a super simple problem, not sure what is going on but I am hoping a fresh set of eyes might help. All I am trying to do is take the 'property_address' column from the powerlender table and use that information onto the foreclosure table - foreclosure is otherwise all ready to go. Both tables have a loan_id (one is…
-
Reporting on a dataset e.g. duplicates, null values and data types
I was wondering if someone could help? I have a dataset containing 196 columns, I would like to know which of the columns are entirely null, which contains data, what level of duplication the field has and what type of data is in the field. There is a similar question here, but this is more about removing as opposed to…
-
To create ETL
I want to get a new etl by connecting two datasets. All stages are working, but they do not pass to the output part. When I press the save button, it does not save my work. Also, I was able to combine a data set and a file that was on my computer before using the "join data" command. Now this option is not active. I cannot…
-
Formatting Fiscal Year and Quarter columns
I am trying to format a column that labels 'FY23' and 'Q1' based on a Period date. What would be the formula to create this? I know Quarter() and Year() functions work but how would I use those functions to format it in the way I need to see it? Thanks
-
Allowing comments on ETL schedule changes
We frequently have to disable automation on our Magic ETLs when troubleshooting issues. Currently there is no commenting option as exists when you save edits to the ETL logic. We need to track for auditing purposes why we disabled and then re-enabled automation and need to tie it to an incident number. If we had the…
-
Using Magic ETL, how can i sort an aggregated string?
-
Sum Orders, Line Count, Sales by day of the week (Friday, Saturday, and Sunday)
Hello, my dataset has 7 columns: Invoice date, location, orders, ... invoice total (see screenshot); I want to sum orders, line count, and sales by day; meaning January 21 2023 Friday's orders =DC 12 ATL's orders + DC 11 MOB's order = 65+0. Friday's sales = DC 12's Invoiced total + DC 11's invoiced total = $10,932.39 + 0.…
-
Magic ETL can use Federated Dataset
Hi, We have number of cases where we want to use Magic ETL using federated Dataset. Can discuss them? Thank You. Best Regards, Tejal
-
Datasets join issue
I'm trying to create a card that can be used to present to budget owners how much they have currently spent for the month compared to the budget they've been given. In order to do so, I have to create a dataflow that involves joining 2 datasets; One is Netsuite, which stores all the journal entry transactions, and the…
-
String Operation Add Space to Postal Code
Hi All, I cannot seem to find out how to add a space to a Postal Code Column using new Magic ETL. Trying to change a text string eg: S4L1A5 to S4L 1A5. thx!
-
Timestamp Runs Recursive Dataflow Magic 2.0
Hello all! I feel like I have lost it but I am looking for a simple way to timestamp each run in a recursive dataflow. The output dataset is simply appending on top of itself with no exclusions thereby producing a new set of rows based on the latest data available in the source dataset. When I try and timestamp I am…
-
Calculate time between two dates during business hours, excluding holidays & Sat/Sun
Need to calculate the elapsed time/minutes between Start Date and End Date, using business hours of 9:00AM to 5:00PM, excluding Saturday/Sunday & holidays. Anyone able to help? either in Magic ETL or Beast Mode.
-
Reg Ex difficulty
I am attempting to pull out a string using Reg ex. I want to get the card name, so text after the --- card_name: and between measurable_id. I am using .*measurable_id) but it is giving me an error message?
-
Calculated Column if 2 Fields Match
Hi - I am trying to create a calculated field similar to the = or EXACT function in excel - example =IF(TRIM(A27)=TRIM(B27),"Match","No Match") I need to know if 2 columns have fields that match for any value. Specifically, if email addresses are the same in each column. Thanks!
-
Magic ETL - Undo Button
Can we add an Undo Button to Magic ETL. This would be especially helpful when we accidentally delete a tile when clicking to drag it.
-
How to correctly use distinct count and case when in etl (unknown error)
Could someone help and explain what's causing this error? And how to correct it? Thank you