-
search and replace
Is there an equivalent to search and replace in ETL? i have a data set that I need to change the word 'Not' to something else - the problem is i only want to change that word and only that word. Any suggestions?
-
separating Output datasets from ETL
I think I made a a mistake of having 1 ETL facilitate some simple transformations for several input datasets. I have the ETL triggered to run whenever any of them update... but now it occurred to me that the ETL is going to keep running every time one of them updates - and I'm afraid it won't pull in the latest updates…
-
Adding data that matches a date to a date dimension table.
I have HR data that has Start Date and End Date (or null) for each employee. I am looking to be able to see the number of active employees at any given date. I have added the Domo Date Dimension table to my data set, but I can't figure out how to join so that for any date I can get the count of employees who's start date…
-
Magic ETL: How to REMOVE Rows Meeting a Two-Column Criteria?
As part of my ETL, I'm trying to REMOVE rows that meet the following criteria: column 1 is NOT NULL AND column 2 is NULL So if column 1 has any value in it AND column 2 is empty, then remove those rows from the data set. I was trying to figure out how to create a Filter Formula for this, but it seems to be designed for…
-
Can someone help with a simple join?
This is a super simple problem, not sure what is going on but I am hoping a fresh set of eyes might help. All I am trying to do is take the 'property_address' column from the powerlender table and use that information onto the foreclosure table - foreclosure is otherwise all ready to go. Both tables have a loan_id (one is…
-
Reporting on a dataset e.g. duplicates, null values and data types
I was wondering if someone could help? I have a dataset containing 196 columns, I would like to know which of the columns are entirely null, which contains data, what level of duplication the field has and what type of data is in the field. There is a similar question here, but this is more about removing as opposed to…
-
To create ETL
I want to get a new etl by connecting two datasets. All stages are working, but they do not pass to the output part. When I press the save button, it does not save my work. Also, I was able to combine a data set and a file that was on my computer before using the "join data" command. Now this option is not active. I cannot…
-
Formatting Fiscal Year and Quarter columns
I am trying to format a column that labels 'FY23' and 'Q1' based on a Period date. What would be the formula to create this? I know Quarter() and Year() functions work but how would I use those functions to format it in the way I need to see it? Thanks
-
Allowing comments on ETL schedule changes
We frequently have to disable automation on our Magic ETLs when troubleshooting issues. Currently there is no commenting option as exists when you save edits to the ETL logic. We need to track for auditing purposes why we disabled and then re-enabled automation and need to tie it to an incident number. If we had the…
-
Using Magic ETL, how can i sort an aggregated string?
-
Sum Orders, Line Count, Sales by day of the week (Friday, Saturday, and Sunday)
Hello, my dataset has 7 columns: Invoice date, location, orders, ... invoice total (see screenshot); I want to sum orders, line count, and sales by day; meaning January 21 2023 Friday's orders =DC 12 ATL's orders + DC 11 MOB's order = 65+0. Friday's sales = DC 12's Invoiced total + DC 11's invoiced total = $10,932.39 + 0.…
-
Magic ETL can use Federated Dataset
Hi, We have number of cases where we want to use Magic ETL using federated Dataset. Can discuss them? Thank You. Best Regards, Tejal
-
Datasets join issue
I'm trying to create a card that can be used to present to budget owners how much they have currently spent for the month compared to the budget they've been given. In order to do so, I have to create a dataflow that involves joining 2 datasets; One is Netsuite, which stores all the journal entry transactions, and the…
-
String Operation Add Space to Postal Code
Hi All, I cannot seem to find out how to add a space to a Postal Code Column using new Magic ETL. Trying to change a text string eg: S4L1A5 to S4L 1A5. thx!
-
Timestamp Runs Recursive Dataflow Magic 2.0
Hello all! I feel like I have lost it but I am looking for a simple way to timestamp each run in a recursive dataflow. The output dataset is simply appending on top of itself with no exclusions thereby producing a new set of rows based on the latest data available in the source dataset. When I try and timestamp I am…
-
Calculate time between two dates during business hours, excluding holidays & Sat/Sun
Need to calculate the elapsed time/minutes between Start Date and End Date, using business hours of 9:00AM to 5:00PM, excluding Saturday/Sunday & holidays. Anyone able to help? either in Magic ETL or Beast Mode.
-
Reg Ex difficulty
I am attempting to pull out a string using Reg ex. I want to get the card name, so text after the --- card_name: and between measurable_id. I am using .*measurable_id) but it is giving me an error message?
-
Calculated Column if 2 Fields Match
Hi - I am trying to create a calculated field similar to the = or EXACT function in excel - example =IF(TRIM(A27)=TRIM(B27),"Match","No Match") I need to know if 2 columns have fields that match for any value. Specifically, if email addresses are the same in each column. Thanks!
-
Magic ETL - Undo Button
Can we add an Undo Button to Magic ETL. This would be especially helpful when we accidentally delete a tile when clicking to drag it.
-
How to correctly use distinct count and case when in etl (unknown error)
Could someone help and explain what's causing this error? And how to correct it? Thank you
-
Converting string to date
Hi, I know there's a STR_TO_DATE function but maybe I could use more insight because it's not working. I have a date field that looks like this: 8-1-22 I want to convert this to a date. How can I achieve this with a ETL formula tile? Thank you.
-
Update Domo Magic ETLs via API/DomoCLI
Howdy, experts, Is there a way to programmatically edit a Magic ETL? I am willing and able to use Python SDK or the DomoCli Jar tool. If there is a way, is there any documentation out there?
-
ETL formula vs Beastmode - result discrepancy
Good afternoon, I've come across a headscratcher where a formula created within ETL is giving a different result when that exact same formula is created as a beastmode. In the attached image, the columns "island break" and "test1" are the exact same formula, with the former being created in ETL and the latter as a…
-
New Year Filtering Issues by Week / Month
My date filters are on the struggle bus in the new year y'all. CASE when WEEK(`Week Date`) = Week(CURDATE())-1 then 'show' else 'hide' end = 'show' The filter is simply returning this current week instead of the previous week. I assume this is because we are in Week 1, and the previous Week was 52. What's a better formula…
-
How should can i remove Dot "." from a column?
Hello, I have a column with multiple data and i need to remove the dot from all of it while keeping the letters and numbers. What should i use in ETL? Will Regex works? If yes, what should be the formula Example of column data: 12412.oaf.124R 124.1256612.124 saarw.124.1fs