Magic ETL

How to get Gross Sales from Shopify?
My team and I are in the process of building datasets from Shopify's API but we are not able to get the gross sales amount to match with the gross sales amount in the Shopify's dashboard. Does anyone have any insights on this? We selected the report "All Orders". We have played with all columns, total_price,…
To create ETL
I want to get a new etl by connecting two datasets. All stages are working, but they do not pass to the output part. When I press the save button, it does not save my work. Also, I was able to combine a data set and a file that was on my computer before using the "join data" command. Now this option is not active. I cannot…
Formatting Fiscal Year and Quarter columns
I am trying to format a column that labels 'FY23' and 'Q1' based on a Period date. What would be the formula to create this? I know Quarter() and Year() functions work but how would I use those functions to format it in the way I need to see it? Thanks
Allowing comments on ETL schedule changes
We frequently have to disable automation on our Magic ETLs when troubleshooting issues. Currently there is no commenting option as exists when you save edits to the ETL logic. We need to track for auditing purposes why we disabled and then re-enabled automation and need to tie it to an incident number. If we had the…
Using Magic ETL, how can i sort an aggregated string?
Sum Orders, Line Count, Sales by day of the week (Friday, Saturday, and Sunday)
Hello, my dataset has 7 columns: Invoice date, location, orders, ... invoice total (see screenshot); I want to sum orders, line count, and sales by day; meaning January 21 2023 Friday's orders =DC 12 ATL's orders + DC 11 MOB's order = 65+0. Friday's sales = DC 12's Invoiced total + DC 11's invoiced total = $10,932.39 + 0.…
Magic ETL can use Federated Dataset
Hi, We have number of cases where we want to use Magic ETL using federated Dataset. Can discuss them? Thank You. Best Regards, Tejal
Datasets join issue
I'm trying to create a card that can be used to present to budget owners how much they have currently spent for the month compared to the budget they've been given. In order to do so, I have to create a dataflow that involves joining 2 datasets; One is Netsuite, which stores all the journal entry transactions, and the…
String Operation Add Space to Postal Code
Hi All, I cannot seem to find out how to add a space to a Postal Code Column using new Magic ETL. Trying to change a text string eg: S4L1A5 to S4L 1A5. thx!
Timestamp Runs Recursive Dataflow Magic 2.0
Hello all! I feel like I have lost it but I am looking for a simple way to timestamp each run in a recursive dataflow. The output dataset is simply appending on top of itself with no exclusions thereby producing a new set of rows based on the latest data available in the source dataset. When I try and timestamp I am…
Calculate time between two dates during business hours, excluding holidays & Sat/Sun
Need to calculate the elapsed time/minutes between Start Date and End Date, using business hours of 9:00AM to 5:00PM, excluding Saturday/Sunday & holidays. Anyone able to help? either in Magic ETL or Beast Mode.
Reg Ex difficulty
I am attempting to pull out a string using Reg ex. I want to get the card name, so text after the --- card_name: and between measurable_id. I am using .*measurable_id) but it is giving me an error message?
Calculated Column if 2 Fields Match
Hi - I am trying to create a calculated field similar to the = or EXACT function in excel - example =IF(TRIM(A27)=TRIM(B27),"Match","No Match") I need to know if 2 columns have fields that match for any value. Specifically, if email addresses are the same in each column. Thanks!
How to correctly use distinct count and case when in etl (unknown error)
Could someone help and explain what's causing this error? And how to correct it? Thank you
Converting string to date
Hi, I know there's a STR_TO_DATE function but maybe I could use more insight because it's not working. I have a date field that looks like this: 8-1-22 I want to convert this to a date. How can I achieve this with a ETL formula tile? Thank you.
Magic ETL Forecasting Tile
Hi, I have a dataset that I have grouped together into monthly data (using the LAST_DAY function in case it matters). Using magic ETL, I then add the forecasting tile to get a forecasted volume. I have actuals upto the end of May 2022, but the forecast model is only giving me forecast data starting in July 2022. Can…
Update Domo Magic ETLs via API/DomoCLI
Howdy, experts, Is there a way to programmatically edit a Magic ETL? I am willing and able to use Python SDK or the DomoCli Jar tool. If there is a way, is there any documentation out there?
ETL formula vs Beastmode - result discrepancy
Good afternoon, I've come across a headscratcher where a formula created within ETL is giving a different result when that exact same formula is created as a beastmode. In the attached image, the columns "island break" and "test1" are the exact same formula, with the former being created in ETL and the latter as a…
New Year Filtering Issues by Week / Month
My date filters are on the struggle bus in the new year y'all. CASE when WEEK(`Week Date`) = Week(CURDATE())-1 then 'show' else 'hide' end = 'show' The filter is simply returning this current week instead of the previous week. I assume this is because we are in Week 1, and the previous Week was 52. What's a better formula…
How should can i remove Dot "." from a column?
Hello, I have a column with multiple data and i need to remove the dot from all of it while keeping the letters and numbers. What should i use in ETL? Will Regex works? If yes, what should be the formula Example of column data: 12412.oaf.124R 124.1256612.124 saarw.124.1fs
Network Access from MagicETL?
Am I correct in surmising that whatever environment runs Domo's MagicETLs restricts internet connectivity? I've got a few Jupyter workspaces that a colleague has set up to do various things with our data--mostly normal/conventional stuff, but he's also doing a few things that require network access, like sending emails,…
How would I pull a list of column names that have no data?
Our Salesforce dev team frequently changes field names and without notifying us, so I'm trying to find an easy way to create a report showing all of the columns that contain no data as this is a sign this field was replaced with a new field or is no longer in use and we need to remove it from our ETLs and cards. Is there a…
How do I filter duplicative entries when two date fields are involved? (entry & modified dates)
Hey Domo Smarties! [Annotated Screen Cap Below] What's the best way to filter out duplicate rows according to the latest modified date in an ETL? Desired Result: One unique entry by "start date" and "model" with the latest "ob modified date".
MAGIC ETL Formula
Hi Guys, I am working on a workflow, I have two datasets I combined using left join. Now I have a new column "Category". Now those that are null in the category column and have have "AB" text on its Product Group name should be identified as "Above Normal" and those that doesn't have should be "Normal". But when I run it,…
Calculate Previous Quarter Start and End Date
Hello! I am looking to calculate the Previous Quarter Start/End Date and the Previous Two Quarter Start/End Date. For example: Input: November 8, 2022 Desired Output: Previous Quarter Start Date - July 1, 2022 Previous Quarter End Date - September 30, 2022 Previous Two Quarter Start Date - April 1, 2022 Previous Two…

Upcoming Events

Connections Tour, Denver
Spend a half day with your peers, Domo enterprise customer speakers, and product leads to explore real-world use cases and new platform innovations. Whether you’re a power user or just starting to learn about Domo, don’t miss this opportunity to learn from like-minded professionals about how they use data to multiply their…
Connections Tour, Los Angeles
Spend a half day with your peers, Domo enterprise customer speakers, and product leads to explore real-world use cases and new platform innovations. Whether you’re a power user or just starting to learn about Domo, don’t miss this opportunity to learn from like-minded professionals about how they use data to multiply their…
Connections Tour, San Jose
Spend a half day with your peers, Domo enterprise customer speakers, and product leads to explore real-world use cases and new platform innovations. Whether you’re a power user or just starting to learn about Domo, don’t miss this opportunity to learn from like-minded professionals about how they use data to multiply their…
Connections Tour, Atlanta
Spend a half day with your peers, Domo enterprise customer speakers, and product leads to explore real-world use cases and new platform innovations. Whether you’re a power user or just starting to learn about Domo, don’t miss this opportunity to learn from like-minded professionals about how they use data to multiply their…
Connections Tour, Washington D.C.
Spend a half day with your peers, Domo enterprise customer speakers, and product leads to explore real-world use cases and new platform innovations. Whether you’re a power user or just starting to learn about Domo, don’t miss this opportunity to learn from like-minded professionals about how they use data to multiply their…

Magic ETL

Discussion List