Magic ETL

This is a super simple problem, not sure what is going on but I am hoping a fresh set of eyes might help. All I am trying to do is take the 'property_address' column from the powerlender table and use that information onto the foreclosure table - foreclosure is otherwise all ready to go. Both tables have a loan_id (one is…

I was wondering if someone could help? I have a dataset containing 196 columns, I would like to know which of the columns are entirely null, which contains data, what level of duplication the field has and what type of data is in the field. There is a similar question here, but this is more about removing as opposed to…

I want to get a new etl by connecting two datasets. All stages are working, but they do not pass to the output part. When I press the save button, it does not save my work. Also, I was able to combine a data set and a file that was on my computer before using the "join data" command. Now this option is not active. I cannot…

I am trying to format a column that labels 'FY23' and 'Q1' based on a Period date. What would be the formula to create this? I know Quarter() and Year() functions work but how would I use those functions to format it in the way I need to see it? Thanks

We frequently have to disable automation on our Magic ETLs when troubleshooting issues. Currently there is no commenting option as exists when you save edits to the ETL logic. We need to track for auditing purposes why we disabled and then re-enabled automation and need to tie it to an incident number. If we had the…

Hello, my dataset has 7 columns: Invoice date, location, orders, ... invoice total (see screenshot); I want to sum orders, line count, and sales by day; meaning January 21 2023 Friday's orders =DC 12 ATL's orders + DC 11 MOB's order = 65+0. Friday's sales = DC 12's Invoiced total + DC 11's invoiced total = $10,932.39 + 0.…

Hi, We have number of cases where we want to use Magic ETL using federated Dataset. Can discuss them? Thank You. Best Regards, Tejal

I'm trying to create a card that can be used to present to budget owners how much they have currently spent for the month compared to the budget they've been given. In order to do so, I have to create a dataflow that involves joining 2 datasets; One is Netsuite, which stores all the journal entry transactions, and the…

Hi All, I cannot seem to find out how to add a space to a Postal Code Column using new Magic ETL. Trying to change a text string eg: S4L1A5 to S4L 1A5. thx!

Hello all! I feel like I have lost it but I am looking for a simple way to timestamp each run in a recursive dataflow. The output dataset is simply appending on top of itself with no exclusions thereby producing a new set of rows based on the latest data available in the source dataset. When I try and timestamp I am…

When creating any ETL the user interface is unable to alert you the impact of the change will make on the dataflow. If I create a transformation that is not optimized I should be alerted this will increase process time. It would be helpful to have a time estimation in Magic ETL itself as to how long each step will take…

Need to calculate the elapsed time/minutes between Start Date and End Date, using business hours of 9:00AM to 5:00PM, excluding Saturday/Sunday & holidays. Anyone able to help? either in Magic ETL or Beast Mode.

I am attempting to pull out a string using Reg ex. I want to get the card name, so text after the --- card_name: and between measurable_id. I am using .*measurable_id) but it is giving me an error message?

Hi - I am trying to create a calculated field similar to the = or EXACT function in excel - example =IF(TRIM(A27)=TRIM(B27),"Match","No Match") I need to know if 2 columns have fields that match for any value. Specifically, if email addresses are the same in each column. Thanks!

Recently, we ran into an issue with one of our email connector datasets where a "Currency" column was being formatted as a string which was causing issues down the line in other dataflows. We're not sure how the problem initially started, but we found that enabling the "Use Raw Numbers" setting seemed to fix it and…

Can we add an Undo Button to Magic ETL. This would be especially helpful when we accidentally delete a tile when clicking to drag it.

Could someone help and explain what's causing this error? And how to correct it? Thank you

Hi, I know there's a STR_TO_DATE function but maybe I could use more insight because it's not working. I have a date field that looks like this: 8-1-22 I want to convert this to a date. How can I achieve this with a ETL formula tile? Thank you.

Howdy, experts, Is there a way to programmatically edit a Magic ETL? I am willing and able to use Python SDK or the DomoCli Jar tool. If there is a way, is there any documentation out there?

Good afternoon, I've come across a headscratcher where a formula created within ETL is giving a different result when that exact same formula is created as a beastmode. In the attached image, the columns "island break" and "test1" are the exact same formula, with the former being created in ETL and the latter as a…

My date filters are on the struggle bus in the new year y'all. CASE when WEEK(`Week Date`) = Week(CURDATE())-1 then 'show' else 'hide' end = 'show' The filter is simply returning this current week instead of the previous week. I assume this is because we are in Week 1, and the previous Week was 52. What's a better formula…

I would like to have a way to create complex formulas, save them (similar to the Beast Mode Manager) , and then have them available for use in ETLs; when an ETL that contains one of these formulas is executed the current version of the formula would always be used. This would have two use cases (for me): If there is a need…

Hello, I have a column with multiple data and i need to remove the dot from all of it while keeping the letters and numbers. What should i use in ETL? Will Regex works? If yes, what should be the formula Example of column data: 12412.oaf.124R 124.1256612.124 saarw.124.1fs

Am I correct in surmising that whatever environment runs Domo's MagicETLs restricts internet connectivity? I've got a few Jupyter workspaces that a colleague has set up to do various things with our data--mostly normal/conventional stuff, but he's also doing a few things that require network access, like sending emails,…

Our Salesforce dev team frequently changes field names and without notifying us, so I'm trying to find an easy way to create a report showing all of the columns that contain no data as this is a sign this field was replaced with a new field or is no longer in use and we need to remove it from our ETLs and cards. Is there a…