Magic ETL

I've written a connector to query a remote API, the data has come in correctly but each row can have many labels, because the connector will only create one table at a time and I don't want to query the remote API twice I've created a comma separated field. ID, Name, Labels 1, "Hi there", "hi, welcome, hello" 2, "Over…

I am trying to find a way to count number of rows per month (spanning over 3 years and counting) to get the total number employees for each month in variable form. The data structure is set in a way that the number of rows should be equal to the number of active employees as of a certain snapshot date. I am not sure if I…

Hello everyone! So we use filters similar to this in Domo and noticed that for some reason all results are being returned. What is happening below is we apply a filter on the rule to only look at 'Y' results that should be only applications hired this year, but instead we receive everything. We are working through it on…

Hello, I would like to ask how to add pivot value to new column by Magic ETL. I prepared the table as follows which have value of product for 2021 Apr-Jun and previous year of same month. I want to add rows and columns highlighted in yellow as shown on the right table by Magic ETL. The rows that I want to add is 2021 Apr,…

I have 2 batches in a dataset that need to be deleted. The batches are easy to identify and the 2 just need to be wiped out entirely. I am wondering if it is possible to just go in a delete a batch, and what would be the best way to do this?

I have an employee name in my raw data shown as >>> last_name, First_name middle_initial Doe, John H. or sometimes shown as >>> Doe, John Dorian H. How can I make it so it would appear as >>> John Doe or John Dorian Doe in DOMO using ETL or beastmode? Thanks

I think I need some help with the order of operations on this. I have recursive dataflow for Yelp data. I am trying to create a 'metric date' column by 1st, Splitting the ' FILE_NAME' column date example 'security_public_storage_account_time_range_report_11_1_2021_to_11_30_2021.xls Then in the next Tile I am using the Add…

Hello! It would be great if there was some sort of notification/error on Primary Key/Primary Indexes in Magic 2.0, it's a great unintentional feature on MySQL dataflows and helps greatly with data integrity.

Justin Millheim, from Domo product, highlights how the new Magic ETL is smarter, faster, and easier for all. Read up on the power of Magic HERE.

I have a dataset that has amount coming in as "Euro", which I would like to convert to "USD". Does anyone know how to go about this in magic ETL? Preferable I would like to use my own fx rates which as you know is likely to change per month. Is these case statement or other that I can use to get this done please?

I have a table that has details of inventory at each site that illustrates KPI's like Occupancy, vacancy, days vacant, and occupied units. It is put together using 3 different data sources. Price list - This is a majority of it. it is all the units aggregated row by row with those occupied, vacant, and total unit details.…

I'm trying to eliminate outliers from my dataset (top20% highest score let's say) by week. So I'd need to filter out (by rank) top 20% of scores from each week and then graph it on a line graph. My data is dynamic and it changes every day so I can't rank the entire data set. I need to rank by week. I've seen people talk…

I have a column( that illustrates a dollar amount but is in string format. What I am trying to do is to remove the dollar sign ($) that is the very first character in each row, so i am only left with the numbers. I have tried the left/right substring but each dollar amount is different length so I have ran in to issues.

Hey guys, so I am trying to utilize the filter formula feature in magic etl, but I can't seem to get it to work. When I run the following formula, no data appears. Using Excel, I performed a concatenate on all 517 websites that I would like to be filtered out from my data in order to build my formula. I've also used AND as…

in magic ETL you have group by tile. and it allows formulas if you type the below formula by hand it evaluates. if you save the formula in a table and bring the value in the formula window it evaluates as string text and not formula

I have a dataset consisting of Google Analytics data. One of the columns identifies their Userid (for our ecommerce portal) if they authenticated. Another column identifies their GA session ID (during the visit to our site before and after they authenticate). I am interested in capturing all the activity for a user before…

Hello! I have a problem that needs to be visualized and it was phrased to me like this: I need to see what percentage of sales each hour had for the total day last year then I need that percentage multiplied by the daily goal to get an hourly goal for today. So we have this chart right now: this show us net sales today,…

Hi everyone, I have a strange problem. Probably more of a SQL question than a Domo question, but here we go. I have a typical date column (yyyy-mm-dd) and a column called "total working days in month" where it returns a aggregate value of the # of working days for each month. Below is an example (just assume every date is…

I have a workbench job that will run daily. It will get the data with current date. I then needs to filter this data and create two data sets using the DataFlow ETL tool. How do I append data to the DataFlow ETL output table? DataFlow ETL creates a new table every time it runs. I realize that One way to achieve this is to…

I've searched around but haven't had any luck finding what I need, but I am not sure if I've searched the best way either so please refer me if this is a duplicate. I'll use dummy data to ask my question, but effectively I need the difference between two values across a couple of dimensions. The goal is different from our…

My company uses syndicated POS data from sources like IRI, NPD, and retailer POS. There are many measures that cannot be aggregated from the item level data, so I need to bring in pre-aggregated data in addition to the non-aggregated data. I was planning to have one column that indicated the aggregation level, but when I…

I have a column that is in a string format, and of course contains names. Majority of the rows are an empty string. What I am looking for is to take the rows that do contain a name and replace them with a 1. i have been trying to use replace text tile then trying to use a regular expression in the 2nd step, then replace…

Domo has partnered with Anonomatic (Anonomatic | Protecting PII for Data Privacy and Compliance) to enable Domo customers to combine, aggregate or mask anonymous data at the individual level with no risk of loss or exposure of PII. With the PII Vault and Anonomatic's plugins for Domo Workbench Workbench can now completely…

I have a column that uses an 'x' as a flag, any row that isn't flagged with an 'x' is left as an empty string. What I need is to replace the 'x' with a '1' to be used in a later count. this should be straightforward but I keep getting my wires crossed with the order of operations.

Hey guys, I have a dataset that appends each day to include the daily downloads, and resets the calculation on the 1st of every month. This issue is, it's cumulative totals, so if yesterday we had 40 downloads and the following day we had 15 downloads, the total for the following day would come in as 55 total downloads.…

I'm looking to extract a work order number which contains the letter W followed by 15 digits (Ex. W571191476628566). The order number lies within a string containing notes content that has been exported into domo. (Ex. "Customer called in to discuss work order W571191476628566, and asked about order status"). In the domo…

Hi, We have one filed name "Inquiry Date". and we wanted to calculate the difference between the two inquiries. we need output like mentioned below screenshot (Difference between two dates) eg: (01/01/21) - (01/01/21) = 0 (02/01/21) - (01/01/21) = 1 (07/01/21) - (02/01/21) = 5 (15/01/21) - (07/01/21) = 8 Please suggest a…

A lot of the dataflow creation I do is taking 2 datasets that differ slightly and don't have an easy 1:1 comparison that makes joining the data very easy. usually I am using 1 report for almost the entire visualization, and puling a column or two form the 2nd report. Since the reports aren't in an identical format, and…