-
Framed Sum in Rank & Window Magic ETL not treating zeroes properly
Hi there, I'm trying to produce a rolling 12 month total for each month in a dataset, but I'm finding with some of the partitions that I get a negative exponential when I'm expecting it to return zero (all the months are zero - see raw data screenshot). It doesn't seem to happen with every partition that has zero values,…
-
Magic ETL - copy/paste JSON definition to clipboard
During the Technical User Group kickoff call, @john_stevens dropped some knowledge on us that just blew my mind. As seen in the gif below, you can copy Magic ETL tiles to the clipboard, and then paste into a text editor and it will give you the JSON definition of those tiles. That definition file can then be edited and…
-
Disable/Hide Tiles
Sometimes when in development I have a need to hide/disable a tile or group of tiles that I am working on but have a need to run the flow in order to check other things but the flow won't run until all tiles are configured correctly. Sometimes I don't want to complete the tile (maybe it is having errors) and I need to…
-
Adding Budget Rows to Actual
Hello, I have an original cases database in DOMO each row has a case submission and case start, and then I later replicate it all the columns and added the budget we have for the year. I had to unpivot this data in order to create graphs that will put both dates in the same axis. I would like to show the budget as a third…
-
Comma Separated Field to Child Table
I've written a connector to query a remote API, the data has come in correctly but each row can have many labels, because the connector will only create one table at a time and I don't want to query the remote API twice I've created a comma separated field. ID, Name, Labels 1, "Hi there", "hi, welcome, hello" 2, "Over…
-
Count snapshot data (for HR Turnover)
I am trying to find a way to count number of rows per month (spanning over 3 years and counting) to get the total number employees for each month in variable form. The data structure is set in a way that the number of rows should be equal to the number of active employees as of a certain snapshot date. I am not sure if I…
-
Issue with dates in ETL
Hello everyone! So we use filters similar to this in Domo and noticed that for some reason all results are being returned. What is happening below is we apply a filter on the rule to only look at 'Y' results that should be only applications hired this year, but instead we receive everything. We are working through it on…
-
How to add pivoted value to new columns by Magic ETL
Hello, I would like to ask how to add pivot value to new column by Magic ETL. I prepared the table as follows which have value of product for 2021 Apr-Jun and previous year of same month. I want to add rows and columns highlighted in yellow as shown on the right table by Magic ETL. The rows that I want to add is 2021 Apr,…
-
Deleting a batch
I have 2 batches in a dataset that need to be deleted. The batches are easy to identify and the 2 just need to be wiped out entirely. I am wondering if it is possible to just go in a delete a batch, and what would be the best way to do this?
-
changing a name in ETL
I have an employee name in my raw data shown as >>> last_name, First_name middle_initial Doe, John H. or sometimes shown as >>> Doe, John Dorian H. How can I make it so it would appear as >>> John Doe or John Dorian Doe in DOMO using ETL or beastmode? Thanks
-
Formula failing to convert value from a type string to a type date
I think I need some help with the order of operations on this. I have recursive dataflow for Yelp data. I am trying to create a 'metric date' column by 1st, Splitting the ' FILE_NAME' column date example 'security_public_storage_account_time_range_report_11_1_2021_to_11_30_2021.xls Then in the next Tile I am using the Add…
-
Primary Key/Index Magic 2.0 Tile Failures
Hello! It would be great if there was some sort of notification/error on Primary Key/Primary Indexes in Magic 2.0, it's a great unintentional feature on MySQL dataflows and helps greatly with data integrity.
-
What Magic ETL features are available to me?
Justin Millheim, from Domo product, highlights how the new Magic ETL is smarter, faster, and easier for all. Read up on the power of Magic HERE.
-
Foreign Currency Conversion Help
I have a dataset that has amount coming in as "Euro", which I would like to convert to "USD". Does anyone know how to go about this in magic ETL? Preferable I would like to use my own fx rates which as you know is likely to change per month. Is these case statement or other that I can use to get this done please?
-
Need help getting pointed in the right direction for what might be causing inflating counts
I have a table that has details of inventory at each site that illustrates KPI's like Occupancy, vacancy, days vacant, and occupied units. It is put together using 3 different data sources. Price list - This is a majority of it. it is all the units aggregated row by row with those occupied, vacant, and total unit details.…
-
Trying to figure out how to filter out top 20th percent of data by week in domo graph
I'm trying to eliminate outliers from my dataset (top20% highest score let's say) by week. So I'd need to filter out (by rank) top 20% of scores from each week and then graph it on a line graph. My data is dynamic and it changes every day so I can't rank the entire data set. I need to rank by week. I've seen people talk…
-
The correct regex to remove the first character?
I have a column( that illustrates a dollar amount but is in string format. What I am trying to do is to remove the dollar sign ($) that is the very first character in each row, so i am only left with the numbers. I have tried the left/right substring but each dollar amount is different length so I have ran in to issues.
-
Write a Filter Formula using Magic ETL Filter Tile
Hey guys, so I am trying to utilize the filter formula feature in magic etl, but I can't seem to get it to work. When I run the following formula, no data appears. Using Excel, I performed a concatenate on all 517 websites that I would like to be filtered out from my data in order to build my formula. I've also used AND as…
-
Allow Magic ETL to evaluate formulas from Webforms
in magic ETL you have group by tile. and it allows formulas if you type the below formula by hand it evaluates. if you save the formula in a table and bring the value in the formula window it evaluates as string text and not formula
-
How populate a new column with data based on data in other rows
I have a dataset consisting of Google Analytics data. One of the columns identifies their Userid (for our ecommerce portal) if they authenticated. Another column identifies their GA session ID (during the visit to our site before and after they authenticate). I am interested in capturing all the activity for a user before…
-
Is this doable? Seeing percent of total day sales by hour using Timestamp column.
Hello! I have a problem that needs to be visualized and it was phrased to me like this: I need to see what percentage of sales each hour had for the total day last year then I need that percentage multiplied by the daily goal to get an hourly goal for today. So we have this chart right now: this show us net sales today,…
-
How to SUM working days correctly?
Hi everyone, I have a strange problem. Probably more of a SQL question than a Domo question, but here we go. I have a typical date column (yyyy-mm-dd) and a column called "total working days in month" where it returns a aggregate value of the # of working days for each month. Below is an example (just assume every date is…
-
How to append data to the output dataset?
I have a workbench job that will run daily. It will get the data with current date. I then needs to filter this data and create two data sets using the DataFlow ETL tool. How do I append data to the DataFlow ETL output table? DataFlow ETL creates a new table every time it runs. I realize that One way to achieve this is to…
-
Anything like Difference matrix, Difference between two pivots, difference within the value field?
I've searched around but haven't had any luck finding what I need, but I am not sure if I've searched the best way either so please refer me if this is a duplicate. I'll use dummy data to ask my question, but effectively I need the difference between two values across a couple of dimensions. The goal is different from our…
-
Handling multiple aggregation levels from source data
My company uses syndicated POS data from sources like IRI, NPD, and retailer POS. There are many measures that cannot be aggregated from the item level data, so I need to bring in pre-aggregated data in addition to the non-aggregated data. I was planning to have one column that indicated the aggregation level, but when I…
-
Reg. Expression to replace a list of names with a single character.
I have a column that is in a string format, and of course contains names. Majority of the rows are an empty string. What I am looking for is to take the rows that do contain a name and replace them with a 1. i have been trying to use replace text tile then trying to use a regular expression in the 2nd step, then replace…
-
New Data Privacy Solution - Beta Testers Wanted
Domo has partnered with Anonomatic (Anonomatic | Protecting PII for Data Privacy and Compliance) to enable Domo customers to combine, aggregate or mask anonymous data at the individual level with no risk of loss or exposure of PII. With the PII Vault and Anonomatic's plugins for Domo Workbench Workbench can now completely…