-
Year over year cumulative average
I am trying to create a line chart with the year as a series. The data points are per month with a cumulative average. Data: Year Month Closed Cases Total Cases % Cumulative % (Cum. Math) 2022 1 50 100 50% 50% (50/100) 2022 2 100 150 75% 60% (150/250) 2023 3 100 100 100% 71.43% (250/350) etc. across multiple years where…
-
Formula for rounding time to nearest minute
Hi, I need to round times to the nearest minute. Not rounding up or down, but nearest minute. Any ideas on how to use formula ETL tile for this? Thanks!
-
Find greatest value for each specific ID
Hi, I have a dataset like this: ID Value 1 5 1 6 1 7 2 23 2 24 2 25 I want to write a ETL formula that creates a third column saying the greatest value for each ID is: ID Value Greatest 1 5 7 1 6 7 1 7 7 2 23 25 2 24 25 2 25 25 Thank you
-
Success rate calculation
I'm trying to work out the success rate of applications submitted, attached is a basic flow diagram of how this calculation works. I have setup an ETL which filters out any withdrawn applications and separates the approved and refused applications. Is there a way that I can sum the values of Approved Applications and…
-
Grand total instead of running total with Count in Rank & Window?
I was trying to get a total number using Count with Rank & Window in Magic ETL but I can only get a running total instead of the grand total repeated across the rows. My output looks like this: jane doe, item a, 1 jane doe, item b, 2 jane doe, item c, 3 But I wanted this: jane doe, item a, 3 jane doe, item b, 3 jane doe,…
-
ML model null values and unknown error message
We are trying to create a machine learning workflow wherein we are trying to predict by feeding in several rows of data to train the model and use that as base to get the predictions. We were able to run the same model (with samechosen parameters) in Python and get an accuracy of upto 95%. When we try to replicate the same…
-
View a dataflow's ETL without having rights to edit
Hi, In our organization, we have tons of dataflows built. Often, I'd like to understand how a dataflow was built, including the processing steps in the ETL. The only way to view the ETL steps is to have edit rights to the specific ETL. Often, I don't need to edit the ETL, but I do want to see how it's built. It would be…
-
How to skip nulls in rank and window?
I have a dataflow that is joining multiple datasets with information about a set of schools - 29 elementary schools and 3 high schools. One of the data sets is specific to tests scores that only the elementary schools take, so the high school rows are "null." This dataflow that I am creating aims to generate separate…
-
% Sold of Available Inventory (aka Sell-Through)
I am stumped on this one. I have two tables: an orders table and an inventory table. orders contains a record for each order placed by a customer; and inventory holds a record of how much inventory is available at the start of the period. Note that qtyAvail does not update... it is a reflection of how much that store…
-
Datasets join issue
I'm trying to create a card that can be used to present to budget owners how much they have currently spent for the month compared to the budget they've been given. In order to do so, I have to create a dataflow that involves joining 2 datasets; One is Netsuite, which stores all the journal entry transactions, and the…
-
What is the best way to parse URLs?
I currently am bringing in data from google ads and one of the columns is `landing page url`. I am trying to parse this row from: https://m.ufhealth.org/uf-health-pregnancy-care?utm_source=google&utm_medium=tj%20ppc&utm_campaign=fy21%20ob%20services&gclid=EAIaIQobChMIo7Hl4pCq8gIV_21vBB1iYQ_JEAAYASAAEgJD3fD_BwE to uf health…
-
Status tracking for hot board
I am wanting to track a hot board status for part numbers and want to use the status to track through the process. Is there a formula or beastmode that can remove the in process data once the ticket has been fulfilled and reads 'completed'. For example… Once the part number 3333-000 by Robert Storey was completed can the…
-
Attempting to create unique rows for each possible value in a chosen column
Our business model currently offers multiple product options. I'd like to create brand new rows for each customer, 1 for each product, whether they own that product or not. My thought is to use new columns and then use a dynamic unpivot. Need help creating the new columns first though.. Currently have this: Account Product…
-
Reduce ETL Processing Time
Hi Everyone. I'm looking for strategies to reduce the run time of Magic ETL 2 data flows. I'm working with several left joins in sequence on about 17 datasets of 1 million rows each. Beyond this, the ETL performs no other operations. I'm curious if anyone has experience with these options: Data fusion Adrenaline Redshift…
-
Case Syntax
I am having difficulty understanding the case syntax while using magic ETL. In the current Example, I have a list of properties and coded them to display a text column of the region for each specific property. Unfortunately, there is no address line to be able to parse and use to make the regions so I'm hard-coding the…
-
How to represent how many tickets opened by each individual user?
Hi, I am trying to figure out how to pull 2 datasets together correctly. So, one dataset is Users and the other is Tickets. I want to connect Tickets to Users so I can have a single integer connected to a single user to show many tickets a specific individual has opened. Example: User_Name Number_Of_Tickets_Opened…
-
Only show unique values of a column in table
Is there a way, in analyzer or ETL, where we can only display one row for each unique value of a column corresponding to a key column? For example, I would want this: ID Num 1 4 1 4 1 5 2 4 2 5 2 6 3 6 3 7 3 7 to become this: ID Num 1 4 1 5 2 4 2 5 2 6 3 6 3 7
-
Error filtering Data
Hi, I'm using a filter on a Dataset I which I need that a column A to be different to FALSE and another column, B, equals to FALSE, but it is not doing the filter correctly
-
How to Deal with Multiple Date Fields
I have a perplexing issue I'm trying to solve. I have data coming from several different data sources (all parts of Zendesk), each of which each represent a different kind of user interaction. For example: Email, Chat, Phone Calls These are all related to a master "Tickets" table, so they can be joined based on a Ticket…
-
Avg. Time between purchase orders
Hi, Domo newbie here. I am trying to find the average time between orders. The columns I have are Customer ID First Purchase date Last Purchase date Time between purchases I tried to using the group by function to find the average time between orders, but it seems to be returning the same value as the 'time between…
-
Is there a reliable way to make Magic ETL intentionally fail?
I have an ETL that uses, among other inputs, a Webform that isn't always maintained perfectly. One recent problem involved two rows for the same identifier, with different text in the description column. What I'd like to do is make the ETL fail if something like this happens. I tried doing a Group By on the identifier…
-
Is there way to extract week of quarter from a date column?
The default week() function extracts the week number from the start of the year and runs 1 to 53 or 54. I need to show week number within the quarter, running 1 to 13 or 14 within each qtr. Is there a way to do this using beast mode or using the formula tile in Magic ETL ? Thanks!
-
Automatically update the column value by current month and year in Magic ETL
hi guys, I got a table on below and some columns using month/year as column name. i would like to make an automatically Magic ETL and set a logic condition like below: if the date(column name) < current month and year (let say 08/2022) then all value would be clear as 0 value under the column (01/2022, 02/2022,…
-
Limit on ranking tiles
I added 20 ranking tiles to me Magic ETL, but it fails stating out of memory. I removed 4 of them, and now it runs fine. Is there a limit to the number of ranking tiles you can use? The input is only 2 million records.
-
How to create 2 Output Dataset in DOMO (unable to load this dataset issue)
Hello everyone - Good Day! I just need some inputs. I have a dataflow with 4 input dataset and 1 output dataset. When I add another output dataset and hit preview, it showed all green checks. However when I saved and ran it, that 2nd output dataset shows as "unable to load this dataset"? any reason why it is unable to load?
-
Quick Select Multiple Columns in "Select Column" ?
I am wondering if there is a way to choose multiple columns quickly when using "Select Columns" in an ETL. I do not mean using Add All Columns. We do not know SQL, and we have massive DataSets with a large amount of columns (50+), but only need a mix of about half & half between 2 Datasets. Having to scroll through &…
-
Beast Mode to compare the record from the recent Monday to the last Monday
Hi All, I have a dataset that has the the different schedule codes by date at a PO number level..I am trying to identify the records from the most recent monday and compare it to the immediate last monday and then flag the combination of (POnumber /schedule_code) to be old (meaning this combination existed the last monday…
-
MagicETL/SQL to join datasets using a comparison between values
I am trying to get a geolocation based on the IPNumber. Dataset a: ipaddress ipnumber (translated from ipaddress) Dataset b: lowIPNumber highIPNumber Country Region City I would like to add the Country, Region, and City values to an output dataset: ipaddress ipnumber Country Region City where a.ipnumber >= b.lowIPNumber…
-
Calculated Fields - Pipedrive ID's
Hi, I am pulling in data from Pipedrive and need to use Calculated Fields to convert Pipedrive Field ID's into text. Is there a way that I can do this once instead of doing calculated fields for each metric?
-
Period over Period in a table
I'm attempting to do a Period over Period in a table, but want to keep the date range to previous week/month/quarter to keep it auto-updating and grouping the data in a particular way. My idea was to create a new column in ETL that is the same as the column I'm trying to do a Period over Period calculation, but from the…