-
Datasets join issue
I'm trying to create a card that can be used to present to budget owners how much they have currently spent for the month compared to the budget they've been given. In order to do so, I have to create a dataflow that involves joining 2 datasets; One is Netsuite, which stores all the journal entry transactions, and the…
-
What is the best way to parse URLs?
I currently am bringing in data from google ads and one of the columns is `landing page url`. I am trying to parse this row from: https://m.ufhealth.org/uf-health-pregnancy-care?utm_source=google&utm_medium=tj%20ppc&utm_campaign=fy21%20ob%20services&gclid=EAIaIQobChMIo7Hl4pCq8gIV_21vBB1iYQ_JEAAYASAAEgJD3fD_BwE to uf health…
-
Status tracking for hot board
I am wanting to track a hot board status for part numbers and want to use the status to track through the process. Is there a formula or beastmode that can remove the in process data once the ticket has been fulfilled and reads 'completed'. For example… Once the part number 3333-000 by Robert Storey was completed can the…
-
Attempting to create unique rows for each possible value in a chosen column
Our business model currently offers multiple product options. I'd like to create brand new rows for each customer, 1 for each product, whether they own that product or not. My thought is to use new columns and then use a dynamic unpivot. Need help creating the new columns first though.. Currently have this: Account Product…
-
Reduce ETL Processing Time
Hi Everyone. I'm looking for strategies to reduce the run time of Magic ETL 2 data flows. I'm working with several left joins in sequence on about 17 datasets of 1 million rows each. Beyond this, the ETL performs no other operations. I'm curious if anyone has experience with these options: Data fusion Adrenaline Redshift…
-
Case Syntax
I am having difficulty understanding the case syntax while using magic ETL. In the current Example, I have a list of properties and coded them to display a text column of the region for each specific property. Unfortunately, there is no address line to be able to parse and use to make the regions so I'm hard-coding the…
-
How to represent how many tickets opened by each individual user?
Hi, I am trying to figure out how to pull 2 datasets together correctly. So, one dataset is Users and the other is Tickets. I want to connect Tickets to Users so I can have a single integer connected to a single user to show many tickets a specific individual has opened. Example: User_Name Number_Of_Tickets_Opened…
-
Only show unique values of a column in table
Is there a way, in analyzer or ETL, where we can only display one row for each unique value of a column corresponding to a key column? For example, I would want this: ID Num 1 4 1 4 1 5 2 4 2 5 2 6 3 6 3 7 3 7 to become this: ID Num 1 4 1 5 2 4 2 5 2 6 3 6 3 7
-
Error filtering Data
Hi, I'm using a filter on a Dataset I which I need that a column A to be different to FALSE and another column, B, equals to FALSE, but it is not doing the filter correctly
-
How to Deal with Multiple Date Fields
I have a perplexing issue I'm trying to solve. I have data coming from several different data sources (all parts of Zendesk), each of which each represent a different kind of user interaction. For example: Email, Chat, Phone Calls These are all related to a master "Tickets" table, so they can be joined based on a Ticket…
-
Avg. Time between purchase orders
Hi, Domo newbie here. I am trying to find the average time between orders. The columns I have are Customer ID First Purchase date Last Purchase date Time between purchases I tried to using the group by function to find the average time between orders, but it seems to be returning the same value as the 'time between…
-
How do I insert a row which is the variance between two other rows?
I have an ETL output table with two rows (highlighted in green) and I would like to add another row (highlighted yellow) which is the variance between the two rowa , how can I achieve this? I am transposing this into a table card and would like to get something like this
-
Is there a reliable way to make Magic ETL intentionally fail?
I have an ETL that uses, among other inputs, a Webform that isn't always maintained perfectly. One recent problem involved two rows for the same identifier, with different text in the description column. What I'd like to do is make the ETL fail if something like this happens. I tried doing a Group By on the identifier…
-
Is there way to extract week of quarter from a date column?
The default week() function extracts the week number from the start of the year and runs 1 to 53 or 54. I need to show week number within the quarter, running 1 to 13 or 14 within each qtr. Is there a way to do this using beast mode or using the formula tile in Magic ETL ? Thanks!
-
Automatically update the column value by current month and year in Magic ETL
hi guys, I got a table on below and some columns using month/year as column name. i would like to make an automatically Magic ETL and set a logic condition like below: if the date(column name) < current month and year (let say 08/2022) then all value would be clear as 0 value under the column (01/2022, 02/2022,…
-
Limit on ranking tiles
I added 20 ranking tiles to me Magic ETL, but it fails stating out of memory. I removed 4 of them, and now it runs fine. Is there a limit to the number of ranking tiles you can use? The input is only 2 million records.
-
Magic ETL v1 Update
We wanted to share a planning update and a correction to an earlier communication that was made about the end-of-life plan for Magic ETL v1 dataflows as part of Domo’s Summer 2022 product release. We continue to see strong momentum with the adoption of Magic ETL v2 dataflows. Since the general availability of Magic ETL v2…
-
How to create 2 Output Dataset in DOMO (unable to load this dataset issue)
Hello everyone - Good Day! I just need some inputs. I have a dataflow with 4 input dataset and 1 output dataset. When I add another output dataset and hit preview, it showed all green checks. However when I saved and ran it, that 2nd output dataset shows as "unable to load this dataset"? any reason why it is unable to load?
-
Quick Select Multiple Columns in "Select Column" ?
I am wondering if there is a way to choose multiple columns quickly when using "Select Columns" in an ETL. I do not mean using Add All Columns. We do not know SQL, and we have massive DataSets with a large amount of columns (50+), but only need a mix of about half & half between 2 Datasets. Having to scroll through &…
-
Beast Mode to compare the record from the recent Monday to the last Monday
Hi All, I have a dataset that has the the different schedule codes by date at a PO number level..I am trying to identify the records from the most recent monday and compare it to the immediate last monday and then flag the combination of (POnumber /schedule_code) to be old (meaning this combination existed the last monday…
-
MagicETL/SQL to join datasets using a comparison between values
I am trying to get a geolocation based on the IPNumber. Dataset a: ipaddress ipnumber (translated from ipaddress) Dataset b: lowIPNumber highIPNumber Country Region City I would like to add the Country, Region, and City values to an output dataset: ipaddress ipnumber Country Region City where a.ipnumber >= b.lowIPNumber…
-
Calculated Fields - Pipedrive ID's
Hi, I am pulling in data from Pipedrive and need to use Calculated Fields to convert Pipedrive Field ID's into text. Is there a way that I can do this once instead of doing calculated fields for each metric?
-
Period over Period in a table
I'm attempting to do a Period over Period in a table, but want to keep the date range to previous week/month/quarter to keep it auto-updating and grouping the data in a particular way. My idea was to create a new column in ETL that is the same as the column I'm trying to do a Period over Period calculation, but from the…
-
REGEXP_REPLACE in ETL add new line?
I have data in Domo for an address that includes a new line character. This data was brought in from NetSuite in this format. I am trying to add additional data that matches this format. I have the following data: Ship Address: attn~company~addr1~addr2~city, state zip I would like it saved as such: attn company addr1 addr2…
-
Option to manually run Magic ETL v2 without optimization
I love that ETL v2 allows automatic query optimization because it significantly cuts down the run time of our ETL pipeline. However I have run into some issues with some rows not being processed when rows get appended to the input dataset while the dataflow is running. The next time I run the dataflow, the ETL optimization…
-
How to remove empty columns from a dataset?
I am using a DOMO connector to import Salesforce data. The imported data has 30+ columns with no value. Can a query be written to remove all the columns with no values? I know I can write a script using Python/R but we don't have a scripting tile in our package.
-
How to find a max value from multiple aggregates
Hey guys, I'm looking at our collections information from the last two years to find our best collections month during that time frame for each of our locations. Before when I had to do this I just did it in ETL using a group by function, but this case is a little more complicated as I'm wanting a specific set of…