-
GA4 campaign and session campaign data Joining question
I have a unique question… some context: I have a dataset from the Google Analytics 4 connector that has 5 columns that I am grouping by with one of those group by columns being the 'campaign' dimension. The other dataset in the join has 4 of the same columns but the fifth one is a 'session campaign'. The two datasets are…
-
How is Timezone inherited from source then converted?
I have a dataset coming in from the Gong connector and some timestamps come in as text fields (scheduled, started). Our Domo timezone is set to Eastern. When I cast data type as timestamp, the times move up 3 hours. Should I assume the Gong source data is Pacific (Gong is in SF) and Domo is inheriting the timezone…
-
I want to create a column that contains the total sum of another column.
Hi everyone, looking to create a column that contains total revenue in order to find individual contributions. I have tried to do this using rank/window function within the magic ETL however all I get is a running total. Any help appreciated :) Thanks!
-
Error Message on Run when Using 'New' Data Selection
Hi all, I have an ETL with a View of a Dataflow as the input - data selection on input set to 'New' (Beta) then output is set to 'Append (Beta'). The input dataset is 250m rows going back 13 months, so I really only need the ETL to run on the latest transactions coming into the input, not on the whole thing. When I hit…
-
Calculating a final value from two selected values that exist in the same column?
I have two columns—one column has revenue, the other column states which quarter the revenue was collected in. Is there a way that allows a user to select a quarter to calculate the difference in revenue between the selected quarter and another selected quarter. So, I am basically looking for a solution that would enable…
-
Multi-tab input
Hello, I have a input data set that is a multi-tab spreadsheet. I used File upload option to import that to Domo. When I am using this in Magic-ETL, I am unable to specify the tab that I need.. What is the way to specify the exact tab I referring to in that spreadsheet. I need to use different tabs for different joins in…
-
How to remove whitespace after a full name in ETL
I have a name column with a full name: example Bob Dylan and am joining to another dataset by name. I'm having issues and believe its due to extra white space after the last name. I tried using Replace text, regEx, \s, but that just removed all white space creating BobDylan. Any thoughts here?
-
Can I get the MIN date over a partition with a formula tile?
I need to walk a date column partitioned by the value of another column (UID) to find the earliest date for that group. I do not want to collapse the rows. I've tried a number of approaches to this with a SQL perspective, but I'm starting to think Magic ETL wants me to use a Group by. Here are a couple of examples of my…
-
Preview flow "from here" option?
I think I know the answer, but I thought I'd check anyway … Is there any hack to cause a Magic ETL preview to run from a certain point in the flow forward? I'm working on a flow that starts with some heavy sources and groups down before performing some merges and other heavy actions. I would LOVE to preview from a point…
-
Add jump points to ETLs to clean up cluttered ETLs
When I create an ETL I do my best to make sure that all logical paths are kept together and that paths from one tile to another don't cross other paths if possible. Sometimes, however, I can't help but end up with a rat's nest of paths that clutter up the ETL and make it hard to follow. I would like to request jump points…
-
Magic ETL History Error Log Visual Representation
It would be great if in the history of the dataflow it gave some sort of visual representation on which FAILED had an actual error message I normally have to look at each one to find the one with the actual error
-
Average of a difference in Timestamps
I have two timestamp fields: completed at and delivered at. I want to find the difference of both and take the average. The dates include a window that is sometimes over a day. I read this By @GrantSmith which is useful. Is there an easy way to do this without breaking up each segment (day, hour, minute, second) then…
-
Changing dataset update method from Replace to Partition doubles data
We've noticed that if we change the update method of an existing dataset to Partition from replace, we end up with two records in the dataset for every new one (and both of them look identical, down to the field we're using for partitioning): it was quite the shock to see a dataset I expected to have 91 million rows…
-
Issue with Sales Data Tracking and Date Transformation
Hello, I'm encountering an issue with tracking sales data in from our CRM. The problem arises from the fact that the table card relies on the 'Date Created' column for capturing engagements. Although this successfully captures most sales data, it fails to include engagements that were created in the previous year but…
-
Formulae function for table instead of line by line
I have two tables. The first table i have a list of telephone numbers. The second table, a list of the first 3 digits of the number. I want to qualify the first with the next. Here is my formulae: case when SUBSTR(Phone,4,3) not in(NXX) then 'no' else 'yes' END so this is fine in that it qualifies line by line. However, I…
-
Why doesn't the Date Settings feature in Magic ETL update my dates?
When I navigate to Settings and change the Timezone to America/Los Angeles, it doesn't change any of the values for my date columns. However, when I navigate to my input dataset in the ETL and change the time zone on an individual date field, it works as expected. Am I doing something wrong?
-
Fill in Blanks based on existing column
Hi All, Financial Analyst trying to tackle ETLs. Vaguely familiar and can work my way through MagicETL but am stumped on this one. Hoping for some help. I have a data set replicated below. I want to fill the the [BLANK] using an ETL so on the data set where the store numbers are the same and the ticketIDs are the same, the…
-
Chose the newest date available
Hi All, I am working to combine two tables. The first step I need to take is to filter the project_number by with the newest report date available. The example below shows two different project numbers The first one has the last report date as Q3 2022 - we need to capture that input The second project_number has q4 of 2022…
-
unpivoting data
I have data this way: Account | Category | Date 12 | Phone | 01/01/22 12 | TV | 01/01/22 13 | Phone | 01/02/22 12 | TV | 01/01/22 I would like to figure out on each date the counts for each subcategory. First i would want the data pivoted this way: Account | Category | Date 12 | Phone, TV | 01/01/22 13 | Phone | 01/02/22…
-
Does anyone know a Regex that only accepts a segment with a number before 'k' and nothing after?
Does anyone know how to create a Regex that only accepts a segment with a number before a 'k' and nothing after? Or it can be a regex that replaces everything that doesn't have a number before 'k' and nothing after with an empty string. I am looking to extract the circ value for our email campaigns but some rows have a…
-
Pass Variables into a MagicETL from Workflows.
With the new workflow features on the horizon, I think it would be immeasurably valuable to pass output variables from workflows into Magic ETLs since workflows can execute ETLs already. For example: An 'audit' workflow is triggered that evaluates a dataset for various criteria. As part of the evaluation it sets output…
-
Word Count
Is there a way to create a field or value that identifies the number of words in a field? Preferably ETL, but Beastmode if necessary.
-
Sum of units sold, rolling 30 days
Looking to replicate the exact data layout above (side by side columns) in a table in Domo. So units sold by SKU by month (got this far) but also a column for rolling L30 Days sum. I created a new column in the dataset for count of days from current for each row DATEDIFF(CURDATE(),(Calendar Date)) but having a challenge…
-
Averaging time/returning only whole numbers of a fraction number
Is there a way in a beastmode to make the following example numbers on the left below remove the numbers after the decimal? 14.1925 — 14 15.999 —- 15 0.98 — 0 I am trying to get the average time of day that donors answer their phone when we call. So here below this donor answered his phone at these 3 times (hh:mm:ss):…
-
Using partitioning in ETL or Workbench
Good afternoon. Typically, to not do full replaces of data pulls into Domo from our databases, we have used recursive dataflows with ETL. I am trying to think of a way of accomplishing this using the partitioning features in ETL and/or workbench to avoid the ETL still having to process the whole set of updated+historical.…
-
SQL formula not working?
I have a series of tests that run to determine a pass or fail. All the formulas work but this one is giving me problems - CASE WHEN Critical/Major= 'Common' AND
No>= 2 AND Critical/Major= 'Major' AND No>= 1 THEN 'Fail' Any one know why this would not be returning a Fail?
-
Average Time between Orders
Stuck doing this in Magic ETL: Trying to calculate the average time between orders. For each record in the DataSet, add a field showing the number of days since the previous order for that customer. Customers have multiple orders so I can't use Max(date)
-
Converting Dataflows
Having a "Convert" button in dataflows would be great for switching from one dataflow to another. For example, a MySQL dataflow to a Magic ETL.