-
How is Timezone inherited from source then converted?
I have a dataset coming in from the Gong connector and some timestamps come in as text fields (scheduled, started). Our Domo timezone is set to Eastern. When I cast data type as timestamp, the times move up 3 hours. Should I assume the Gong source data is Pacific (Gong is in SF) and Domo is inheriting the timezone…
-
I want to create a column that contains the total sum of another column.
Hi everyone, looking to create a column that contains total revenue in order to find individual contributions. I have tried to do this using rank/window function within the magic ETL however all I get is a running total. Any help appreciated :) Thanks!
-
Error Message on Run when Using 'New' Data Selection
Hi all, I have an ETL with a View of a Dataflow as the input - data selection on input set to 'New' (Beta) then output is set to 'Append (Beta'). The input dataset is 250m rows going back 13 months, so I really only need the ETL to run on the latest transactions coming into the input, not on the whole thing. When I hit…
-
Calculating a final value from two selected values that exist in the same column?
I have two columns—one column has revenue, the other column states which quarter the revenue was collected in. Is there a way that allows a user to select a quarter to calculate the difference in revenue between the selected quarter and another selected quarter. So, I am basically looking for a solution that would enable…
-
Multi-tab input
Hello, I have a input data set that is a multi-tab spreadsheet. I used File upload option to import that to Domo. When I am using this in Magic-ETL, I am unable to specify the tab that I need.. What is the way to specify the exact tab I referring to in that spreadsheet. I need to use different tabs for different joins in…
-
How to remove whitespace after a full name in ETL
I have a name column with a full name: example Bob Dylan and am joining to another dataset by name. I'm having issues and believe its due to extra white space after the last name. I tried using Replace text, regEx, \s, but that just removed all white space creating BobDylan. Any thoughts here?
-
Can I get the MIN date over a partition with a formula tile?
I need to walk a date column partitioned by the value of another column (UID) to find the earliest date for that group. I do not want to collapse the rows. I've tried a number of approaches to this with a SQL perspective, but I'm starting to think Magic ETL wants me to use a Group by. Here are a couple of examples of my…
-
Preview flow "from here" option?
I think I know the answer, but I thought I'd check anyway … Is there any hack to cause a Magic ETL preview to run from a certain point in the flow forward? I'm working on a flow that starts with some heavy sources and groups down before performing some merges and other heavy actions. I would LOVE to preview from a point…
-
Add jump points to ETLs to clean up cluttered ETLs
When I create an ETL I do my best to make sure that all logical paths are kept together and that paths from one tile to another don't cross other paths if possible. Sometimes, however, I can't help but end up with a rat's nest of paths that clutter up the ETL and make it hard to follow. I would like to request jump points…
-
Magic ETL History Error Log Visual Representation
It would be great if in the history of the dataflow it gave some sort of visual representation on which FAILED had an actual error message I normally have to look at each one to find the one with the actual error
-
New Dataflow Run Options
Looks like Domo has silently updated trigger options for dataflows (hopefully its not silent and they tell people, I think it just got to my instance about an hour ago so hoping I am just early and more details will come out soon). I love this idea but do feel it is a bit clunky and requires a lot more clicks but I need to…
-
Magic ETL Organization Tiles
Would be nice to have a feature to add a box around several tiles in order to organise better the dataflow. Sometimes we have a complex dataflow with several business logic and a lot of tiles, and it would be easier to identify the several steps with that boxes. An example of that is like the one in Unreal Engine:
-
Average of a difference in Timestamps
I have two timestamp fields: completed at and delivered at. I want to find the difference of both and take the average. The dates include a window that is sometimes over a day. I read this By @GrantSmith which is useful. Is there an easy way to do this without breaking up each segment (day, hour, minute, second) then…
-
Changing dataset update method from Replace to Partition doubles data
We've noticed that if we change the update method of an existing dataset to Partition from replace, we end up with two records in the dataset for every new one (and both of them look identical, down to the field we're using for partitioning): it was quite the shock to see a dataset I expected to have 91 million rows…
-
Issue with Sales Data Tracking and Date Transformation
Hello, I'm encountering an issue with tracking sales data in from our CRM. The problem arises from the fact that the table card relies on the 'Date Created' column for capturing engagements. Although this successfully captures most sales data, it fails to include engagements that were created in the previous year but…
-
Formulae function for table instead of line by line
I have two tables. The first table i have a list of telephone numbers. The second table, a list of the first 3 digits of the number. I want to qualify the first with the next. Here is my formulae: case when SUBSTR(Phone,4,3) not in(NXX) then 'no' else 'yes' END so this is fine in that it qualifies line by line. However, I…
-
Why doesn't the Date Settings feature in Magic ETL update my dates?
When I navigate to Settings and change the Timezone to America/Los Angeles, it doesn't change any of the values for my date columns. However, when I navigate to my input dataset in the ETL and change the time zone on an individual date field, it works as expected. Am I doing something wrong?
-
Fill in Blanks based on existing column
Hi All, Financial Analyst trying to tackle ETLs. Vaguely familiar and can work my way through MagicETL but am stumped on this one. Hoping for some help. I have a data set replicated below. I want to fill the the [BLANK] using an ETL so on the data set where the store numbers are the same and the ticketIDs are the same, the…
-
Chose the newest date available
Hi All, I am working to combine two tables. The first step I need to take is to filter the project_number by with the newest report date available. The example below shows two different project numbers The first one has the last report date as Q3 2022 - we need to capture that input The second project_number has q4 of 2022…
-
unpivoting data
I have data this way: Account | Category | Date 12 | Phone | 01/01/22 12 | TV | 01/01/22 13 | Phone | 01/02/22 12 | TV | 01/01/22 I would like to figure out on each date the counts for each subcategory. First i would want the data pivoted this way: Account | Category | Date 12 | Phone, TV | 01/01/22 13 | Phone | 01/02/22…
-
Dynamic Pivot
I have a table with a combination of fields and a target value. I want to concat all the fields (Retailer, Field, Target, Strategic Priority) and pivot the table so they are all columns with their respective Target Value underneath. I know how to do this with the Pivot option in which I manually create a new column for…