-
Case when SYNTAX
Hi all, I am trying to write a case statement for a column when we see a null to grab another column. I am not sure why I am not getting the output expected. Can someone take a look and maybe advise? Essentially 36534370 and 36534369 from the investor_loan_id column should be in the left column as well. **I've tried to…
-
How do I fill text/values down in the same column for different partitions
I am trying to fill the text/values in "Drillable P&L Group Names" and "Sort Order" down in the same columns and can't figure out how. Keep in mind that the attached dataset is a single partition of a much larger dataset that contains multiple Client Names, GL Accounts, etc. And I'm trying to find a solution that would…
-
Comment out tiles in MagicETL
When building complex ETLs it would be handy to be able to "comment out" tiles so they are ignored for execution. For bonus points, I'd like to be able to have an unterminated chain of commented-out tiles not block the ETL's execution.
-
Looking on a specific date
Hi all, I am working in Magic ETL. I have group two different datasets on their 'lock_dates' I have created a calculated column where the number of locks are counted in each data set. Then I created a column that told me if dataset 1 matched dataset 2. All of this is shown below The issue I am running into is seeing that…
-
Is there an alternative for the add constants tile?
Hi Everyone, I'm trying to establish a new column with the same value for every row. But instead of a manual floating decimal input through an add constants tile, I'd like to generate the value from the magic etl auto calculation every time the dataflow runs. I know there is a simple way to do this, but the solution…
-
How can I convert an Excel date code into a normal M/D/Y formatted date?
Hi All, I have some data that I link to DOMO via the Google Analytics connector. It's provided by a 3rd party and contains dates in Excel codes in their 4** format. Is there a recommended Beast Mode or other way to fix the date formatting? Due to IT policy, I can't access google sheets to change it manually. Plus, I would…
-
How do I create a matrix from two unique lists in magic ETL?
How do I create a matrix as shown in the "Result" image based on the two input lists provided (zeros filled in the field)? I am trying to do this in Magic ETL. Thanks in advance! Gregory
-
How to Unpivot or Explode Variable-Length Lists in Domo to Flatten a Table?
Hi Domo community, I have a dataset in Domo where the number of postcodes in a cell can vary. Here's an example of my input data: Network State Postcode A VIC 3000, 3001, 3002 B NSW 3011, 3021, 3001, 3004, 3012 I need to transform it into the following format: Network State Postcode A VIC 3000 A VIC 3001 A VIC 3002 B NSW…
-
LEAD IGNORE NULL in Magic ETL?
Hi there, I am trying to rewrite a Redshift Dataflow into Magic ETL. I ran across a specific function that was available in Redshift that I dont think is possible in Magic ETL. I wanted to get the community's input and advice to see what you guys think. This is the function found in Redshift: LEAD(CASE WHEN t2."channel"…
-
Ability to remove unnecessary columns directly in the input DataSet before loading all its rows
The functionality I require is already available in the MySQL and Redshift DataFlow… …in this example deselecting "department" and "state" columns. This option would make it possible not to load all columns for all rows in the DataSet. I hope it will be available in the Magic ETL input DataSets as soon as possible. Thank…
-
Comparing Datasets to Determine Variance
Hello everyone, I am working on comparing data from a previous data input, Universal Analytics, to a new one, Google Analytics 4. Basically, there was an update and data is formatted differently. I am attempting to join the two datasets to compare the month of A ugust for variances, but the closest thing to a unique column…
-
Long Running Dataflow Alerting/Auto-Restart
We need to have the ability to understand when dataflows are running longer than the average duration. We would like to set user defined alert criteria based upon the dataflow's duration. For example: alert when dataflow has been running 15min, 1hr, etc. longer than the average for the dataflow. Having the functionality of…
-
In App Editable Data and Real-Time Visualizations
Hi Everyone, If users wanted to be able to edit the data that goes into a visualization, and then see how that edit impacted a visualization (and all of it's great metrics), what would be the idea way to do this in Domo? I was thinking that you could use a Domo Webform to let users plug in new data/edit data, and then use…
-
How do I remove the 'Total' row from a data import?
I am using a connector to pull data in from one of our web analytics platforms. The problem is that it pulls in a 'Total' row which I can not suppress at the source. Using an ETL how do I remove that row? I've tried to use the Filter Row tile but perhaps I am doing something wrong there because I have not been able to…
-
Can you use Magic ETL to 'explode' table of transactions to all days?
Table A has transactions that show an item's "Old Status" and "New Status" along with the date of the transaction. For example, row 1 shows that item XYZ changed from "Regular Price" to "Promo Price" on 1/1/2023. Row 2 shows that item XYZ changed from "Promo Price" to "Regular Price" on 1/4/2023. Row 3 shows that item XYZ…
-
Month Over Month % Change of Total Number
I have revenue figures recorded at random intervals of days throughout months. It has not been updated since June, so I cannot use the automatic date filters in Domo without manually going in every month it gets updated and changing things around. I was able to get the most recently updated month and the prior month totals…
-
How to build a filter for only the most recent value of a column in a data set to show.
I've got a dataset of patients for my hospital and each patient has a unique medical record number. The dataset has multiple visits from the same patients and each visit gets a unique account number. Each visit there is also a calculated readmission risk score. I'm trying to build a filter either in the ETL or on the Domo…
-
Visualizing Linear Regression Confidence Intervals in Domo
Is there a way to visualize confidence intervals from Domo's built in predictive models. Do I need to create a new formula for each one and use a multi-line chart?
-
Remove duplicate sites that have different 'operators'
Hello, I have a large list of sites where there are multiple duplicates of the same 'Site Address'. I can't just use the 'Remove Duplicates' tile in ETL as there can be multiple panels on one site. I'm looking to sort the sites using the 'Latest update' date field. Then I'd like to remove sites that have the same address…
-
Join Condition in ETL
1.For Some scenarios we will join tables based on the between dates condition with out columns mapping Eg select a.*,b.* from Table1 a , Table2 b where Date between date1 and date2 2.For Some scenarios we will join tables without any conditions Eg select a.*,b.* from Table1 a , Table2 b
-
Mimic Vlookup in Dataset?
As the title says, I am trying to mimic a vlookup on a dataset. I am using an ETL that is connecting different membership logs from SF. Basically every time a member leaves or joins it creates a new log. On one dashboard we are looking at data based on all the members who joined this year but also left this same time…
-
Using RegEx to split a column at a delimeter
I currently am working with a column that is delimited using underscores. I was able to write the following RegEx in a builder which was able to do what I needed: ^(?:[^_]+) What is the best way to implement this RegEx to return the part of the string that this captures?
-
DAP Dataflow
What is this? I have found DAP Dataflow ID in the governance data. I found a magic ETL and I can see the Dataflow ID in the URL and it matches with the record. I opened all the datasets, none of them match the DAP Dataflow ID and there is nothing I can find in knowledge that explains what this is. Anyone?
-
Criteria Based Triggers
Greetings, It would be great if we could schedule ETL to run on multiple yet very specific criteria. The one I have in mind as an example would be if the data set is not triggered by a prior dataset updating to allow for the system to run it at a certain time. I know we can set it to do this now but in that case it would…
-
How to correctly pivot this data?
I am trying to pivot the data below in an ETL flow. I am having trouble formmatting it correctly to PIVOT how I need. I would like the following above to look like this after complete… How could I do this? Thanks
-
Check if site exists in another dataset, then remove from list if exists - ETL
Hi, I have a list of sites which have been joined from two datasets in an ETL using a field called 'Database Number'. This is working as expected. I want to then check whether this 'Database Number' exists in dataset 3, if it does, it means that we are working on this deal and therefore don't need this included in the…
-
Bug / Incorrect behavior with Convert_TZ() in MagicETL
TL;DR - The covert_tz() is subtracting an additional 5 hours when trying to convert a date/time value in UTC back to its original ET. I have a record that occurred on July 31, 2023 at 08:00:29pm, when recorded in UTC this is '2023-08-01T00:00:29.000Z'. This record has 'America/New_York' as a value in timezone . I wanted to…