-
How to build a filter for only the most recent value of a column in a data set to show.
I've got a dataset of patients for my hospital and each patient has a unique medical record number. The dataset has multiple visits from the same patients and each visit gets a unique account number. Each visit there is also a calculated readmission risk score. I'm trying to build a filter either in the ETL or on the Domo…
-
Visualizing Linear Regression Confidence Intervals in Domo
Is there a way to visualize confidence intervals from Domo's built in predictive models. Do I need to create a new formula for each one and use a multi-line chart?
-
Remove duplicate sites that have different 'operators'
Hello, I have a large list of sites where there are multiple duplicates of the same 'Site Address'. I can't just use the 'Remove Duplicates' tile in ETL as there can be multiple panels on one site. I'm looking to sort the sites using the 'Latest update' date field. Then I'd like to remove sites that have the same address…
-
Join Condition in ETL
1.For Some scenarios we will join tables based on the between dates condition with out columns mapping Eg select a.*,b.* from Table1 a , Table2 b where Date between date1 and date2 2.For Some scenarios we will join tables without any conditions Eg select a.*,b.* from Table1 a , Table2 b
-
Mimic Vlookup in Dataset?
As the title says, I am trying to mimic a vlookup on a dataset. I am using an ETL that is connecting different membership logs from SF. Basically every time a member leaves or joins it creates a new log. On one dashboard we are looking at data based on all the members who joined this year but also left this same time…
-
Using RegEx to split a column at a delimeter
I currently am working with a column that is delimited using underscores. I was able to write the following RegEx in a builder which was able to do what I needed: ^(?:[^_]+) What is the best way to implement this RegEx to return the part of the string that this captures?
-
DAP Dataflow
What is this? I have found DAP Dataflow ID in the governance data. I found a magic ETL and I can see the Dataflow ID in the URL and it matches with the record. I opened all the datasets, none of them match the DAP Dataflow ID and there is nothing I can find in knowledge that explains what this is. Anyone?
-
Criteria Based Triggers
Greetings, It would be great if we could schedule ETL to run on multiple yet very specific criteria. The one I have in mind as an example would be if the data set is not triggered by a prior dataset updating to allow for the system to run it at a certain time. I know we can set it to do this now but in that case it would…
-
How to correctly pivot this data?
I am trying to pivot the data below in an ETL flow. I am having trouble formmatting it correctly to PIVOT how I need. I would like the following above to look like this after complete… How could I do this? Thanks
-
Check if site exists in another dataset, then remove from list if exists - ETL
Hi, I have a list of sites which have been joined from two datasets in an ETL using a field called 'Database Number'. This is working as expected. I want to then check whether this 'Database Number' exists in dataset 3, if it does, it means that we are working on this deal and therefore don't need this included in the…
-
Bug / Incorrect behavior with Convert_TZ() in MagicETL
TL;DR - The covert_tz() is subtracting an additional 5 hours when trying to convert a date/time value in UTC back to its original ET. I have a record that occurred on July 31, 2023 at 08:00:29pm, when recorded in UTC this is '2023-08-01T00:00:29.000Z'. This record has 'America/New_York' as a value in timezone . I wanted to…
-
Remedying Data Recording Issues on the Front End in Domo
I have a dataset with item names. These item names have a preassigned "price" to them that is not in the source data (although I know what they should be). What has happened is that some people (not all people) record their transactions all at once, combining what should be multiple revenue values into a single one.…
-
Null Date Values in Card Filters
Hi! I know this question has been asked a few times in the forums over the years (see "Best Practice for Date fields" and "How do you Filter on Date that is Null") so apologies for the redundancy. I'm asking the question again because these posts seem to miss an element that is crucial to my use case: calculations and…
-
Dataflow failed
Hello all, I get the below error after running my dataflow. As this consists for multiple inputs, I haven't still been able to trace the exact field causing it. But I do have a formula tile with this calculation.. " Failed to convert value '-3--3-01' from type 'String' to type 'Date'. " Some days this data flow runs…
-
Dataflow Search Screen - Show # of Tiles
It would be cool if when searching for dataflows that screen could show # of tiles in the dataflow.
-
How do I take a portion of a column value and push it to a new column?
I have a column for campaign names that looks roughly like this A1234567| Campaign 1 | Google Ads | …… What I need to be able to do is read/grab all the non-space characters before the pipe and put that value in a new column called Campaign ID. In the case above, the new column for Campaign ID would contain A1234567. If…
-
How to exclude/filter out based on 2 dates
Hello Domo! I uploaded a file/table in DOMO, that has a wipe date and a forecast date. What I was hoping to do is, to use this table and join it in my dataset, so that I can use it to filter out everything within the wipe date and forecast date. Is this possible? I am having problems with joining it to my dataset.
-
Dataflow or View Query to run AFTER user filter pages
Sometimes it can be really difficult to build an end dataset that will be able to calculate the metrics that my users care about on the fly in a beastmode. For example: This contains 3 different fixed functions so that I can show a certain metric dynamically to the user. Because of the high computation (mixed with a big…
-
Wildcard for numbers not characters in Beast Mode or Magic ETL?
I'm trying to create a new column based on the prefix of another column, but the prefix B### is categorized as type B, and prefixes BC and BW are categorized as another type H. E.g. Col_ori Col_new B001 B BC002 H BW001 H The wildcard % (i.e. using LIKE 'B%') will include all prefixes starting with B. How can I distinguish…
-
Colorize Column Headers in MagicETL Previews based on Connecting Line Color
With complex flows, it can sometimes be difficult to know what column came from what connecting source. It would be nice if MagicETL colorized column headers based on the connected line colors when in preview mode. As you can see in my beautiful artwork below (🤣), note the task I highlighted in yellow. That is the task I…
-
UUID / GUID Functions in Rank and Window
There are times where I may need to generate a unique ID so I can tie related batches of records together under said ID without worrying much about collisions with another group of related records in the same dataset. This will also allow me to treat them as a partition key if I want to target a handful of records for…
-
Ability to save and easily reuse commonly used strings of logic within MagicETL/SQL
It would be really nice, when creating or editing a Magic ETL, to be able to easily reuse sequences of logic that could be easily adapted to any environment. Recursive append loops Rank and filter Split column and dynamic pivot The option to select which saved item you want to use would appear in the Magic ETL edit menu on…
-
Domo ETL parallel processing to reduce ETL runtime
Hello, I have a python script which is part of an ETL to transform a combination of 3 input datasets. The python script contains multiple if else statements and for loops which is taking aroung 4 hours to complete the ETL pipeline. I want to know if there is an option to parallelize the python script in Magic ETL to reduce…
-
Data transformation ideas around old/new user data
HI, we're migrating from username sign in, to okta that uses email as user id. we have an existing user info data with user id as username (xfsgsbss) but we would have a new data with user id as email(fdhsvbsjsbsjsh@email.com). I want to be able to join both old and new data and make sure the right attributes goes to them,…
-
How to create a rate by specific selection criteria in Domo
Hello again community. So I work within a healthcare organization and I have a domo grouped/stacked bar graph built currently from an etl that has columns regarding patients readmission start date, account number, discharge date and attending providers(previous admission). The card breaks down the readmit percentage rate…
-
Using Magic ETL to extract a substring using Regex and excluding remaining strings
Hello! I know variations of this question have been asked in the forums but I haven't been able to find a solution that works for me. I have a column Project Name that contains Projects out of Financial Force that may contain an At-Risk ticket number, which is formatted as: AR-00000 i.e. literally "AR-" or "AR - " followed…
-
More info in logs
It would be very useful if, when executing a Domo ETL, a log file was generated to see the details of potential failures in the process. Currently, if there is a failure in any of the Domo's own boxes, you see that the process has been interrupted in a part of the process but we don't see the details. Also, if the process…
-
Saving States
Is there a way to save data and possibly append to it? Let me give an example. When I pull data from a database, I would like to pull data and when I pull data tomorrow I want the original data to still be there. So I want to be able to see user counts by region today, and then in a month I would still like to see what it…