-
How can I remove line breaks from a string column in an ETL?
I have a dataset that includes line breaks in some cells. I was trying to use the "Replace Text" action, but I'm not sure how Domo is coding the breaks. '\n' and '<br>' did not work. In Domo, you can't visually see the line breaks, but as soon as I download the CSV and open in Excel, I can see them (screen shot attached).…
-
Remedying Data Recording Issues on the Front End in Domo
I have a dataset with item names. These item names have a preassigned "price" to them that is not in the source data (although I know what they should be). What has happened is that some people (not all people) record their transactions all at once, combining what should be multiple revenue values into a single one.…
-
Null Date Values in Card Filters
Hi! I know this question has been asked a few times in the forums over the years (see "Best Practice for Date fields" and "How do you Filter on Date that is Null") so apologies for the redundancy. I'm asking the question again because these posts seem to miss an element that is crucial to my use case: calculations and…
-
Dataflow failed
Hello all, I get the below error after running my dataflow. As this consists for multiple inputs, I haven't still been able to trace the exact field causing it. But I do have a formula tile with this calculation.. " Failed to convert value '-3--3-01' from type 'String' to type 'Date'. " Some days this data flow runs…
-
Dataflow Search Screen - Show # of Tiles
It would be cool if when searching for dataflows that screen could show # of tiles in the dataflow.
-
How do I take a portion of a column value and push it to a new column?
I have a column for campaign names that looks roughly like this A1234567| Campaign 1 | Google Ads | …… What I need to be able to do is read/grab all the non-space characters before the pipe and put that value in a new column called Campaign ID. In the case above, the new column for Campaign ID would contain A1234567. If…
-
Select All Columns in Remove Duplicates ETL Tile
Instead of having to add each column individually, it would be great if there was a select all columns feature for the remove duplicates step in the ETL.
-
How to exclude/filter out based on 2 dates
Hello Domo! I uploaded a file/table in DOMO, that has a wipe date and a forecast date. What I was hoping to do is, to use this table and join it in my dataset, so that I can use it to filter out everything within the wipe date and forecast date. Is this possible? I am having problems with joining it to my dataset.
-
Dataflow or View Query to run AFTER user filter pages
Sometimes it can be really difficult to build an end dataset that will be able to calculate the metrics that my users care about on the fly in a beastmode. For example: This contains 3 different fixed functions so that I can show a certain metric dynamically to the user. Because of the high computation (mixed with a big…
-
Wildcard for numbers not characters in Beast Mode or Magic ETL?
I'm trying to create a new column based on the prefix of another column, but the prefix B### is categorized as type B, and prefixes BC and BW are categorized as another type H. E.g. Col_ori Col_new B001 B BC002 H BW001 H The wildcard % (i.e. using LIKE 'B%') will include all prefixes starting with B. How can I distinguish…
-
Colorize Column Headers in MagicETL Previews based on Connecting Line Color
With complex flows, it can sometimes be difficult to know what column came from what connecting source. It would be nice if MagicETL colorized column headers based on the connected line colors when in preview mode. As you can see in my beautiful artwork below (🤣), note the task I highlighted in yellow. That is the task I…
-
UUID / GUID Functions in Rank and Window
There are times where I may need to generate a unique ID so I can tie related batches of records together under said ID without worrying much about collisions with another group of related records in the same dataset. This will also allow me to treat them as a partition key if I want to target a handful of records for…
-
"Documentation Mode" in Magic ETL/SQL
A toggle next to "Try the new Magic ETL" would read "Documentation Mode" and would: Put an opaque film over the whole Magic ETL map Disallow changes to the tiles Enable the ability to draw and color-code sections of the ETL Be able to notate what each section is doing An additional item in the Save menu would be "Save and…
-
Ability to save and easily reuse commonly used strings of logic within MagicETL/SQL
It would be really nice, when creating or editing a Magic ETL, to be able to easily reuse sequences of logic that could be easily adapted to any environment. Recursive append loops Rank and filter Split column and dynamic pivot The option to select which saved item you want to use would appear in the Magic ETL edit menu on…
-
Block tiles in Magic ETL to simplify complex dataflows
"Block Tiles" are larger tiles that contain a string of tiles inside. Block tiles could make large Magic ETLs (100+ tiles) easier to document, and much easier to read and understand. These tiles would contain a group of tiles that have a single output tile (not an output dataset) to make for an easy way to connect block…
-
Tool to convert MySQL data flows to Magic ETL
In order to take full use of the power Magic ETL v2, it would be great if a tool could be developed to take a MySQL data flow and convert it to Magic ETL
-
ETL Field Search Capability
It would be helpful in an ETL to be able to search for a field name and have the tiles that directly reference that field name be highlighted. Many times when supporting dataflow development we are looking for a field and we have to open every tile to see where that field is referenced - in join, in formulas, in filters,…
-
Domo ETL parallel processing to reduce ETL runtime
Hello, I have a python script which is part of an ETL to transform a combination of 3 input datasets. The python script contains multiple if else statements and for loops which is taking aroung 4 hours to complete the ETL pipeline. I want to know if there is an option to parallelize the python script in Magic ETL to reduce…
-
Data transformation ideas around old/new user data
HI, we're migrating from username sign in, to okta that uses email as user id. we have an existing user info data with user id as username (xfsgsbss) but we would have a new data with user id as email(fdhsvbsjsbsjsh@email.com). I want to be able to join both old and new data and make sure the right attributes goes to them,…
-
How to create a rate by specific selection criteria in Domo
Hello again community. So I work within a healthcare organization and I have a domo grouped/stacked bar graph built currently from an etl that has columns regarding patients readmission start date, account number, discharge date and attending providers(previous admission). The card breaks down the readmit percentage rate…
-
Using Magic ETL to extract a substring using Regex and excluding remaining strings
Hello! I know variations of this question have been asked in the forums but I haven't been able to find a solution that works for me. I have a column Project Name that contains Projects out of Financial Force that may contain an At-Risk ticket number, which is formatted as: AR-00000 i.e. literally "AR-" or "AR - " followed…
-
More info in logs
It would be very useful if, when executing a Domo ETL, a log file was generated to see the details of potential failures in the process. Currently, if there is a failure in any of the Domo's own boxes, you see that the process has been interrupted in a part of the process but we don't see the details. Also, if the process…
-
Saving States
Is there a way to save data and possibly append to it? Let me give an example. When I pull data from a database, I would like to pull data and when I pull data tomorrow I want the original data to still be there. So I want to be able to see user counts by region today, and then in a month I would still like to see what it…
-
Joinin on Email
I have 2 contact databases where I need to join them based on both phone number, name, and email. I am able to currently join on phone but the email part I am having an issue with. When trying to join on email it isn't working. What is the best way to join on email address and if possible where emails closely match?
-
Split Column by Number of Characters
Can we add an option to split a column by the number of characters in the field? I.e. split column by number of characters as far left or as far right. This is a very useful feature in PBI Power Query Editor especially when you have strange date formats like 1231201 or concatenated fields with an order number of a specific…