-
Creating a new column using Formula in Magic ETL
Hello, I have a dataframe with a column named 'Screening Date' in that column are dates and null values. I want to create a new column called 'Completed' that looks through 'Screening date' and if there is a date in a particular row I want to Write "Yes" in my new column. If the 'Screening date' column is null I want to…
-
resursion
i have a large dataset that is too large on the SQL source to bring in monthly so I have to bring in daily. So, I need to find a way to keep a few months of data in Domo. What would be the best way to do this? Should I use recursion? Is partitioning another option? I'm not too sure how these work. Would someone be able to…
-
Cloud Amplifier - Incremental Load
I'm Running MAGIC ETL to Transfer Data from Cloud Amplifier dataset (connected to Snowflake view with about 200 million rows) to a dataset without any transformation. Every time it takes about 1 hour 20 minutes to fetch data from Cloud Amplifier dataset (S3LoaderAction) as it seems it is doing full Data fetch all the time.…
-
Data Science Access/Grant for Users in Magic ETL
We have users who use Magic ETL, but as admins we have users that should not have access to the features in the data science add-on. If there was a way to add a grant so we can revoke access to certain add-ons for users, this would be quite helpful.
-
How can I remove line breaks from a string column in an ETL?
I have a dataset that includes line breaks in some cells. I was trying to use the "Replace Text" action, but I'm not sure how Domo is coding the breaks. '\n' and '<br>' did not work. In Domo, you can't visually see the line breaks, but as soon as I download the CSV and open in Excel, I can see them (screen shot attached).…
-
Meltwater Connector Data Visualization Ideas
Hi All, Hoping to get in touch with any Domo users who are interested in sharing ideas around Meltwater (social & media intelligence) platform connector cards. Let me know! Any successes or best practices? We just onboarded the new platform across our brands. Thanks, Paul
-
How to create a dataset last updated card at top of dash?
Hey, how would I create a last updated card on top of a dash? This way it gives the users the understanding of how up to date the cards below are, etc. How would i create that on the dataset to then even be able to apply to a card? Thanks!
-
Remove duplicate unknown comma separated values within a single 'cell'
Hello good people of Domo Very frustrated trying to remove duplicates WITHIN a comma seperated list. I have the following webform: If I 'Group By' (Magic ETL) by 'Who' & 'Manufacturer' (combining 'Model' & 'Colour' with commas) I get the below. This has repeats in R5:C3 (2x 'TT'), R6:C3 (2x V70) and 'Black' is repeated in…
-
How can I update row values for col1 based on the common ID in col2
How can I use MagicETL to update the rows with NULL Source values to have their relevant Source value, based on ID? Starting Table ———————- Source | ID | RankCol ———————- plant | 100 | 1 NULL | 100 | 2 animal | 101 | 1 NULL | 101 | 2 Desired Resulting Table ———————- Source | ID ———————- plant | 100 | 1 plant | 100 | 2…
-
Backup of ETL
I have a number of ETLs that may need to be extensively updated or removed. I would like to create a backup. I understand that there is a versioning capability built into Domo, but it would be very useful to have an offline backup as well. Besides manual work, is there a way to do this?
-
Issues Joining Transaction Details to Primary Dataset
I have two datasets. One is structured as the "primary" expense file, where each row is dates and other dimensions for each credit/debit. The next is credit card transaction details. They share transaction IDs in a column named Doc, share GL #'s, and share posted dates. The combination of all 3 of these things will result…
-
I would like to do predictive lead scoring for my data
Hi, I have a dataset with the leads information (demographic, titles, etc..). What would be the way to build the predictive score in Domo? For example, Domo can help me predict the score of this lead based on the assigned columns. Thank you for your help!
-
Dataset Views - JOIN on date range?
In most database systems, you can create a join/view on date ranges like so: SELECT * FROM A1 JOIN A2 ON A1.ProductID = A2.ProductID AND (A2.SalesDate >= A1.StartDate) AND (A2.SalesDate <= A1.EndDate OR A1.EndDate IS NULL) However, a DataSet View in Domo only seems to allow joins on exact values and does not allow ranges…
-
Magic ETL column parsing
Is there an easy way using Magic ETL to create new columns based on existing columns. For example I have an ID column and a Page Name column and want to make each ID and Page Name a net new column to link to other data in the dataset. (I'm using governance Page data) Any ideas here?
-
Run DataFlow break/throttle
A tile within Magic ETL that you can insert inside a DataFlow that allows you to throttle the number of rows/calculations that continue past that point - including a full stop (0%. Use Case: I would use this whilst building out complex workflows so that I can test the parts of the workflow I want to test without using up…
-
Duplicate value handling in ETL
I have a column where there are around 34 values that are duplicated for one line that is supposed to be for two people. See picture for example. Ideally it'd be great to have one formula that can distinguish where the break would be so I don't have to manually create 34 lines of code, and have to continually add lines…
-
Remove individual members from view
I have created a view as an admin on top of an ETL and this view is shared with four groups. However, after some time I observed that individual users are being added within the user group, even though they are already members of the group. What should I do to prevent individual members from being added?
-
Magic ETL: Avoid loading all the input columns and rows from data vault.
In Magic ETL, to avoid loading all the input columns and rows from the data vault. On the Input tile, under “Data Handling Section” if there could be a provision (refer to attached pdf with screenshot) check box to select required columns (simple request) and text box to add a where clause on each column Or one text box to…
-
Trying to Count Instances within certain date range where 1 field is the same
Hello! I am trying to replicate an excel formula to determine the number of times a caller calls within 4 days, 3 days, 2 days, and 1 day. I would like to create a field for each of these time windows. If someone calls 6 times within 4 days, I would like the 6th call to have the number 5 in it in the "4 day window" flag.…
-
Does anybody mind sharing what their marketing campaign dashboard looks like?
-
Are Rank functions case-insensitive?
I'm trying to get a rank for data ordered by modified date and partitioned by id. id is alphanumeric and case-sensitive in the source system. However, when I apply the rank (or row_number) function I get 2 different ids grouped because of the letter case. Collation mode is set to Binary in the ETL Settings.
-
Adding new Historical Data to an Already Existing Recursive Dataflow
I am looking for a way to add historical data into my already existing recursive dataflow. My two input datasets are 1.) an email connector that uploads once a day, 2.) a copy of my output dataset as an input dataset acting as my historical records. My output dataset has data from 2021-2023 but I would like to add data…
-
window function
I have the following table and i would like to understand how to get the difference between dates: id | status | date 1 | disconnect | april 4 1 | reconnect | april 7 2 | disconnect | june 4 I would like to understand the average days that persons reconnect in the entire dataset. Can a partition function work here? The…
-
Include Data for a specific date range
Hello - newbie here - I need to know how to only include data that falls within my defined start and end dates columns. There are multiple flight dates, so I need to be able to bucket the daily delivery data within those defined dates. It just pulls in all of the data for each flight and I cannot seem to get it to work. I…
-
Prediction Tile into a Self Serve Prediction Calculator
Hi, has anyone had success with creating a dash for users to make numerical and categorical selections for a dash predictive calculator if you will? I'm referring to the data science tile - "Prediction". I'm able to create magic etl for this type of work but wondering if i can setup a self serve prediction input for our…
-
Removing duplicates
Hi, I need help coming up with logic for this problem. I have a dataset that looks like this: ID Source 1 A 1 A 1 B 1 B 2 A 3 B I want to only remove rows from source A IF that same row is also in source B. Otherwise I want to keep rows unique to source A and unique to source B. The output should look like this: ID Source…
-
Multiple Split Columns
Hey, so i need to split numerous times within a column of data. i'm on the split column tile now, but i don't want to enter 100 new columns to create for each split. is there an easier way to split all of the data in the 'tags' column?
-
Comparing one month's EOM data to previous month EOM data in same row
Hi, I need to do a calculation so I can subtract previous months hours (4/31/2023) data from this month's hours (5/31/2023) data. This is how data is organized. This just a small example of how it is. Without changing the structure of dataset how can i get all the 4/31 data on the same row as the 5/31 data? I have been…
-
How do I alter Date (in Text format : 01.09.2023) to Date format?
How do I alter Date (in Text format : 01.09.2023) to Date format? I need it to be in a Date format such as 2023-09-01 instead of 01.09.2023
-
Approach to logically group data via inference of similar text strings
Hey all. I'm not looking for the detailed solution here as I know it will be complex, potentially require purchased add-ons and most definitely will require my dev team. But I'm hoping someone can guide me to general approaches and Domo capabilities that would be leveraged - if even supportable. We've got a large data set…