-
Multiple singe day events grouped as single consecutive day events
I am trying to figure out a way, in Magic ETL, to take multiple single day events and group them when there is break in consecutive days. Example, if the results show the 1st, 2nd, 3rd, 5th, 6th, 9th, 10th and 11th, I need three results, not 8. I want to see begin and end dates of 1st-3rd, 5th-6th, and 9th-11th. Any…
-
Magic ETL - Sum of values in a column
In my dataset i have a column "A" and there are numbers in that which represent spend. I want to create a new column in which i want sum of all values in A to be available in the new column in all rows. Eg. If sum of all values in column A is 125, and I have 10 rows, then in the new column "B" I want 125 in all 10 rows and…
-
Transforming an array of custom fields
I have a dataset currently flowing in from MongoDB which is essentially populated based on custom fields that are optionally set within the source. Each element in the array has the name and value of the custom field (ie. customField<0-N>_fieldName and customField<0-N>_fieldValue). The issue is that it's not always the…
-
Beast Mode for same date check
I have a list of companies and their create date. I want to create a beast mode that checks if a list of companies has the same create date. Any help here? Would this need to be done in Magic ETL?
-
Creating a new column using Formula in Magic ETL
Hello, I have a dataframe with a column named 'Screening Date' in that column are dates and null values. I want to create a new column called 'Completed' that looks through 'Screening date' and if there is a date in a particular row I want to Write "Yes" in my new column. If the 'Screening date' column is null I want to…
-
resursion
i have a large dataset that is too large on the SQL source to bring in monthly so I have to bring in daily. So, I need to find a way to keep a few months of data in Domo. What would be the best way to do this? Should I use recursion? Is partitioning another option? I'm not too sure how these work. Would someone be able to…
-
Cloud Amplifier - Incremental Load
I'm Running MAGIC ETL to Transfer Data from Cloud Amplifier dataset (connected to Snowflake view with about 200 million rows) to a dataset without any transformation. Every time it takes about 1 hour 20 minutes to fetch data from Cloud Amplifier dataset (S3LoaderAction) as it seems it is doing full Data fetch all the time.…
-
Data Science Access/Grant for Users in Magic ETL
We have users who use Magic ETL, but as admins we have users that should not have access to the features in the data science add-on. If there was a way to add a grant so we can revoke access to certain add-ons for users, this would be quite helpful.
-
How can I remove line breaks from a string column in an ETL?
I have a dataset that includes line breaks in some cells. I was trying to use the "Replace Text" action, but I'm not sure how Domo is coding the breaks. '\n' and '<br>' did not work. In Domo, you can't visually see the line breaks, but as soon as I download the CSV and open in Excel, I can see them (screen shot attached).…
-
Meltwater Connector Data Visualization Ideas
Hi All, Hoping to get in touch with any Domo users who are interested in sharing ideas around Meltwater (social & media intelligence) platform connector cards. Let me know! Any successes or best practices? We just onboarded the new platform across our brands. Thanks, Paul
-
How to create a dataset last updated card at top of dash?
Hey, how would I create a last updated card on top of a dash? This way it gives the users the understanding of how up to date the cards below are, etc. How would i create that on the dataset to then even be able to apply to a card? Thanks!
-
Remove duplicate unknown comma separated values within a single 'cell'
Hello good people of Domo Very frustrated trying to remove duplicates WITHIN a comma seperated list. I have the following webform: If I 'Group By' (Magic ETL) by 'Who' & 'Manufacturer' (combining 'Model' & 'Colour' with commas) I get the below. This has repeats in R5:C3 (2x 'TT'), R6:C3 (2x V70) and 'Black' is repeated in…
-
How can I update row values for col1 based on the common ID in col2
How can I use MagicETL to update the rows with NULL Source values to have their relevant Source value, based on ID? Starting Table ———————- Source | ID | RankCol ———————- plant | 100 | 1 NULL | 100 | 2 animal | 101 | 1 NULL | 101 | 2 Desired Resulting Table ———————- Source | ID ———————- plant | 100 | 1 plant | 100 | 2…
-
Backup of ETL
I have a number of ETLs that may need to be extensively updated or removed. I would like to create a backup. I understand that there is a versioning capability built into Domo, but it would be very useful to have an offline backup as well. Besides manual work, is there a way to do this?
-
Issues Joining Transaction Details to Primary Dataset
I have two datasets. One is structured as the "primary" expense file, where each row is dates and other dimensions for each credit/debit. The next is credit card transaction details. They share transaction IDs in a column named Doc, share GL #'s, and share posted dates. The combination of all 3 of these things will result…
-
I would like to do predictive lead scoring for my data
Hi, I have a dataset with the leads information (demographic, titles, etc..). What would be the way to build the predictive score in Domo? For example, Domo can help me predict the score of this lead based on the assigned columns. Thank you for your help!
-
Dataset Views - JOIN on date range?
In most database systems, you can create a join/view on date ranges like so: SELECT * FROM A1 JOIN A2 ON A1.ProductID = A2.ProductID AND (A2.SalesDate >= A1.StartDate) AND (A2.SalesDate <= A1.EndDate OR A1.EndDate IS NULL) However, a DataSet View in Domo only seems to allow joins on exact values and does not allow ranges…
-
Data Flows - Testing Use Case Filters
Use Case: When building data flows with data sets in millions of rows, it's hard to test if the logic works across those rows unless I add filter tiles that filter out data at specific points during the Data Flow build process. This can add complexity when adding many test cases at specific points. The Idea: It would be…
-
Magic ETL column parsing
Is there an easy way using Magic ETL to create new columns based on existing columns. For example I have an ID column and a Page Name column and want to make each ID and Page Name a net new column to link to other data in the dataset. (I'm using governance Page data) Any ideas here?
-
Run DataFlow break/throttle
A tile within Magic ETL that you can insert inside a DataFlow that allows you to throttle the number of rows/calculations that continue past that point - including a full stop (0%. Use Case: I would use this whilst building out complex workflows so that I can test the parts of the workflow I want to test without using up…
-
Duplicate value handling in ETL
I have a column where there are around 34 values that are duplicated for one line that is supposed to be for two people. See picture for example. Ideally it'd be great to have one formula that can distinguish where the break would be so I don't have to manually create 34 lines of code, and have to continually add lines…
-
Remove individual members from view
I have created a view as an admin on top of an ETL and this view is shared with four groups. However, after some time I observed that individual users are being added within the user group, even though they are already members of the group. What should I do to prevent individual members from being added?
-
Magic ETL: Avoid loading all the input columns and rows from data vault.
In Magic ETL, to avoid loading all the input columns and rows from the data vault. On the Input tile, under “Data Handling Section” if there could be a provision (refer to attached pdf with screenshot) check box to select required columns (simple request) and text box to add a where clause on each column Or one text box to…
-
Trying to Count Instances within certain date range where 1 field is the same
Hello! I am trying to replicate an excel formula to determine the number of times a caller calls within 4 days, 3 days, 2 days, and 1 day. I would like to create a field for each of these time windows. If someone calls 6 times within 4 days, I would like the 6th call to have the number 5 in it in the "4 day window" flag.…
-
Does anybody mind sharing what their marketing campaign dashboard looks like?
-
Are Rank functions case-insensitive?
I'm trying to get a rank for data ordered by modified date and partitioned by id. id is alphanumeric and case-sensitive in the source system. However, when I apply the rank (or row_number) function I get 2 different ids grouped because of the letter case. Collation mode is set to Binary in the ETL Settings.
-
Adding new Historical Data to an Already Existing Recursive Dataflow
I am looking for a way to add historical data into my already existing recursive dataflow. My two input datasets are 1.) an email connector that uploads once a day, 2.) a copy of my output dataset as an input dataset acting as my historical records. My output dataset has data from 2021-2023 but I would like to add data…
-
window function
I have the following table and i would like to understand how to get the difference between dates: id | status | date 1 | disconnect | april 4 1 | reconnect | april 7 2 | disconnect | june 4 I would like to understand the average days that persons reconnect in the entire dataset. Can a partition function work here? The…
-
Include Data for a specific date range
Hello - newbie here - I need to know how to only include data that falls within my defined start and end dates columns. There are multiple flight dates, so I need to be able to bucket the daily delivery data within those defined dates. It just pulls in all of the data for each flight and I cannot seem to get it to work. I…