-
Effective Dating
I want to capture appointment differential data and report back using effective dating. So that if I want a snapshot of a specific date, I'm pulling the most recent changes up to that moment and ignoring the rest. I've done this plenty in SQL, but looking for a solution using Domo ETL. I don't want to re-invent the wheel.…
-
Creating A Date Field
Hi Domo Community, How would I go about creating a usable date field from two columns I have? One column is the year, and the other is the month. How could I create a date field from those two columns? For example, 2/1/2024 from a column that has February and a column that has 2024. Thanks!
-
using Domo API and partition
Currently i want to append data using the API append method. However, i also want to update the last 2 days 2 a dataset on a cron job so that i do not miss a day. I know partitioning would only keep the unique record. Is it best to use recursion or partitioning for this?
-
Table Subtotaling
Having an issue when trying to subtotal the time columns. I want to be able to see the total off all the times rather than the count of each row? etg. 00:00:20 + 00:11:57+ 00:05:07… I moved my beast mode into ETL formula to try and get the field to work, but I cant get anything besides 'text' field to work.
-
pivoting data
Hi, I have data in this format: Date Island Count 2021-01-02 Aruba 4 2021-02-01 Curacao 9 2021-03-01 Curacao 10 I would like the data to be formatted this way: Island 2021-01-02 2021-02-01 Aruba 4 7 Curacao 9 10 This format is for a table view
-
Group By "Concat Distinct" Now Live!
I wanted to make a quick post to let you know about an update we made to the Group By tile in Magic. In your instances, you should now see the ability to choose a new options when defining how a column should be aggregated in the Group By tile: Combine distinct strings separated by , This allows you to create an aggregate…
-
Marking Duplicates So I Can Filter Them Out
Good afternoon, I am trying to mark rows that match up with each other as duplicates so that I can filter them out and only have the truly unique records left. Example So after I mark and filter the only record left will be the third one that doesn't have a match. What is the best way to do this? Thank you in advance
-
Combining two datasets based on two potential fields
Hi, I have two datasets. One has pacing data, the other has monthly data. All rows have unique IDs, however the pacing data may have either an ID from the old system (legacy ID) or the new system (new ID). Pacing: ID 1 2 3 4 11 Monthly: New ID Legacy ID 10 1 11 12 13 2 14 3 15 How would I go about joining these two…
-
Flag percent of change when it goes negative
Hello, as the title says I am trying to figure out a beast mode or add an additional column in a view/etl to flag a member when they logged in fewer times this current month compared to the previous month. I manually upload the month's numbers at the end of the month so we are measuring trends and wanting to reach out to…
-
Getting the Avg Days, Avg Hours, Avg Minutes
Hello. May I ask for your help in getting the average days or average hours or average minutes between 2 columns of date + timestamp data? The thing is, the average could be 'days', 'hours' or 'minutes', depending on the values of the 2 data columns, so we want to show the output similar to a timestamp format to be…
-
Multiple singe day events grouped as single consecutive day events
I am trying to figure out a way, in Magic ETL, to take multiple single day events and group them when there is break in consecutive days. Example, if the results show the 1st, 2nd, 3rd, 5th, 6th, 9th, 10th and 11th, I need three results, not 8. I want to see begin and end dates of 1st-3rd, 5th-6th, and 9th-11th. Any…
-
Magic ETL - Sum of values in a column
In my dataset i have a column "A" and there are numbers in that which represent spend. I want to create a new column in which i want sum of all values in A to be available in the new column in all rows. Eg. If sum of all values in column A is 125, and I have 10 rows, then in the new column "B" I want 125 in all 10 rows and…
-
Transforming an array of custom fields
I have a dataset currently flowing in from MongoDB which is essentially populated based on custom fields that are optionally set within the source. Each element in the array has the name and value of the custom field (ie. customField<0-N>_fieldName and customField<0-N>_fieldValue). The issue is that it's not always the…
-
Beast Mode for same date check
I have a list of companies and their create date. I want to create a beast mode that checks if a list of companies has the same create date. Any help here? Would this need to be done in Magic ETL?
-
Creating a new column using Formula in Magic ETL
Hello, I have a dataframe with a column named 'Screening Date' in that column are dates and null values. I want to create a new column called 'Completed' that looks through 'Screening date' and if there is a date in a particular row I want to Write "Yes" in my new column. If the 'Screening date' column is null I want to…
-
resursion
i have a large dataset that is too large on the SQL source to bring in monthly so I have to bring in daily. So, I need to find a way to keep a few months of data in Domo. What would be the best way to do this? Should I use recursion? Is partitioning another option? I'm not too sure how these work. Would someone be able to…
-
Cloud Amplifier - Incremental Load
I'm Running MAGIC ETL to Transfer Data from Cloud Amplifier dataset (connected to Snowflake view with about 200 million rows) to a dataset without any transformation. Every time it takes about 1 hour 20 minutes to fetch data from Cloud Amplifier dataset (S3LoaderAction) as it seems it is doing full Data fetch all the time.…
-
Data Science Access/Grant for Users in Magic ETL
We have users who use Magic ETL, but as admins we have users that should not have access to the features in the data science add-on. If there was a way to add a grant so we can revoke access to certain add-ons for users, this would be quite helpful.
-
How can I remove line breaks from a string column in an ETL?
I have a dataset that includes line breaks in some cells. I was trying to use the "Replace Text" action, but I'm not sure how Domo is coding the breaks. '\n' and '<br>' did not work. In Domo, you can't visually see the line breaks, but as soon as I download the CSV and open in Excel, I can see them (screen shot attached).…
-
Meltwater Connector Data Visualization Ideas
Hi All, Hoping to get in touch with any Domo users who are interested in sharing ideas around Meltwater (social & media intelligence) platform connector cards. Let me know! Any successes or best practices? We just onboarded the new platform across our brands. Thanks, Paul
-
How to create a dataset last updated card at top of dash?
Hey, how would I create a last updated card on top of a dash? This way it gives the users the understanding of how up to date the cards below are, etc. How would i create that on the dataset to then even be able to apply to a card? Thanks!
-
Remove duplicate unknown comma separated values within a single 'cell'
Hello good people of Domo Very frustrated trying to remove duplicates WITHIN a comma seperated list. I have the following webform: If I 'Group By' (Magic ETL) by 'Who' & 'Manufacturer' (combining 'Model' & 'Colour' with commas) I get the below. This has repeats in R5:C3 (2x 'TT'), R6:C3 (2x V70) and 'Black' is repeated in…
-
How can I update row values for col1 based on the common ID in col2
How can I use MagicETL to update the rows with NULL Source values to have their relevant Source value, based on ID? Starting Table ———————- Source | ID | RankCol ———————- plant | 100 | 1 NULL | 100 | 2 animal | 101 | 1 NULL | 101 | 2 Desired Resulting Table ———————- Source | ID ———————- plant | 100 | 1 plant | 100 | 2…
-
Backup of ETL
I have a number of ETLs that may need to be extensively updated or removed. I would like to create a backup. I understand that there is a versioning capability built into Domo, but it would be very useful to have an offline backup as well. Besides manual work, is there a way to do this?
-
Issues Joining Transaction Details to Primary Dataset
I have two datasets. One is structured as the "primary" expense file, where each row is dates and other dimensions for each credit/debit. The next is credit card transaction details. They share transaction IDs in a column named Doc, share GL #'s, and share posted dates. The combination of all 3 of these things will result…
-
I would like to do predictive lead scoring for my data
Hi, I have a dataset with the leads information (demographic, titles, etc..). What would be the way to build the predictive score in Domo? For example, Domo can help me predict the score of this lead based on the assigned columns. Thank you for your help!
-
Dataset Views - JOIN on date range?
In most database systems, you can create a join/view on date ranges like so: SELECT * FROM A1 JOIN A2 ON A1.ProductID = A2.ProductID AND (A2.SalesDate >= A1.StartDate) AND (A2.SalesDate <= A1.EndDate OR A1.EndDate IS NULL) However, a DataSet View in Domo only seems to allow joins on exact values and does not allow ranges…
-
Data Flows - Testing Use Case Filters
Use Case: When building data flows with data sets in millions of rows, it's hard to test if the logic works across those rows unless I add filter tiles that filter out data at specific points during the Data Flow build process. This can add complexity when adding many test cases at specific points. The Idea: It would be…
-
Magic ETL column parsing
Is there an easy way using Magic ETL to create new columns based on existing columns. For example I have an ID column and a Page Name column and want to make each ID and Page Name a net new column to link to other data in the dataset. (I'm using governance Page data) Any ideas here?