-
Renaming Columns and NOT breaking cards
I am barely getting started with the vast DOMO world so forgive me if this is an obvious thing. I was recently creating a dataflow and some cards from that dataflow and decided to test something out. I created the card using a column from that dataflow and then proceeded to change the name of that column in the dataflow.…
-
ETL calculation to work out hours taken from a start and finish timestamp
Hi all and happy Monday I have some data i am pulling in via a SQL workbench that gives us a time clocked onto a job and another column for clocked off the job. The data is in a the format 2022-12-23T14:27:20. So i am trying to generate a calculated column that gives me the hours taken per job, for example: Clock on =…
-
Lag a pre-existing column?
Hi there, I'm wondering if it's possible (with Magic ETL or beast mode) to creation functions (like rank and window) that can lag value from Column 1 to Column 2, where both columns already exist. Full context: We have 3 columns. Monthly total, Last month, Year to date. I'm trying to generate a new YTD total every month by…
-
How do i fill in rows of data with previous row info?
This… into this via magic etl
-
When alter columns can't change column type, what else can I try?
-
Joining row data
Hi, I'm trying to combine several row data that have a similar dimension. For instance, i want to aggregate all of the lists_name's into one row next to 2024 Collection - Launch #4. so turn this… into this…
-
Trying to convert Month of the Year into Date with Magic ETL
Basically the title. I am using a dataset that pulls Month of the Year instead of Date, as the User count with the Date metric isn't accurate. However I have run into issues trying to convert Month of the Year into a date format. Here is the original format: As you can see, each month is numbered from 1-12. I used Value…
-
Converting to Integer
Hi All, In my ETL I am loading 2 columns for Credit & Debit, as part of my ETL I want to do Credit-Debit to get a column for amount however the data being loaded is recognising the Credit & Debit as text. I've tried to use the alter columns tile in my ETL to convert to an integer however it doesn't appear to be working.…
-
Turn on/off Magic ETL tiles
It would be really helpful to have the ability to turn on/off Magic ETL tiles. This is the equivalent of commenting out lines in a SQL dataflow so they don't execute when the dataflow runs but the effort in that section of the ETL is not lost and can easily be re-added.
-
Keep Columns After Using Group By Tile in ETL
I haven't played around with the group by tile yet so this might be a very simple answer I overlooked. But why do all of my columns disappear and leave only the columns I identified in the group by tile from my data after I use this function? I know I could join the data back in but I was assuming I was using it wrong.…
-
Run Recursive Dataflow only when new data comes
I am trying to create a recursive dataflow which should run only when new data comes. Here are the conditions for that, We are suppose to get weekly data in our CSV connector every Monday. We have set out recursive dataflow to run on Wednesday. We use week number as our constraint column. But sometimes, we get data late on…
-
SQL Query against dataset
Hi, I am wondering if anyone has ever had a ask for a way to just write sql against a dataset, or join to datasets. I know we have redshift, but this would be more like a SQL IDE you would use in a relational database. I know its kinda an odd question, but we have some users who prefer sql vs magic etl. I have seen the AI…
-
Date Conversion
I need a formula for taking just the month name from this format - Thu, 29 Feb 2024 11:59 PM. I need it in a date formatted column though. I can take the Month Name using MONTHNAME('my date column') but i cant get the column to be date. Its always text. Any advice? Thanks
-
Required Role Level for Reverting Dataset History
Hello, Domo Community! I'm in the process of delegating dataset management tasks and need clarity on permission levels. Specifically, I want to understand the minimum role level required for a user to access the history of a dataset and use the "revert to this point" feature. I've developed some reports and plan to allow…
-
No Idea why I can't get string to datetime
Input into formula tool is 2019-01-02 07:30:00 AM, formula is STR_TO_DATE(TimeIn1,'%Y-%m-%d %h:%i:%S %p'). Validate formula checks out, but error is Failed to parse date/time: Error at or near character 11 in string /2019-01-15 7:30:00 AM
-
Effective Dating
I want to capture appointment differential data and report back using effective dating. So that if I want a snapshot of a specific date, I'm pulling the most recent changes up to that moment and ignoring the rest. I've done this plenty in SQL, but looking for a solution using Domo ETL. I don't want to re-invent the wheel.…
-
Creating A Date Field
Hi Domo Community, How would I go about creating a usable date field from two columns I have? One column is the year, and the other is the month. How could I create a date field from those two columns? For example, 2/1/2024 from a column that has February and a column that has 2024. Thanks!
-
using Domo API and partition
Currently i want to append data using the API append method. However, i also want to update the last 2 days 2 a dataset on a cron job so that i do not miss a day. I know partitioning would only keep the unique record. Is it best to use recursion or partitioning for this?
-
Table Subtotaling
Having an issue when trying to subtotal the time columns. I want to be able to see the total off all the times rather than the count of each row? etg. 00:00:20 + 00:11:57+ 00:05:07… I moved my beast mode into ETL formula to try and get the field to work, but I cant get anything besides 'text' field to work.
-
pivoting data
Hi, I have data in this format: Date Island Count 2021-01-02 Aruba 4 2021-02-01 Curacao 9 2021-03-01 Curacao 10 I would like the data to be formatted this way: Island 2021-01-02 2021-02-01 Aruba 4 7 Curacao 9 10 This format is for a table view
-
Group By "Concat Distinct" Now Live!
I wanted to make a quick post to let you know about an update we made to the Group By tile in Magic. In your instances, you should now see the ability to choose a new options when defining how a column should be aggregated in the Group By tile: Combine distinct strings separated by , This allows you to create an aggregate…
-
Marking Duplicates So I Can Filter Them Out
Good afternoon, I am trying to mark rows that match up with each other as duplicates so that I can filter them out and only have the truly unique records left. Example So after I mark and filter the only record left will be the third one that doesn't have a match. What is the best way to do this? Thank you in advance
-
Combining two datasets based on two potential fields
Hi, I have two datasets. One has pacing data, the other has monthly data. All rows have unique IDs, however the pacing data may have either an ID from the old system (legacy ID) or the new system (new ID). Pacing: ID 1 2 3 4 11 Monthly: New ID Legacy ID 10 1 11 12 13 2 14 3 15 How would I go about joining these two…
-
Flag percent of change when it goes negative
Hello, as the title says I am trying to figure out a beast mode or add an additional column in a view/etl to flag a member when they logged in fewer times this current month compared to the previous month. I manually upload the month's numbers at the end of the month so we are measuring trends and wanting to reach out to…
-
Getting the Avg Days, Avg Hours, Avg Minutes
Hello. May I ask for your help in getting the average days or average hours or average minutes between 2 columns of date + timestamp data? The thing is, the average could be 'days', 'hours' or 'minutes', depending on the values of the 2 data columns, so we want to show the output similar to a timestamp format to be…
-
Multiple singe day events grouped as single consecutive day events
I am trying to figure out a way, in Magic ETL, to take multiple single day events and group them when there is break in consecutive days. Example, if the results show the 1st, 2nd, 3rd, 5th, 6th, 9th, 10th and 11th, I need three results, not 8. I want to see begin and end dates of 1st-3rd, 5th-6th, and 9th-11th. Any…
-
Magic ETL - Sum of values in a column
In my dataset i have a column "A" and there are numbers in that which represent spend. I want to create a new column in which i want sum of all values in A to be available in the new column in all rows. Eg. If sum of all values in column A is 125, and I have 10 rows, then in the new column "B" I want 125 in all 10 rows and…
-
Transforming an array of custom fields
I have a dataset currently flowing in from MongoDB which is essentially populated based on custom fields that are optionally set within the source. Each element in the array has the name and value of the custom field (ie. customField<0-N>_fieldName and customField<0-N>_fieldValue). The issue is that it's not always the…