-
Creating a rolling standard deviation within magic ETL
I'd like to create rolling standard deviation within Magic ETL that uses the previous 90 rows (or previous 90 days) as the window. I was able to do this within MySQL before, however, I'd like to do this within Magic ETL. For example if I have 100 rows of data each row should reference the previous 90 rows as the sample…
-
Transforming Support Staff Name Column
Hello, ETL question. For context, I am creating a dashboard for self-service reports on customer satisfaction surveys. Typically I would create a drop down filter card to 'Filter by: Owner', but in this case the owner column contains multiple names: IE: Owner Joe Smith, Bob Smith Cate Smith Cindy Smith, Sam Smith Does…
-
NEW Domo Data Science Resources Guide (help w/ Jupyter, scripting tiles, data science tiles, AutoML)
Hi all, I'm a data scientist at Domo on the Data Science Professional Services Team. We have a NEW Domo Data Science Resources Guide. The guide includes a list of all the help resources Domo has created related to data science products (Jupyter Workspaces, Magic ETL R/Python scripting tiles, Magic ETL data science tiles, &…
-
Joining 3 different datasets to match zip codes
Hi, I have 3 datasets each with a column containing zip codes. I want to use ETL to create a new dataset with 3 columns, all containing the zip codes from each input lined up. Input: Dataset 1 Dataset 2 Dataset 3 1 2 1 2 3 3 3 5 4 4 6 5 Output: D1 D2 D3 1 1 2 2 3 3 3 4 4 5 5 6 Thank you
-
Creating an Artificial downtime for maintenance for only week and work hours
I am trying to calculate downtime within DOMO. The downtime we have currenlty coming from the other system does not put in the factors of weekends and holidays as well as after hours. How can I calculate a correct amount of time between the starttime to endtime while only subtracting within the window. For example if A…
-
Is it possible to make a HTTP request using the Python Script tile of Magic ETL?
We would like to use data of a dataset in the body of a POST request and we were wondering if the Python Script tile in Magic ETL would work for that. We have analyzed but it does not seem to have libraries for that. We have this solution to export the dataset and make the request in a Python script in a Virtual Machine…
-
How do I create a calculated column based off information from another dataset?
I have two datasets: 1- contains the rep name and the number of sales they closed for each date. 2 - contains the rep name and the number of calls they made for each date. In a report, I'm summing up the total number of calls made each week by all reps and dividing it by the number of setters for that week. A rep is…
-
Dataset Email Connector
I have a dataset that updates via email connecotr. When the data is sent to the connector the dates turn into integers. Is there a way to fix this? Thanks
-
Is it possible to create a table showing appointment availability in Domo?
I have a list of appointments scheduled with their start and end times, I've created a pivot table showing all appointment start times as the row and closers are broken out into columns. Through an ETL, i'm able to count the number of appointments scheduled at that start time but what I'd really like to do is mark off each…
-
Please help me write this filter formula:
How can I write a filter formula where I want to exclude everything that says 'INTERCOMPANY' from 'CUSTOMER TYPE' Column except this one scenario where we keep 'INTERCOMPANY' where there shows 'X' in 'COMPANY' Column. Similarly, how to write a filter formula where I can exclude everything that says 'ENDUSER' from 'CUSTOMER…
-
Add Hints to Deduplicate Tile
When I ingest the customer table from our POS, for example, and compare individual customer records to the last ingestion, I want to keep the older of the two records if selected fields show the records to be duplicates otherwise. The Deduplicate tile is the obvious choice to use, but appears to choose at random which…
-
Showing some values based on SUM, other values based on the most recent date available for the week?
I am working with a dataset that pulls in sales and inventory data for items on a daily basis. In data analyzer, I created a table with the data grouped by week. After grouping by week, most of the fields in my card (i.e. Revenue, Units Sold, etc.) are aggregated by SUM because I would like to know the sum of all of the…
-
Split columns based on number of characters using regex
Hi all, I need to split a column that contains both a client name and number into 2 separate columns. Some client names themselves contain whitespace, so I cannot split on whitespace and am looking at Regex, though it's been a while since I've used it. All the client numbers are 5 digits long, though they are randomly…
-
Use Empty csv in ETL
Greetings! I am sending csv reports to box and using the Advanced box connector to retrieve the files and add them to a magic ETL. The reports from the current and previous years work great. I would like to set up this process to run through 2026 so I am sending empty reports for 2024-2026. They currently populate box with…
-
R and Python for determing dataframe equality in ETL
Greetings Domo Community, I have currently been refactoring Magic ETL tiles and have been attempting to use Python and R scripts to test for equality before finalizing the refactored tile components. Using both approaches with Python and R I have had significant difficulties in completing this task, which I will outline…
-
What are the est practices to maximize speed and minimize data storage when updating a large dataset
What are the est practices to maximize speed and minimize data storage when updating a large dataset? I have an example but any tips on performance I'm willing to hear. We have a dataset that consists of an initial load (~ 1 million records) and a daily* update of ~ 20k records (and growing). Within the first year we…
-
SQL in ETL
Hi All, I'm currently trying to recreate a MySQL flow in Domo to ETL. One of the first things we are doing in a table is taking out extra characters from a column to create a new trade_id Here is how we are doing it. when I go to add the formula tile and copy and paste this syntax, ETL is saying it doesnt recognize the…
-
Filtering Records Based on Aggregate Criteria
I've been trying to do the following but can't figure out the best way to do it. I have a table that looks basically like this: user_id|ticket_id|inquiry_type I want to filter out rows for a specific user_id when ALL of the rows for that user_id have a value of "false_inquiry" in the inquiry_type field. But if the user has…
-
I wanted to rename few items in a column based on this campaign, in the ETL
Hi, I wanted to rename App to Web for this campaign, and I tried using a formula to achieve this in the ETL. Here is my formula CASE when campaign = 'CM1' then 'Web' else channel END But this is not giving me the expected output. Could anyone please help me with this? I actually wanted to achieve this in ETL only, not in…
-
First Non-Null Value from Column in Formula Tile
Greetings DOMO, Does anyone know how to find the first non-null value of a column in a formula tile. Tried using Coalesce along with a few tricks and couldn't get anything to work. All help would be appreciated. Cheers, Will
-
Creating a Pass/Fail Test in Magic ETL
I am trying to create a pass/fail test in magic ETL. There are four test it needs to go through to pass or fail. Once a row is listed as fail I would want all the rows matching that submission ID to fail as well how would I go about this or what is the correct formula to use? for example It failed the first test but passed…
-
Cant edit the ETL, beside I'm the owner
Im having some issues with my dataflow,i cant edit the ETL beside im the owner, i dont now what i have to do to solve the issue
-
Success Rate %
To work out the success rate I need to (a) count number of rows where 'Status' column has 'Application Granted' and divide this by (b) count number of rows where there is a value in 'Determination Date' column. A / B = Success rate Any help would be much appreciated, cheers
-
Question about using recursive reports but only reclusive until post month
I am working on setting up some recursive data structures to capture the data I need for this instance it charges in a period. We can call this resident's charges. Charges are accumulated until a post date which is most of the time the 21's day of the month with some exceptions. I have a small web form that lists these…
-
Daily Dataset Update via Python fails on first run each day
I am using the Domo Dimensions Calendar as an input to a Python script that updates an dataset of the next 365 days as columns |2023-01-27 | 2023-01-28 | 2023-01-29 | 2023-01-30 | ........ | 2024-01-27 So, when the script runs tomorrow the first column will be 2023-01-28, and so on. It works, to a point. The first daily…
-
How do i fill in the date gaps?
I have a start date and an end date. How do i have those dates in between appear? (ETLs/Codes)
-
Lead Function in Rank and Window Returning Self Referencing Value
For some reason I am getting a self referencing value rather than a NULL. In this example, I was expecting the Next Row Column to be NULL for the last row. Instead, it seems to be self referencing the student enrollment # column. The first 5 rows in the example are correct. Is this the default behavior of this…