-
Export Magic ETL Code for External Version Control
In our current environment, we use an external repository (Bitbucket) to maintain version control and the ability to run detailed diffs before making changes to our SQL dataflows. It would be helpful to have a way to export either the code or some representation of the current state of a Magic ETL dataflow to be used in…
-
Group By Issue
I need assistance with identifying transactions that net out to zero in a large dataset. Each row in the dataset represents a unique transaction with its own ID. Objective: Identify pairs of transactions that meet the following conditions: Same client ID Same transaction type ID Same transaction date The sum of their…
-
Creating a Beastmode/ Dimension
I have a set of data that includes columns like " Facebook Engagements, Facebook Impressions, Twitter Engagements, Twitter Post Impressions, TikTok engagements, TikTok Impressions" how do I create a dimension or beastmode where you will be able to filter by platform, e.g.: Facebook, Twitter, TikTok.
-
Is there a way to aggregate the output using a FIXED function used in a CASE statement?
I'm a MajorDomo in a large retailer, and I'm working to rewrite our TY/LY Beast Modes to calculate off of a "Week Number in Epoch" column, rather than comparing against Fiscal Week as we move into a Week 53. I previously asked about writing a temp table in a Beast Mode (https://dojo.domo.com/main/discussion/comment/59532),…
-
Add ORDER BY to GROUP_CONCAT Function in Magic ETL v2
Currently, Magic ETL v2 supports the aggregate function GROUP_CONCAT in its Group By tile. While clauses inside the GROUP_CONCAT function like DISTINCT and SEPARATOR are available, the ORDER BY clause doesn't work and causes the tile to fail. SQL DataFlows currently support using the GROUP_CONCAT function with the ORDER BY…
-
Get MySQL on latest version
Currently, Domo's MySQL is on version 5.6, which is approaching end of support. There are also a number of commonly used features that people want to use in MySQL, but can't because it is still on version 5.6. Please upgrade to the latest version.
-
Beast Mode for "Views in the first 30 days"
Hi there, My team wants to create a beast mode that looks at total views in the first 30 days per asset since the video was published. For example, a video was published on March 1, 2024 and we want to know how many total views did it generate through March 30, 2024. We created a couple of sample beast modes that are…
-
Pivot/Group By - Make Multiple rows into one row and add columns
Hi Community - thanks as always for the consistent great help. I'm attempting to Group/Pivot/Join/Append (not sure exactly what the methodology will be) multiple rows of Patients into single rows with additional columns. Right now, each patient event is on it's own row. So, a patient seen on Monday and then also on Tuesday…
-
SQL To Magic ETL Issue
Domo's use of mySQL as an ETL is frustrating slow. I have a solution that runs in seconds when I duplicate it in MS SQL, but when applied in Domo it takes forever. I need to figure out how to do the following with tiles in Magic ETL. I have created an example using store locations as anonymized data. Assume I have a table…
-
GROUP_CONCAT function in Dataset View vs MySQL Dataflow
I have created a MySQL Dataflow where I was able to successfully use the GROUP_CONCAT function. It is preferred that I use a Dataset View in this circumstance since the underlying data is coming from AppDB and therefore updates every 15 minutes if there is new data. I have copied and pasted the exact query that is…
-
Need to extract all queries used in our SQL Server connectors.
We recently realized that someone in the past hard-coded database names — names which have since changed — in some of the SQL queries used in the SQL Server connectors. Unfortunately, we have hundreds of connectors, and opening up each of them manually to look for a problem will not be fun. To avoid doing that I want a way…
-
"Documentation Mode" in Magic ETL/SQL
A toggle next to "Try the new Magic ETL" would read "Documentation Mode" and would: Put an opaque film over the whole Magic ETL map Disallow changes to the tiles Enable the ability to draw and color-code sections of the ETL Be able to notate what each section is doing An additional item in the Save menu would be "Save and…
-
Compare MAX date with YOY: Month-to-Date (MTD) Comparison
Trying to create a sql statement in magic ETL to compare YOY: Month-to-Date (MTD) by MAX date. My current code from is: CASE WHEN (MONTH(MEMBERSHIP_INSTANCE_PURCHASE_DATE) = MONTH(CURDATE()) and YEAR(MEMBERSHIP_INSTANCE_PURCHASE_DATE) = YEAR(CURDATE()) and DAYOFMONTH(MEMBERSHIP_INSTANCE_PURCHASE_DATE)…
-
What is the problem with my beastmode?
I am trying to make an outlier flag that flags values 50% above of 50% below the budgeted, or daily goal mount. I made two threshold calculations(dailygoal / 2) & (dailygoal * 1.5). I keep getting an error message, but I am not sure what I am doing wrong. Any suggestions? Thanks, and my sql command is attached below. CASE…
-
UTC to PST conversion in ETL
Hi, I am trying to convert the "Date" from UTC to PST in the ETL. Currently, I created "Send Date PST" with the formula below. TIMESTAMP((convert_tz(`SendDate`, 'UTC', 'America/Los_Angeles'))) However, when I try to use it in the card and filter for the last 4 hours, my card is blank: It works when I do the same thing with…
-
lookup function in beastmode?
Hi all, I have a table that has these columns: loan number other loan number first principle balance hi type description 2nd mortgage amount is the field we are trying to create The logic is such: when hi type description = '1st mortgage' and other loan number is > 1 then i want to look up the first principle balance of…
-
Can I run a Stored Procedure to an external MS SQL and import resulting dataset?
I have large amounts of data stored in an external MS SQL database. Complicated queries are run via a stored procedure, and the resulting dataset is written to a table that I currently have connected to DOMO to produce client dashboards. I'd like to call the stored procedure from the DOMO data connection, have it run,…
-
How do I use window function date ranges in DOMO ETLs?
The short version, I need the following query to work somewhere in DOMO ETL: AVG(`Score`) OVER (PARTITION BY Company ORDER BY 'Date` RANGE BETWEEN INTERVAL '90' DAY PRECEDING AND INTERVAL '0' DAY FOLLOWING) More detail: I tried using group by but cannot use window functions, formulas but can't use aggregations, and rank…
-
Disable Views SQL Editor when it's been enabled
The SQL Editor in Views has proven to be invaluable when trying to fix other people's broken views. However, once the underlying SQL has been fixed I would like the ability to switch the view back to it's normal look and feel: most of my users don't know SQL and get freaked out when they see that big black box with the…
-
Help with SQL query
My first post so apologies if I have dropped this in the wrong forum. I have a slightly more complex dataflow than Magic ETL will handle and I am hoping I can manage this with SQL, however my SQL is a little rusty (read metal falling apart). The requirement is possibly quite common in that I need to measure how many…
-
MAGIC ETL/DATAFLOWS Q&A from Domopalooza
The product team enjoyed answering questions from the audience during the final session at Domopalooza. Below you will find the answers to all questions related to Magic ETL and Dataflows (including those that weren't mentioned on stage). Q: When are you going to upgrade the MySQL version in MySQL DataFlows? A: We do not…
-
Using LAG() OVER function to get difference in a Snapshot dataset
Hello! I am trying to get the right formula to calculate the difference in data within a table (same data APPENDED to create snapshots). Here is an example of a beast mode I have been playing with. I have unique data by Opportunity ID & Snapshot YearWeek in the rows summarized in this chart, I would like to take the 202413…
-
Different time zone
Hi! I'm trying to configure the time zone in ETL but my query is resulting in different times when the function calculates the difference, for the same column. ETL time zone function: Imported table from SQL Server: Result after time zone changes: The date range of the table is from Feb 24 to Mar 12. From Feb 24 to Mar 8…
-
Unable to Create Same Time vs Yr Ago
I'm trying to create a dynamic Comparison Value that adjusts the view based on Time Period Selection. I was able to create a Gauge Value that works, but am struggle with the Beast Mode that would allow the end user to view vs same time year ago value. I have the code below and have tried various adjustments, but keep…
-
Is it possible to batch edit source data?
I have a large dataset that needs some cleaning. We have appended to this dataset daily over several years and some of the data values have drifted over time as users have renamed what are essentially labels for different entities. If this were SQL, I could write an update statement and quickly replace the values in label…
-
Domo workbench - "attempting to open data source"
When a workbench job is executing, does anyone know what is happening when the preview window execution step says "attempting to open data source"? We will have a job that gets stuck on this step for several hours and it is unable to get past this step, then the query times out. The workbench job is executing a stored…
-
How do I get started with MySQL Dataflows?
Hello all, I have roughly two years experience with creating Magic ETLs, but no experience with MySQL dataflows. I'm seeking to experiment with MySQL just for the sake of experimentation. Background: I've written thousands of Case When Statements for Beast Modes and calculated fields, but have very little actual SQL…
-
Can use FIXED with SQL data
-
Aggregating Data for a Beastmode - Counting Survival Analysis
Hi there -- I have a dataset that has an individual record per employee that states if they are active or terminated and that gives their current tenure or the tenure at the time that they left the company. I'm trying to do a survival beastmode using a bar chart where I show 100% at tenure = 0, and then at tenure = 1, I…