-
MySQL Recursion Performance/Speed Issues
Hello! I am looking for suggestions on how to improve the performance of my mysql dataflow. Currently I have a recursive dataflow built with a Google Analytics connector, and I'm using a concatenated key created by joining multiple columns together to delete and upsert new data from the historical dataset. I'm using the…
-
Can you prevent the MySQL connector from locking its source table while syncing?
I have a large table that takes a while to sync over to Domo through the MySQL connector. I currently schedule the sync to occur overnight because a table lock prevents other users from reading the source table. I would like to sync the table on demand during working hours though. Is there a way to instruct the MySQL…
-
Appending an update set to itself
Hi, I have a MySQL dataflow that is built from API reports from a vendors application. The idea is that we did a one time historical pull of the API as dataset 1. Then, the same API that only pulls 1 day of data and appends to the historical dataset as dataset 2. But, every once and a while it seems as if data is dropping…
-
access max.date from sql table
Hi. I have two input datasets in SQL Magic Transformation. One table called daily the other one estimated . Both tables have the same columns. I need to fetch the data from estimated table but only for the date that is later than max(`Date`) in table dail Data looks like this. Table daily Date Name Revenue 2021-08-01 A 10…
-
Workbench ODBC - Dynamic query/parameter
When we are establishing a new job in Domo Workbench of the type ODBC, we write the query in the box of Database Query Editor as in the image below. However the query we want to do should not be static and we would like to modify that query based on external triggers. For example, in the image, is it possible to pass a…
-
MySQL Connector to Read Only Some Tables in a Database rather than All Tables in a Database
We are using a MySQL connector to load data from our Google Cloud SQL servers into DOMO. From what I can tell, it is only possible to connect to a Database, and all the tables within that database become accessible via the connector. Any of the tables in our database can be chosen in this window (see the highlighted…
-
Beast mode to kill div0 errors
Hi, can anyone tell me why If my "A" code works, and my "B" CASE WHEN... THEN 0 ELSE 2 END code works, why can't I substitute code "A" for "2" in code B? I'm trying to kill divide by zero errors in a beast mode. --A SUM(IFNULL(`qty sold instock`,0))/SUM(IFNULL(`qty found`,0)) --B (CASE WHEN (IFNULL(`qty found`,0)) = 0 THEN…
-
How do I used a Create / Use / output table using a SQL transform SQL type / CREATE PROCEDURE?
I'm trying to just work out the basic syntax / method in DOMO SQL transform of: Create Stored Procedure (creates a result table after some manipulation of the data) Execute Stored Procedure (to get result table) Output Result table into DOMO for use in charts etc.. I'm trying to get this to work but I can't get the results…
-
Summing up filtred values based on criteria
Hey guys, I will try to explain my issue, I'm really loosing hair on this one, hope wil get feedback from you
-
Convert DATETIME (UTC) to specific timezone
Hello, Domosapiens! I have an interesting quandry. I have a data flow (using MagicETL - should I be using something else?) that I am trying to build and convert a date that my MySQL data connector is bringing over. The datetime column comes from an orders table and is called posted_date and it brings the data over as UTC…
-
SQL - join where a column is between a number range
Hello, I cannot for the life of me figure out why this "where" clause is giving me troubles, I have used this logic a thousand times with no problems. The problem is coming on my join of c to a. Specifically, it seems to happen with my "where c.result_code is greater or equal to 9.5 and c.result_code is less than or equal…
-
Join based on filter criteria
Table A (Completed Evaluations w/ dates & locations) Table B (Locations Universe, all available locations) Table A has all the same location columns as Table B. Table A also has completed dates and evaluation data, We want to show locations with completed evaluations for a user specified date period (i.e. using a date…
-
Is it possible to use while/do loops in MySQL in Domo Dataflows?
I have data that has varying rows of data for each identifier, from one row to 26. For each identifier, I have four different columns that change with the various rows. For each new identifier, I want to loop through the rows that follow that have the same identifier and build the row out with the unique values in these…
-
Business days between date function
I use the datediff for business days function in a number of mysql data flows and it works great. However, I'm getting some very strange results on the latest flow that I'm working on and I can't figure out what's going wrong. I have a start date which I'm looking to compare to the current date. However, the code I'm using…
-
How do i trim out an email address from a field with a string?
How do i trim out an email address from a field with a string? Example of Field: Yes, we accept this current pricing and would like to proceed with this order. Thank you, Bob Dole Lab Research Analyst Poss Lab—Dole University bob.dole@some.edu Thanks
-
Dividing in SQL
I currently have this code: categorizing some leads. Select `Year-Month` ,`Lead Source` ,`Product Line` ,`Product Models` ,`Country` ,`Early Stage No Movement` ,`Stage 0 to Early` ,`Early to Lost` ,`Early to Won` ,`Early to Late` ,`Late to Lost` ,`Late to Won` ,Sum(`Early to Lost`+`Early to Won`+`Early to Late`) AS 'Total…
-
Is it possible to do CTE hierarchical recursive query in MySQL?
I have a table with thousands of rows in which there is a relationship of child/parent between the rows. For each record I would like to have all the hierarchy related with that record. As an example, I have the following table and for the id=19 I would like to return all its related children, which are [20, 21, 22] I have…
-
MySQL Data Flows clarification: MySQL version & window functions (row_number)
I've neglected MySQL Data Flows because I'd passingly assumed that they were for MySQL-derived DataSets. It seems not, it looks like a MySQL DataFlow is a DataFlow that uses an embedded version of MySQL. Is this correct? I've seen mention of Window Functions in passing, and assumed the MySQL must be 8.0+, as that's when…
-
DOMO SQL MAX(date) not working
hello, hope someone could help on my SQL: I just created a simple SQL under DOMO MySQL to select some fields and the MIN and MAX of a date, like: SELECT `id`, `name`, min(`a_date`) as 'oldest date', max(`a_date`) as 'latest date' FROM`data_1` GROUP BY `id`, `name` but nothing is returned in the 2 date fields, original…
-
How can I create a new column with extracted numbers in SQL or ETL
I have a column called 'description' which can contain multiple elements. One of them is 'Order #1234567890' (or other digits). I want to create a new column that just extracts the numbers in SQL or Magic ETL (so that I can do Beast Modes etc. on it afterwards). How can I create this column? Numbers may exist in other…
-
Help identifying and isolating a date held within a string of text
Hi all, I'm hoping some creative minds out there can help with a business problem I am having. I am looking to create a Beast Mode field for expiry date, however the source of the expiry date is held within a string of text. Example: "Building agreement in place with John Smith - signed via docusign , EXPIRES 2020-04-28…
-
Mimic VLOOKUP based on Date Ranges
I'm looking for a way to merge two sets of data based on approximate matches. I have two datasets: one with all of the daily sales data for a customer based on their id number: idDateRevenueGross…
-
Multiple SQL Update Statements in Same Transform
I'm currently adding one Update Statement per one Transform process box/dataflow in the Domo MySQL tool. How would I combine them in the same process box/dataflow in Domo? Thank you. /* Update Value1*/ UPDATE `table1` SET `Title` = "My Updated Value1" WHERE `Title` = "My Original Value1" /* Update Value2 */ UPDATE `table1`…
-
Extract 1 row / few rows from big dataset (>100M rows)
When I try to extract the _BATCH_LAST_RUN_ from a MySQL dataset with 106M rows, the ETL takes 3h20min. Is there a way to extract only one row from the dataset. For the moment, I have to wait until the full 106M rows dataset is load in both Magic ETL and SQL.
-
Historical Database I inherited
Hi all. I'm dealing with CRM data, and have a snapshot of all of our data that is appended to a full historical daily database. This is done in a SQL transform, but I am completely unable to figure out why the input data is being appended to the output instead of clearing it. I am completely dumbfounded. I'm attaching…
-
sql dataflow turn off input dataset limit
In sql data flow can I turn off the input dataset loaded limit? cuurently it set at 500K. I have big tables where the first 500K rows are all the same date so if I try and do a select distict date, I get a single row in my preview. I have long, advanced, queries with multple changes and running the data flow for the final…