-
Reduce ETL Processing Time
Hi Everyone. I'm looking for strategies to reduce the run time of Magic ETL 2 data flows. I'm working with several left joins in sequence on about 17 datasets of 1 million rows each. Beyond this, the ETL performs no other operations. I'm curious if anyone has experience with these options: Data fusion Adrenaline Redshift…
-
Division of Values
Hello Domo Ninjas - I'm trying to get a new value from a dataset, where I'm dividing 1 column by another. Its a strange way of measuring how much Sales is adding on Services to Product deals. I'm getting errors both in Beast Mode, when I try MOD(ProdSales,SvcsSales ) And in DataFlows when I add a Calculator, attach it to…
-
Python Tile
Tring to split the values in a column into multiple rows using explode and I keep getting an error. I am not too familiar with the python tiles... The value in my row will be "A<br>B" and I want them to appear as two separate rows, one with A and one with B. Getting error: "00:00:01.817 domomagic: Version 0.3 00:00:01.819…
-
beast mode for specific date range
CASE WHEN `end_date__c` >= '1/01/2021' and `end_date__c` <= '12/31/2021' then `2021` else 0 end getting an error message Calculation Error : A column in this calculation did not exist.
-
Creating a Link Field in Domo
Hi All, I was trying to have a hyperlink embedded inside a Domo Table/MegaTable and I used the following method. CONCAT('<a href="https://na132.salesforce.com/', `donation_link`, '" target="_blank">', 'Donation Link', '</a>') Now this is working perfectly on Domo but one major problem I'm facing is when I export the data,…
-
Case Syntax
I am having difficulty understanding the case syntax while using magic ETL. In the current Example, I have a list of properties and coded them to display a text column of the region for each specific property. Unfortunately, there is no address line to be able to parse and use to make the regions so I'm hard-coding the…
-
How to remove columns with Null values?
Hi all, I have a dataset with 100+ columns. There are many columns with null values. I would like to remove all those columns without manually selecting those columns using the Select Columns tile on Magic ETL. Is there a way to do this?
-
Is this a bug or user error
Hi, Noticed some odd behaviour with a simple dataset I am pulling in from our db. From the column named Area onwards the data doesn't align to the column headers. e.g the AREA column should 1420 etc. It all needs shifting left. I have a feeling as I am selecting from two table and both have an ID column it can't work it…
-
How to represent how many tickets opened by each individual user?
Hi, I am trying to figure out how to pull 2 datasets together correctly. So, one dataset is Users and the other is Tickets. I want to connect Tickets to Users so I can have a single integer connected to a single user to show many tickets a specific individual has opened. Example: User_Name Number_Of_Tickets_Opened…
-
Only show unique values of a column in table
Is there a way, in analyzer or ETL, where we can only display one row for each unique value of a column corresponding to a key column? For example, I would want this: ID Num 1 4 1 4 1 5 2 4 2 5 2 6 3 6 3 7 3 7 to become this: ID Num 1 4 1 5 2 4 2 5 2 6 3 6 3 7
-
Dashboard performance problem
Hi guys, I have a view that once built has 112k rows. It is built from 7 datasets. Am I right in thinking once the view is built then it doesn't need to go back to the datasets and perform joins etc? I am seeing some very poor performance on the dashboard built from this view but the number of rows is quite low. The…
-
Why would I use a DataFusion instead of a Dataset View? Will DataFusions be deprecated?
If a DataFusion has limitations on what can be edited after it's created, why would I use one instead of a Dataset View? When making certain changes to a DataFusion, you get the prompt that it is "no longer editable as a DataFusion", and must be saved as a Dataset View. Since Dataset Views are a lot more powerful (but…
-
Error filtering Data
Hi, I'm using a filter on a Dataset I which I need that a column A to be different to FALSE and another column, B, equals to FALSE, but it is not doing the filter correctly
-
Recursive ETL
Hi guys, I am pulling data from from our db looking like Date|Name|Value DATE and NAME is the unique key I sort of understand the recursive ETL and it will append and replace old data with new data but I am missing the point slightly. Should the new data do a complete pull from the db or a subset? I am looking to just get…
-
ETL run complete, but output datasets still not reloaded
I notice with an ETL I have (with a large amount of data), it takes a while for the output datasets to refresh after each run. For example, the ETL completed over 2 hours ago, and yet the output dataset has still not be updated... Is this a common issue?
-
How to Deal with Multiple Date Fields
I have a perplexing issue I'm trying to solve. I have data coming from several different data sources (all parts of Zendesk), each of which each represent a different kind of user interaction. For example: Email, Chat, Phone Calls These are all related to a master "Tickets" table, so they can be joined based on a Ticket…
-
Trying to create a nested Case statement with multiple conditions
basically, I need to first attest that it is in the current quarter, and then I need to look at the column for confidence whether it is A or B, if it is blank, I look at column trust whether it is A or B, if it is also blank, I look at the status column if it states committed then 'True' else 'false' I am able to do the…
-
how to capture the current quarter using beastmode
Hi Domo Masters - so, when we want to capture the current date what we do is we use>>> Case When 'Date'=Curdate() then 'True' else 'False' end is there a way we can capture the current quarter? Thanks!!!
-
How would I insert a row which is the variance between two other rows?
-
Is there a reliable way to make Magic ETL intentionally fail?
I have an ETL that uses, among other inputs, a Webform that isn't always maintained perfectly. One recent problem involved two rows for the same identifier, with different text in the description column. What I'd like to do is make the ETL fail if something like this happens. I tried doing a Group By on the identifier…
-
Identifying "Last Week' when current week is 0 or 1
I'm using the case statement below to identify dates from "Last Week". It works fine but I will run into a problem in January as we move to week 0 or 1 for current week, and last week could be 52 or 53 (see screen grab). Any suggestions for approaching this? CASE WHEN WEEK(`Date`) = (WEEK(CURRENT_DATE())-1) THEN 'Last…
-
Add only new records
Hello there. I have a Jira connector set up that pulls users (Name, Email, Jira ID). However, it only pulls currently active. One of the dashboards I am creating needs this data, but we also need to keep users who leave. My thought was to export the data today, then import as a data file. Then, starting tomorrow, append…
-
Period over period on one row
Hi, For this particular use case I have data like below Date | Value I need to transform this to Date | Value | Date LY | Value LY I could join the source data up like this to itself when pulling the data into domo via SQL but would rather do this in domo. I attempted to use the period over period dimension stuff made by…
-
How to fix 'Cannot Save' error in Scheduling?
I am working with the domo writeback to gsheets. It is scheduled to run each day at a specific time which I set up when I first set up the writeback into my ETL. Now I need to change that schedule so I go to the dataset details then the 'Settings' and 'Scheduling' and make a change. However, when I click SAVE - nothing…
-
single date filter for multiple columns
Hello team, columns A and B are the occurrences in date format of two separate events. I have three columns. People, Date A and Date B. I'd like to be able to have a single date filter and out put the count of A and count of B for each person in that date timeframe. I appreciate any suggestions!
-
Freeze Header in Pivot Table (chart types)
Hi Team, Do we have option to freeze header in pivottable (chart table) as i could not find in chart properties pls suggest
-
Is there way to extract week of quarter from a date column?
The default week() function extracts the week number from the start of the year and runs 1 to 53 or 54. I need to show week number within the quarter, running 1 to 13 or 14 within each qtr. Is there a way to do this using beast mode or using the formula tile in Magic ETL ? Thanks!
-
Automatically update the column value by current month and year in Magic ETL
hi guys, I got a table on below and some columns using month/year as column name. i would like to make an automatically Magic ETL and set a logic condition like below: if the date(column name) < current month and year (let say 08/2022) then all value would be clear as 0 value under the column (01/2022, 02/2022,…
-
Limit on ranking tiles
I added 20 ranking tiles to me Magic ETL, but it fails stating out of memory. I removed 4 of them, and now it runs fine. Is there a limit to the number of ranking tiles you can use? The input is only 2 million records.
-
Writeback Gsheets
Hello! I am new to Domo and setting up a write back to a google sheet. Ideally, I'd like it to write to specific cells within a sheet, as we previously had set to do in Alteryx. Has anyone done this? It looks like you have to write to a sheet and it will all be replaced- is that true?