-
Magic ETL v1 Update
We wanted to share a planning update and a correction to an earlier communication that was made about the end-of-life plan for Magic ETL v1 dataflows as part of Domo’s Summer 2022 product release. We continue to see strong momentum with the adoption of Magic ETL v2 dataflows. Since the general availability of Magic ETL v2…
-
Estimate processing time of each step in Magic ETL v2
When creating any ETL the user interface is unable to alert you the impact of the change will make on the dataflow. If I create a transformation that is not optimized I should be alerted this will increase process time. It would be helpful to have a time estimation in Magic ETL itself as to how long each step will take…
-
What does the "Use Raw Numbers" setting for email connectors do?
Recently, we ran into an issue with one of our email connector datasets where a "Currency" column was being formatted as a string which was causing issues down the line in other dataflows. We're not sure how the problem initially started, but we found that enabling the "Use Raw Numbers" setting seemed to fix it and…
-
Global Formulas in ETLs
I would like to have a way to create complex formulas, save them (similar to the Beast Mode Manager) , and then have them available for use in ETLs; when an ETL that contains one of these formulas is executed the current version of the formula would always be used. This would have two use cases (for me): If there is a need…
-
Ideas for new features in Domo from AMRO
Hi! We came up with some suggestions for new features in Domo in one of our recent internal discussions, that we would like to share with Dojo members. We think these enhancements could be useful not only to us but other Domo clients too. (if the image is not clear please see the attached excel instead) Really looking…
-
Option to align Magic ETL functions to a grid
I'd like to be able to have my ETL functions precisely aligned in the Magic ETL editor so that they're easier to read quickly. When I'm creating an ETL, I tend to place functions where it makes the most sense to me, but if a function is a little bit off-centre it's not obvious which function it's supposed to be next to…
-
Create a SQL tile within Magic ETL
It would be great to have a SQL tile within Magic ETL where users can write SQL much like what users can do with the Python tile. This would open up the ability to do conditional joins and looping in Magic ETL. It would also remove some of the dependencies on MySQL, Redshift dataflows which can be very slow to run.
-
Top 5 Selections within 7 day Rolling Period
I'm creating a dashboard to track complaints filed against a facility. Each record in my dataset is assigned to a unique ID. Each unique record displays 1 "topic" they selected. The "topic" is the reason for their complaint. I need to find the Top 5 Topics selected on each ROLLING 7 day period. So today's 7 day period…
-
MetaData for datasets in Magic ETL
It'd be nice to have some basic metadata like last updated, row count etc on the datasets to better align data based on the dates or to do validation to check against missing data
-
Breaking data per month viewed per week
Hi DOMO - Good Morning! we have a data that shows per week data per resource. and we only have 2 date columns which starts from Sunday and ends on a Saturday. the total hours, and daily hours have all been already grouped by using magic etl.…
-
Add a Link to Input Dataset Details in MAGIC UI (Similar to Lineage "VIEW" Button)
There are many times when users are in an ETL troubleshooting, and need to open one of the input ETLs for further investigation. Currently there is no available link in MAGIC that will take you to your input dataset's details. Something similar to lineage to "VIEW" the dataset, would be very useful and save quite a few…
-
How do I insert a row which is the variance between two other rows?
I have an ETL output table with two rows (highlighted in green) and I would like to add another row (highlighted yellow) which is the variance between the two rowa , how can I achieve this? I am transposing this into a table card and would like to get something like this
-
Merging Legacy and New POS Dataset
Hello, Experts! I am reaching out in hopes that I get some guidance on the best approach for building out an ETL. Our company is undergoing a point of sale transition and things are going well. We currently have legacy data in one dataset and new data flowing into Domo separately. My CEO is wanting to see week by week…
-
Option to manually run Magic ETL v2 without optimization
I love that ETL v2 allows automatic query optimization because it significantly cuts down the run time of our ETL pipeline. However I have run into some issues with some rows not being processed when rows get appended to the input dataset while the dataflow is running. The next time I run the dataflow, the ETL optimization…
-
Revert Data Set
Hi - I would appreciate any assistance someone can offer. I was working with an ETL and accidentally filtered too many rows of my data set. Now some of my important data is lost from the set. I need to revert to an earlier version of the data set; is there an easy way to do that?
-
Links to Input/Output Datasets in Magic ETL Editor
Oftentimes I find myself having to open a new tab to navigate to the various input and output datasets when in the editing canvas for a Magic ETL. It would be nice if there were a link that would open the dataset in a new tab somewhere on the configuration dialog that appears after selecting the tile.
-
Magic ETL - copy/paste JSON definition to clipboard
During the Technical User Group kickoff call, @john_stevens dropped some knowledge on us that just blew my mind. As seen in the gif below, you can copy Magic ETL tiles to the clipboard, and then paste into a text editor and it will give you the JSON definition of those tiles. That definition file can then be edited and…
-
Disable/Hide Tiles
Sometimes when in development I have a need to hide/disable a tile or group of tiles that I am working on but have a need to run the flow in order to check other things but the flow won't run until all tiles are configured correctly. Sometimes I don't want to complete the tile (maybe it is having errors) and I need to…
-
Primary Key/Index Magic 2.0 Tile Failures
Hello! It would be great if there was some sort of notification/error on Primary Key/Primary Indexes in Magic 2.0, it's a great unintentional feature on MySQL dataflows and helps greatly with data integrity.
-
What Magic ETL features are available to me?
Justin Millheim, from Domo product, highlights how the new Magic ETL is smarter, faster, and easier for all. Read up on the power of Magic HERE.
-
Allow Magic ETL to evaluate formulas from Webforms
in magic ETL you have group by tile. and it allows formulas if you type the below formula by hand it evaluates. if you save the formula in a table and bring the value in the formula window it evaluates as string text and not formula
-
New Data Privacy Solution - Beta Testers Wanted
Domo has partnered with Anonomatic (Anonomatic | Protecting PII for Data Privacy and Compliance) to enable Domo customers to combine, aggregate or mask anonymous data at the individual level with no risk of loss or exposure of PII. With the PII Vault and Anonomatic's plugins for Domo Workbench Workbench can now completely…
-
Common Beast Mode & ETL Questions
Once you are logged into the Help Center, you can move seamlessly between Domo University Training, Knowledge Base, Community and Support (using the head navigation menu) . Knowledge Base articles are a great resource to answer many general questions. KB articles answering the most common Beast Mode/ETL questions: * Beast…
-
Optimizing Domo Dataflows
* If you are struggling with long run times * Join big datasets at Domo Fusion speed and use them in ETL * Consistent failure of ETL after mulitple hours * Want to work on a subset of a big dataset * Create Views in Domo