-
Collapse the bottom section of the Formula Editor window to gain more room in the actual editor
In the Magic ETL Formula Editor window, I would estimate that 95% of the time I don't need any of the bottom three sections: Columns, Functions, and Function Descriptions. With them in place (highlighted in red), and the new AI prompt box which appeared today (highlighted in green), I am only able to see four lines in the…
-
Comment out tiles in MagicETL
When building complex ETLs it would be handy to be able to "comment out" tiles so they are ignored for execution. For bonus points, I'd like to be able to have an unterminated chain of commented-out tiles not block the ETL's execution.
-
Magic ETL Column Search Improvements
The new Column Search feature is a godsend. But … it could be better with two modifications: Add a Match String checkbox to limit the search to match the text string exactly. I was searching for the source of a field in a very large ETL. It turned out that the name of the one I wanted (countAsCar, for example) is included…
-
API Log in DomoStats
We want to do an audit of datasets accessed via API calls, as well as the clients using those calls, and I was amazed that this isn't logged as part of DomoStats (or the deprecated (?) Domo Governance datasets). I am recommending that this be added either through DomoStats or some other mechanism.
-
Move output dataset from one ETL to another
I'm writing a new version of the ETL that generates our Employee Directory. The existing output dataset from the existing ETL feeds dozens of other ETLs, hundreds of cards, and quite a few external systems via either the SFTP connector or directly through API calls. When I've got my new version all set I'm going to have to…
-
View older ETL version without making that version the active version
I would like to be able to view older versions of ETLs without needing to make them active first. The way I envision it you would go to the Versions tab of an existing ETL and see a new menu item when you click on a version's ellipsis: View Version. Choosing this would open up that version of the ETL in read-only mode,…
-
Need to extract all queries used in our SQL Server connectors.
We recently realized that someone in the past hard-coded database names — names which have since changed — in some of the SQL queries used in the SQL Server connectors. Unfortunately, we have hundreds of connectors, and opening up each of them manually to look for a problem will not be fun. To avoid doing that I want a way…
-
Collapse selected branches in Lineage
I would like to have the ability to collapse selected input and output branches in Lineage. This would help declutter the screen when tracing datasets and ETLs, especially when dealing with recursive ETLs that put two or more copies of everything downstream on the screen.
-
Bargraph for Employees/Hour when I only have start and stop times
This will probably be obvious in retrospect, but I cannot figure out how to generate a chart based on the data I have. I have data in the following format: Name Store Date TimeIn TimeOut Alice 0001 1/5/2024 6:00 12:00 Bob 0001 1/5/2024 7:00 11:00 Charlie 0001 1/5/2024 7:00 9:00 Denise 0001 1/5/2024 8:00 12:00 What I need…
-
Disable Views SQL Editor when it's been enabled
The SQL Editor in Views has proven to be invaluable when trying to fix other people's broken views. However, once the underlying SQL has been fixed I would like the ability to switch the view back to it's normal look and feel: most of my users don't know SQL and get freaked out when they see that big black box with the…
-
Need Rank to update in non-standard (?) way
I've got customer records with customer GUIDs, record dates, and member status. If the data for a specific customer looks like this: Date Status 1/1/2023 Active 2/1/2023 Active 3/1/2023 Inactive 4/1/2023 Inactive 5/1/2023 Active 6/1/2023 Active 7/1/2023 Active I want to get a dense ranking that groups the status together,…
-
Assign colors to tiles
I would like to be assign colors to tiles: this would make troubleshooting and code reviews much easier. A stretch goal would be to add setting the color of tiles to the options when you select more than one tile in addition to Delete, Duplicate, and Copy To Clipboard. Using this to visually indicate functional sections of…
-
How to disable SQL Editor on a View once it's been enabled?
I enabled the new SQL Editor on one of my views this morning to troubleshoot an issue: it's a wonderful tool, and helped me solve a very bizarre problem. Unfortunately, the editor takes up a lot of screen real estate, so I would like to disable it and return to the normal form of the view now that it's no longer needed.…
-
Amazon S3 Assumerole Advanced v2 Issues
We pull data from S3 using the S3 Assumerole Advanced v2 connector, and I'm having problems with it. There are three update methods available with this connector: Replace, Append, and Merge. We're bringing in employee data. Here's the problems with the three methods: I would prefer to use Merge, but when I choose it it…
-
Displaying up and down periods over time in a chart
We are tracking internet down time at our stores. Basically every 15 minutes we receive a list of all stores that are currently up. I then process that and for every store that was missing in the list I store a record in a dataset with the store and a timestamp. We need to show over a 24 hour time period what stores were…
-
Give Schema Management Toolkit the ability to set a default value when adding a new column
When you add a new column — via Schema Management in the toolkit — to a dataset that is either partitioned or updated by appending, it would be nice to be able to set a default value for the column so you don't have to go through contortions to update the older records.
-
Change API Scope
While looking into API credentials we noticed that some of the credentials were given scopes they don't need. Unfortunately, according to support it's not possible to remove, say, the User scope from an existing API client. I am recommending that a mechanism for altering the scope of an API client be created.
-
Reassign API Credentials
We wish to be able to reassign API credentials when, for example, one of our vendors has completed development and turned their project over to us for maintenance.
-
Force Pie Chart to show data for only most recent day of date range
I have a dataset that has the following columns: Date, Store, Plan, Total. My users want a pie chart that shows the total for each plan type on the last day of whatever date range the filters set, i.e.: if today is the 24th and the filter is set to month to date, I want only the values for the 24th. Unfortunately, no…
-
Help with Beast Mode Formula
I need help doing a complex sum in a beast mode, as when I do it I either get an error or a totally wrong number. The formula I was given reduces to A/(A+B-C), and sums across the entire data set for whatever date range the user chooses. Each of the letter values will be either a zero or one for a given record based on…
-
Need to see which connectors are currently connecting
I need a way to see which connectors are currently executing. Ultimately, I'd like to have a card on my error dashboard showing which connectors are running, how long they've been running, and possibly the average execution time so we can know if something's out of whack. Is any of this information surfaced in DomoStats or…
-
Get value for first day of the month
I need to be able to create a beast mode that does the following: for any given month sum up columns A, B, and C, then get the value D for the first day of the month, and implement the following formula: (SUM(A) + SUM(B) - SUM(C) / D for the first day of the month I can do it in an ETL, but that involves aggregations and…
-
Need help mimicking recursion with partitioned datasets
I need help implementing a particular use case for partitions: importing selected partitions from a dataset, modifying the records, then outputting the data back into it's original partition (or a new partition) in the original dataset. There are two uses for this I can think of off the bat: A dataset can have a maximum of…
-
Add jump points to ETLs to clean up cluttered ETLs
When I create an ETL I do my best to make sure that all logical paths are kept together and that paths from one tile to another don't cross other paths if possible. Sometimes, however, I can't help but end up with a rat's nest of paths that clutter up the ETL and make it hard to follow. I would like to request jump points…
-
Changing dataset update method from Replace to Partition doubles data
We've noticed that if we change the update method of an existing dataset to Partition from replace, we end up with two records in the dataset for every new one (and both of them look identical, down to the field we're using for partitioning): it was quite the shock to see a dataset I expected to have 91 million rows…
-
Change SQL Server Connector to import datetime data with greater than 1 second granularity
SQL Server's Time and DateTime fields store data to the millisecond (Time datatypes are accurate to 100 nanoseconds). However, the connectors truncate those data types to the nearest second. I put in a ticket when I found this — I really do need to keep the milliseconds when importing — but was told it's working as…
-
Color code table columns based on tags
Our privacy officer wants us to start tagging table columns that contain PII. The problem with that is that when you add a tag to a column the only visual indication a tag exists is the information icon (a lower case "i" in a circle). We would like to: a) assign colors to tags so that when they do display the color is…
-
Add Hints to Deduplicate Tile
When I ingest the customer table from our POS, for example, and compare individual customer records to the last ingestion, I want to keep the older of the two records if selected fields show the records to be duplicates otherwise. The Deduplicate tile is the obvious choice to use, but appears to choose at random which…
-
Documentation needed for using Parameters in SQL Server Connector
I would like to have our SQL Server Connector import only data that has been altered since the last successful import (something like dtLastUpdated >= _BATCH_LAST_RUN_, but only if that value is only saved on a successful import. In the Details section of the connector there is a Query Parameter option that hints at this…
-
In Dataset Data tab, add null as filter criteria for date fields.
I need to be able to filter on the presence or absence of NULL in a date or datetime column when looking at a dataset on the Data tab. If there's a way to do this that doesn't involve creating temporary subsets that filter based on a formula or beast mode, please let me know.
