-
Data Warehouse Summary Values
Can someone tell me what is counted as 'DOMO MAGIC DATA' in the summary metrics shown in the top right of the data warehouse screen? I've read the documentation on the Data Warehouse page and watched the little video but it doesn't specify what that is counting. I originally thought it was dataflows so I created a test…
-
Formula failing to convert value from a type string to a type date
I think I need some help with the order of operations on this. I have recursive dataflow for Yelp data. I am trying to create a 'metric date' column by 1st, Splitting the ' FILE_NAME' column date example 'security_public_storage_account_time_range_report_11_1_2021_to_11_30_2021.xls Then in the next Tile I am using the Add…
-
Help on recursive dataflow
I have a recursive dataflow that keeps getting hung up from an issue on the join between the recursiveprod and the main data that is being groupby. The error it is showing is DUPLICATE COLUMN NAMES. So I go and change the column name and i am able to get it to run. it then takes that new unique column name and adds back in…
-
Importing Data into Domo from our Connectors
A lot of our data sources are becoming fairly large over a few million rows, and we have noticed refresh speeds getting much slower. I think the solution is to have data appended as of last import rather than replace the whole thing? But I'm curious to know if anyone else has a better solution?
-
How to reactivate a dataflow disabled from inactivity?
I have a fairly comprehensive dataflow. Most of the datasets that are a part of this dataflow update nightly, but there are some others that only get updated monthly due to limitations in how we get the data then how it gets in to Domo. We use the email connector and when we receive the statement once a month email it via…
-
Need help getting pointed in the right direction for what might be causing inflating counts
I have a table that has details of inventory at each site that illustrates KPI's like Occupancy, vacancy, days vacant, and occupied units. It is put together using 3 different data sources. Price list - This is a majority of it. it is all the units aggregated row by row with those occupied, vacant, and total unit details.…
-
The correct regex to remove the first character?
I have a column( that illustrates a dollar amount but is in string format. What I am trying to do is to remove the dollar sign ($) that is the very first character in each row, so i am only left with the numbers. I have tried the left/right substring but each dollar amount is different length so I have ran in to issues.
-
Aggregation by month with segmentation
Hi there. I am breaking my head about something that just feels so easy to get. Is there somebody who can help me out with this please? I want to show a bar chart grouped by month (please see example below). The bars then should be segmented into categories. The data is coming from the user activity in a tool. The idea is…
-
Alerts on Output Dataset Fail with False Claim of Duplication
When attempting to add an alert to the output dataset of one of our dataflows we receive the below error message: We have added a Remove Duplicates step to the dataflow on the `Case Number` column just before the output dataset, however this message is still being received. We even compared the Count to the Distinct Count…
-
Reconnecting Disconnected Output DataSets and Cards
We are developing under several accounts (e.g. Dev1 and Dev2). In order to organize the ownership, I have changed the ownership of some pages and cards to one account (Dev2 > Dev1). Then the connection between the DataSet and the card got disconnected and the card is no longer visible. For the card with a direct connection…
-
How to append data to the output dataset?
I have a workbench job that will run daily. It will get the data with current date. I then needs to filter this data and create two data sets using the DataFlow ETL tool. How do I append data to the DataFlow ETL output table? DataFlow ETL creates a new table every time it runs. I realize that One way to achieve this is to…
-
Reg. Expression to replace a list of names with a single character.
I have a column that is in a string format, and of course contains names. Majority of the rows are an empty string. What I am looking for is to take the rows that do contain a name and replace them with a 1. i have been trying to use replace text tile then trying to use a regular expression in the 2nd step, then replace…
-
Changing a value to an integer in the ETL
I have a column that uses an 'x' as a flag, any row that isn't flagged with an 'x' is left as an empty string. What I need is to replace the 'x' with a '1' to be used in a later count. this should be straightforward but I keep getting my wires crossed with the order of operations.
-
Where can I find the logic for custom built dimensions?
Hello, I'm having an issue tracking down where, exactly, I can find the logic for these custom-built Dimension Segments. Any tips for where I might find it? Thanks!
-
Redshift Unable to create database.
We are getting the below error when trying to build a Redshift dataflow: We are unable to run previews, and we are unable to run the dataflow itself. It fails every time we try to run. Any idea what is causing this issue?
-
what does the delta symbol mean on my data flow ?
I checked all the flows and tables involved in building this flow, but I cant find any mistake or warning. What does that orange delta symbol mean ? it doesnt give any info when i hover over it or when i click it. thanks for the help.
-
Sharing favorite filters in data center to colleagues
Hi all, I have been using tags and favorite filters as a way to group my team's datasets and dataflows into collection. Just until today I realized that the favorite filters I created for my dataflows are not visible to my colleague (while, strangely, the filters for datasets are). My colleague and I are both in the same…
-
"Invalid Schema, Check Your Dataset Query" error
Hello, I only saw a few questions related to this on Dojo and figure I might ask. My dataflow has always ran fine (created in May 2021) but yesterday there was an error that showed up. I'm not able to preview the dataset, and I tried to refresh the ETL multiple times and reset the schema (deleted all columns from the…
-
Appending an update set to itself
Hi, I have a MySQL dataflow that is built from API reports from a vendors application. The idea is that we did a one time historical pull of the API as dataset 1. Then, the same API that only pulls 1 day of data and appends to the historical dataset as dataset 2. But, every once and a while it seems as if data is dropping…
-
Notification of DataFlow and DataSet Processing Failures
I'd like Domo to notify our admin team's Google Chat or mailing list when a DataFlow and DataSet fails to process. I know that it can be configured in "Notifications" from the top right corner of each DataSet, but I don't think it is possible to notify any email address other than the owner. I have also not found a webhook…
-
Row Numbers from original data
Hi there! Huge fan of the forums and hoping you can help me with something that previous posts and many late night Google searches have eluded me on... We have an email connector pulling in many CSV files from attachments and appending them one after the other in the order received. The order of the data within each CSV is…
-
Long Execution
Hi people! I'm here again! This time, i have a e long execution problem! I have a table with raw data with 46 million lines, approximately. Here is my first question: When a create a dataflow that process that 46 million rows and generates a output dataset, that dataset is a physical table or anytime i use that output…
-
Dataflow creation best practice and recommendation
A lot of the dataflow creation I do is taking 2 datasets that differ slightly and don't have an easy 1:1 comparison that makes joining the data very easy. usually I am using 1 report for almost the entire visualization, and puling a column or two form the 2nd report. Since the reports aren't in an identical format, and…
-
Join Function in ETL
Hi, I am trying to join a table on my DataSet, using the left join function. My original DataSet contains only 118k rows, and the other table contains 1405 rows. I thought that the output DataSet will stay 118k rows, and just have addition columns on it. However, the output DataSet is 4.6M which is way more then I…
-
How to split values from one column in to 2 columns?
I have a column that contains values that are 4 digits. I want to divide them up in to 2 separate columns. The first 2 number are the % of the discount, and the last 2 are the length Ideally it would be the % and contain 30, 40, 35, 40 ,etc... Then Length would have the last for digits like 02, 02, 03, 02, 04, etc.. I am…
-
How to delete portion of text in a column in the ETL?
I have a date column that is in this format: The format of the date is fine, but what I am trying to do is get rid of everything including the 'T' and to the right, so that all that is left would be 2021-06-27. If a solution within the ETL is possible that would be great.
-
Data Flow help
Hello, Experts, I am humbly reaching out for some help. I have a vendor sending a snapshot of a database table every day and not sending me diffs. I am trying to determine the diffs. The connector type is SFTP CSV. The file they send daily is overwritten daily. I currently have the data connector appending the data from…
-
Share dataflow and dataset owned by me to other author in the same organisation
Is there any easy way to share everything so that the other authors can see my work? I need to click share each time for each dataflow or dataset or cards that I created. How can I work more collaboratively with other author in our instance so we know what's the progress from each other? Thanks Sherry