-
Right string operation to remove the timestamp
I have a long date that I have converted to a text. Now I want to use the string operations tile to cut off the tail so I can have a nice clean date. the way it looks now in a string format is: 2022-02-24T12:08:34 What I want is: 2022-02-24 What I have been trying is: But it leaving the date unchanged and that timestamp at…
-
Most efficient way to export data from AWS to Domo with little to no effort?
Currently using Redshift/QuickSight for data analysis. Would like to export data to Domo with minimal effort. What are the pros and cons for each option? Thank you.
-
Framed Sum in Rank & Window Magic ETL not treating zeroes properly
Hi there, I'm trying to produce a rolling 12 month total for each month in a dataset, but I'm finding with some of the partitions that I get a negative exponential when I'm expecting it to return zero (all the months are zero - see raw data screenshot). It doesn't seem to happen with every partition that has zero values,…
-
More easily jump to a Dataset's Dataflow
When in a Dataset I want to easily jump to the dataflow that created the Dataset. It's sort of hidden over here. Why not move the "Edit Etl" down to this section?
-
Trying to condense / group rows to remove nulls, any help appreciated
Hello, I am working on a data flow that needs to perform various substring functions to isolate data from a large xml string. I have gotten it close, where the data is linked to the log / time / user in in the sql database, and i am able to separate values into appropriately named columns. I would like to know if/how to…
-
Data Overview
Dear Community. I am trying to get an overview what data we are currently importing to DOMO due to data privacy evaluation. There are a lot of Data Sources (54) and a huge amount of respective Data Flows (1.9K). My question is if there is a functionality or app supporting me with listing all data schemas/column names per…
-
Data Warehouse Summary Values
Can someone tell me what is counted as 'DOMO MAGIC DATA' in the summary metrics shown in the top right of the data warehouse screen? I've read the documentation on the Data Warehouse page and watched the little video but it doesn't specify what that is counting. I originally thought it was dataflows so I created a test…
-
Formula failing to convert value from a type string to a type date
I think I need some help with the order of operations on this. I have recursive dataflow for Yelp data. I am trying to create a 'metric date' column by 1st, Splitting the ' FILE_NAME' column date example 'security_public_storage_account_time_range_report_11_1_2021_to_11_30_2021.xls Then in the next Tile I am using the Add…
-
Help on recursive dataflow
I have a recursive dataflow that keeps getting hung up from an issue on the join between the recursiveprod and the main data that is being groupby. The error it is showing is DUPLICATE COLUMN NAMES. So I go and change the column name and i am able to get it to run. it then takes that new unique column name and adds back in…
-
Importing Data into Domo from our Connectors
A lot of our data sources are becoming fairly large over a few million rows, and we have noticed refresh speeds getting much slower. I think the solution is to have data appended as of last import rather than replace the whole thing? But I'm curious to know if anyone else has a better solution?
-
How to reactivate a dataflow disabled from inactivity?
I have a fairly comprehensive dataflow. Most of the datasets that are a part of this dataflow update nightly, but there are some others that only get updated monthly due to limitations in how we get the data then how it gets in to Domo. We use the email connector and when we receive the statement once a month email it via…
-
Need help getting pointed in the right direction for what might be causing inflating counts
I have a table that has details of inventory at each site that illustrates KPI's like Occupancy, vacancy, days vacant, and occupied units. It is put together using 3 different data sources. Price list - This is a majority of it. it is all the units aggregated row by row with those occupied, vacant, and total unit details.…
-
The correct regex to remove the first character?
I have a column( that illustrates a dollar amount but is in string format. What I am trying to do is to remove the dollar sign ($) that is the very first character in each row, so i am only left with the numbers. I have tried the left/right substring but each dollar amount is different length so I have ran in to issues.
-
Aggregation by month with segmentation
Hi there. I am breaking my head about something that just feels so easy to get. Is there somebody who can help me out with this please? I want to show a bar chart grouped by month (please see example below). The bars then should be segmented into categories. The data is coming from the user activity in a tool. The idea is…
-
Alerts on Output Dataset Fail with False Claim of Duplication
When attempting to add an alert to the output dataset of one of our dataflows we receive the below error message: We have added a Remove Duplicates step to the dataflow on the `Case Number` column just before the output dataset, however this message is still being received. We even compared the Count to the Distinct Count…
-
Reconnecting Disconnected Output DataSets and Cards
We are developing under several accounts (e.g. Dev1 and Dev2). In order to organize the ownership, I have changed the ownership of some pages and cards to one account (Dev2 > Dev1). Then the connection between the DataSet and the card got disconnected and the card is no longer visible. For the card with a direct connection…
-
How to append data to the output dataset?
I have a workbench job that will run daily. It will get the data with current date. I then needs to filter this data and create two data sets using the DataFlow ETL tool. How do I append data to the DataFlow ETL output table? DataFlow ETL creates a new table every time it runs. I realize that One way to achieve this is to…
-
Reg. Expression to replace a list of names with a single character.
I have a column that is in a string format, and of course contains names. Majority of the rows are an empty string. What I am looking for is to take the rows that do contain a name and replace them with a 1. i have been trying to use replace text tile then trying to use a regular expression in the 2nd step, then replace…
-
Changing a value to an integer in the ETL
I have a column that uses an 'x' as a flag, any row that isn't flagged with an 'x' is left as an empty string. What I need is to replace the 'x' with a '1' to be used in a later count. this should be straightforward but I keep getting my wires crossed with the order of operations.
-
Where can I find the logic for custom built dimensions?
Hello, I'm having an issue tracking down where, exactly, I can find the logic for these custom-built Dimension Segments. Any tips for where I might find it? Thanks!
-
Redshift Unable to create database.
We are getting the below error when trying to build a Redshift dataflow: We are unable to run previews, and we are unable to run the dataflow itself. It fails every time we try to run. Any idea what is causing this issue?
-
what does the delta symbol mean on my data flow ?
I checked all the flows and tables involved in building this flow, but I cant find any mistake or warning. What does that orange delta symbol mean ? it doesnt give any info when i hover over it or when i click it. thanks for the help.
-
Sharing favorite filters in data center to colleagues
Hi all, I have been using tags and favorite filters as a way to group my team's datasets and dataflows into collection. Just until today I realized that the favorite filters I created for my dataflows are not visible to my colleague (while, strangely, the filters for datasets are). My colleague and I are both in the same…
-
"Invalid Schema, Check Your Dataset Query" error
Hello, I only saw a few questions related to this on Dojo and figure I might ask. My dataflow has always ran fine (created in May 2021) but yesterday there was an error that showed up. I'm not able to preview the dataset, and I tried to refresh the ETL multiple times and reset the schema (deleted all columns from the…
-
Appending an update set to itself
Hi, I have a MySQL dataflow that is built from API reports from a vendors application. The idea is that we did a one time historical pull of the API as dataset 1. Then, the same API that only pulls 1 day of data and appends to the historical dataset as dataset 2. But, every once and a while it seems as if data is dropping…
-
Notification of DataFlow and DataSet Processing Failures
I'd like Domo to notify our admin team's Google Chat or mailing list when a DataFlow and DataSet fails to process. I know that it can be configured in "Notifications" from the top right corner of each DataSet, but I don't think it is possible to notify any email address other than the owner. I have also not found a webhook…
-
Row Numbers from original data
Hi there! Huge fan of the forums and hoping you can help me with something that previous posts and many late night Google searches have eluded me on... We have an email connector pulling in many CSV files from attachments and appending them one after the other in the order received. The order of the data within each CSV is…
-
Long Execution
Hi people! I'm here again! This time, i have a e long execution problem! I have a table with raw data with 46 million lines, approximately. Here is my first question: When a create a dataflow that process that 46 million rows and generates a output dataset, that dataset is a physical table or anytime i use that output…