-
Re-"Start"-ing inactive datasets in bulk from the Datacenter Dataset View
When datasets haven't been actively queried in a while, they get auto-disabled, and need to be manually "re-started". When datasets like that are inputs to dataflows, they disable the associated dataflows. But, from the Datasets view of the Datacenter, we have no way of seeing that a dataset needs to be "restarted". It…
-
Datediff in Redshift vs Magic ETL
Hi there! Im trying to recreate a calculation from Redshift to Magic ETL. Im running into some trouble with a specific formula. In Redshift: DATEDIFF('week',"start_date__c","end_date__c") In Magic: v1 - DATEDIFF(`end_date__c`,`start_date__c`)/7 In Magic: v2 - WEEKOFYEAR(`end_date__c`) - WEEKOFYEAR(`start_date__c`) Showing…
-
Show Federated Redshift Data Source in Data Source Settings
Would be great to see the table or view the federated source is pointing to within the settings of the data source. You can already see and select columns. Currently you have to rely on keeping the location within the data source name.
-
Redshift Flow
We have a redshift flow that runs daily. The flow has past three years of data from three different flows filtered by the date. Recently some changes were made to the historical data and I cannot see those reflected in the redshift flow. However, if I write the same code in a separate Redshift dataflow it works. Can anyone…
-
When does the Domo platform send a request for a query execution?
The redshift database is getting thousands of queries and is having a hard time keeping up with it. These are due to the federated data sources that have been established. Could someone explain when the DOMO platform send in a request for a query execution? I assume whenever any change is made in analyzer? Then the cards…
-
DateDiff formula in Redshift
Hi Team, The formula below was built as a beastmode but would like to move it to dimensions, the backend. However, "DATEDIFF()" isn't recognized in Redshift, any workarounds? Thanks CASE when ("date","published_date") >0 and DATEDIFF("date","published_date") <=29 then '01 Month' when DATEDIFF("date","published_date") >29…
-
LEAD IGNORE NULL in Magic ETL?
Hi there, I am trying to rewrite a Redshift Dataflow into Magic ETL. I ran across a specific function that was available in Redshift that I dont think is possible in Magic ETL. I wanted to get the community's input and advice to see what you guys think. This is the function found in Redshift: LEAD(CASE WHEN t2."channel"…
-
Amazon Redshift Connector cannot Authenticate
We are trying to connect to a client's Redshift environment. IPs have been whitelisted on their side. But we are still getting an Authentication error. I've got a screenshot of the configuration page.
-
Why do all Redshift Datflows (still) convert all variables to lower case?
Hi, we're currently doing an audit and noticed that legacy datasets have 2 versions, with the 2nd version just capitalizing the variable names (often a magic ETL). The first version is in Redshift - building dataflows in redshift is quite popular within our team because it has fuctions that mysql dataflows doesn't have.…
-
Updating a DataSet Triggered by the Finish of a Glue Job
We are using a Connector to retrieve data from Amazon Redshift and display it in Domo. We use AWS Glue to retrieve data from Oracle and store it in Redshift, but I don't think it's possible to trigger the end of the Glue job to update the DataSet in Domo. Currently we schedule the DataSet update around the time the Glue…
-
Is it possible to change the connector type from Redshift to Redshift SSH?
Is it possible to change the connector type from Redshift to Redshift SSH for existing data sets? We are making some network configuration changes in our AWS environment, and Redshift SSH will be required under the new set up. Is there a way to change the connector associated with a data set, or do we need to rebuild all…
-
Redshift Unable to create database.
We are getting the below error when trying to build a Redshift dataflow: We are unable to run previews, and we are unable to run the dataflow itself. It fails every time we try to run. Any idea what is causing this issue?
-
URGENT: Pull Data from Domo onto Amazon Redshift
I was wondering how I am able to pull in data from Domo using a connector or api and extract data onto Amazon redshift, Is there a way to do that?
-
Which Redshift SQL version / functions are supported?
Hey ya'll, I'm trying to write query to do a Regex sub string on some text. Beast Mode and Magic ETL have Regex but not Regex sub string. MySQL has the capability but Domo is on version 5.x~. My last option was Redshift SQL. My query: SELECT SUBSTRING_REGEX("Description", '.*(Red).*') as color from "clothing_db" Error: The…
-
Is there an alternative of distinct on for redshift?
Hey, I am trying to build a dataflow using redshift but distinct on is not supported. It's a simple query: (SELECT distinct on ("id") var_list.* from "indicator" as ind order by "id", "rank" desc) Any suggestions for workarounds?
-
Empty cells after aggregating and creating a case when variable
Hi I have a dataset that shows a sale/lost sale an agent made on a daily basis. Now I am using the dataflow to get the sales % over the last 3 months (data is only last 3 months) per consultant and want to join it back to the original dataset for later card creation purposes. This following formula gives me empty values…
-
Return Capitalized (UPPER or CamelCase) Characters in Column Names from Redshift DataFlow
Any tips or tricks to avoid the auto-lowercasing of column names in Redshift DataFlows? The reason we need this is because of how page filters are case sensitive, and the page being filtered runs off of several datasets, some are the output from MySQL dataflows and one from Redshift (due to the size, ~4.5M rows). Would…
-
Timing Out Redshift
Backstory: We have a datset provided by an outside consultant which is an export from SPSS. 11.3K rows of 1174 columns. The columns contain replies to a survey. The results are in categorical values, for example the answers to How much do you agree with.... are coded as 1 strongly disagree-5 strongly agree. The end user of…
-
Updating data in a dataset based on date
Hi Everyone. Long time lurker first time poster (please be gentle) I have a dataset that contains a lot of customer data (not to brag or anything) and I'm trying to update the customerID column for one specific customer from 123 to 456 only when another column "event date and time" is before 8/1/18. Essentially, I want all…
-
Allow Virtual DataSets as Inputs to Redshift / MySQL Dataflows
We use the Virtual DataSets toolkit item to populate our secondary Domo instance with data from our primary Domo instance. Domo calls the resulting virtual dataset a federated dataset (the data provider is "domo-federateddata"). Unfortunately we cannot use the federated datasets as inputs to Redshift / MySQL ETL dataflows.…