-
LEAD IGNORE NULL in Magic ETL?
Hi there, I am trying to rewrite a Redshift Dataflow into Magic ETL. I ran across a specific function that was available in Redshift that I dont think is possible in Magic ETL. I wanted to get the community's input and advice to see what you guys think. This is the function found in Redshift: LEAD(CASE WHEN t2."channel"…
-
Amazon Redshift Connector cannot Authenticate
We are trying to connect to a client's Redshift environment. IPs have been whitelisted on their side. But we are still getting an Authentication error. I've got a screenshot of the configuration page.
-
Why do all Redshift Datflows (still) convert all variables to lower case?
Hi, we're currently doing an audit and noticed that legacy datasets have 2 versions, with the 2nd version just capitalizing the variable names (often a magic ETL). The first version is in Redshift - building dataflows in redshift is quite popular within our team because it has fuctions that mysql dataflows doesn't have.…
-
Updating a DataSet Triggered by the Finish of a Glue Job
We are using a Connector to retrieve data from Amazon Redshift and display it in Domo. We use AWS Glue to retrieve data from Oracle and store it in Redshift, but I don't think it's possible to trigger the end of the Glue job to update the DataSet in Domo. Currently we schedule the DataSet update around the time the Glue…
-
Is it possible to change the connector type from Redshift to Redshift SSH?
Is it possible to change the connector type from Redshift to Redshift SSH for existing data sets? We are making some network configuration changes in our AWS environment, and Redshift SSH will be required under the new set up. Is there a way to change the connector associated with a data set, or do we need to rebuild all…
-
Redshift Unable to create database.
We are getting the below error when trying to build a Redshift dataflow: We are unable to run previews, and we are unable to run the dataflow itself. It fails every time we try to run. Any idea what is causing this issue?
-
URGENT: Pull Data from Domo onto Amazon Redshift
I was wondering how I am able to pull in data from Domo using a connector or api and extract data onto Amazon redshift, Is there a way to do that?
-
Which Redshift SQL version / functions are supported?
Hey ya'll, I'm trying to write query to do a Regex sub string on some text. Beast Mode and Magic ETL have Regex but not Regex sub string. MySQL has the capability but Domo is on version 5.x~. My last option was Redshift SQL. My query: SELECT SUBSTRING_REGEX("Description", '.*(Red).*') as color from "clothing_db" Error: The…
-
Is there an alternative of distinct on for redshift?
Hey, I am trying to build a dataflow using redshift but distinct on is not supported. It's a simple query: (SELECT distinct on ("id") var_list.* from "indicator" as ind order by "id", "rank" desc) Any suggestions for workarounds?
-
Empty cells after aggregating and creating a case when variable
Hi I have a dataset that shows a sale/lost sale an agent made on a daily basis. Now I am using the dataflow to get the sales % over the last 3 months (data is only last 3 months) per consultant and want to join it back to the original dataset for later card creation purposes. This following formula gives me empty values…
-
Return Capitalized (UPPER or CamelCase) Characters in Column Names from Redshift DataFlow
Any tips or tricks to avoid the auto-lowercasing of column names in Redshift DataFlows? The reason we need this is because of how page filters are case sensitive, and the page being filtered runs off of several datasets, some are the output from MySQL dataflows and one from Redshift (due to the size, ~4.5M rows). Would…
-
Timing Out Redshift
Backstory: We have a datset provided by an outside consultant which is an export from SPSS. 11.3K rows of 1174 columns. The columns contain replies to a survey. The results are in categorical values, for example the answers to How much do you agree with.... are coded as 1 strongly disagree-5 strongly agree. The end user of…
-
Updating data in a dataset based on date
Hi Everyone. Long time lurker first time poster (please be gentle) I have a dataset that contains a lot of customer data (not to brag or anything) and I'm trying to update the customerID column for one specific customer from 123 to 456 only when another column "event date and time" is before 8/1/18. Essentially, I want all…
-
CROSS Apply equivalent in Redshift SQL
Hi All, I am trying to find the equivalent of CROSS APPLY in the query below. Can you please help.. WITH CTE AS ( SELECT *,ROW_NUMBER()OVER(PARTITION BY "ORDER","ORD_DATE" ORDER BY "DATE_VALUE" DESC)AS RNum FROM input ),CTE2 AS ( SELECT "ORDER","ORDDATE","PRMDATE","DATE_VALUE" AS recdate, DATE_SUB("DATE_VALUE", INTERVAL 7…