mcoblentz Member

Maybe it's just me, but the image did not render.

What happened to this card type? I don't see it anymore.

I admit that a lot of folks say, "Oh, you can use the API for that". But the samples and other bits are lacking there for those of us with no experience in this area. I want to access the metadata about the datasets - specifically the row counts for each ODBC dataset so I have a bit of a QA check on the data (did I get it…

The tests are running now. I will post as I get data. the source dataset is about 53M rows. The UPDATES and INSERTS are about 500K each.

I tried using COPY w_quote_f FROM w_quote_f_INSERT; COPY w_quote_f FROM w_quote_f_UPDATE; instead of ALTER TABLE but I couldn't get Domo to run with that either. :( 

And I created a third version, which I thought would be really good but Domo is yelling at me that one of the columns (a text column no less) is different. Hmm. DELETE FROM w_quote_f WHERE row_wid IN(SELECT row_wid FROM w_quote_f_inserts); DELETE FROM w_quote_f WHERE row_wid IN(SELECT row_wid FROM w_quote_f_updates); ALTER…

In an attempt to measure the difference, I kept the same flow as above and created a second version like this: begin transaction; DELETE FROM w_quote_f WHERE row_wid IN(SELECT row_wid FROM w_quote_f_inserts); DELETE FROM w_quote_f WHERE row_wid IN(SELECT row_wid FROM w_quote_f_updates); insert into w_quote_f (select * from…

Aha!

@RGranada Where is that in Workbench?

@DaniBoyI think this might be better placed in Best Practices. How does one move a post?

Hi @Rich, @RGranada, I just posted about how I do UPSERTS in Redshift here.

@Rich, is there an UPSERT methodology for SQL in the dataflows? I haven't figured out how to save the resulting dataset nor can I get the SQL to actually resolve.

Hi Aaron, I'm trying to avoid doing a full data set replacement (via workbench) because that's 56M rows. So if we do append, then for the INSERTS that's pretty easy. But the UPDATES (300K of them) is not quite so simple - is it? If we delete the rows then if the UPDATE/APPEND does not work, we have a damaged dataset. If we…

Out of curiosity, what is wrong with the one currently available?

Dear Domo, I would like to add this as a feature request as well. Please consider this an UpVote for this idea.

Oh, I think I should have posted this in Ideas Exchange. It's a bug/feature.

Yes but it does not show up in the use list for assignment.