Point ETL Output to Existing Dataset

Parker_Lake · 2024-08-29T21:45:50+00:00

There was an error rendering this rich post.

I want to be able to point the output of an ETL to a pre-existing dataset. If, as part of a fix or as part of development, I need to make alterations to the ETL to get a desired output that I don't want to be the final ETL, it would be great to be able to make the changes and then point the final ETL to the preexisting dataset via ID in the Output Dataset tile without disrupting anything downstream of the dataset.

Find more posts tagged with

Dataset

Magic ETL

Submitted and awaiting review from product team

Status: Submitted and awaiting review from product team

Comments

ArborRose

Enthusiastic "yes".

Jones01

@Parker_Lake I do this via the cli but agree would be handy to have it natively available

Parker_Lake

@Jones01 do you have a link to documentation on how to do that with the cli? I'm new to that but would love to learn.

Jones01

@Parker_Lake

if you connect with the cli tool

https://domo-support.domo.com/s/article/360043437733?language=en_US

Then run list-dataflow -i 96 -f mydataflow.json

96 being the id of your data flow found in the url when viewing it in domo.

This will export the definition of the ETL into json.

In the json you should be able to see the output dataset definition.

You can then replace the dataSourceId with the Id of the dataset you want to output to. I would also set the dataSourceName to the name of the dataset as well.

Once done run set-dataflow-properties -i 96 -d mydataflow.json.

That should do it.