Point ETL Output to Existing Dataset

Parker_Lake
Parker_Lake Member
in Magic ETL Ideas

I want to be able to point the output of an ETL to a pre-existing dataset. If, as part of a fix or as part of development, I need to make alterations to the ETL to get a desired output that I don't want to be the final ETL, it would be great to be able to make the changes and then point the final ETL to the preexisting dataset via ID in the Output Dataset tile without disrupting anything downstream of the dataset.

Tagged:
9
Up
9 votes

Submitted and awaiting review from product team · Last Updated

Comments

  • ArborRose
    ArborRose Coach

    Enthusiastic "yes".

    ** Was this post helpful? Click Agree or Like below. **
    ** Did this solve your problem? Accept it as a solution! **

  • Jones01
    Jones01 Contributor

    @Parker_Lake I do this via the cli but agree would be handy to have it natively available

  • Parker_Lake
    Parker_Lake Member

    @Jones01 do you have a link to documentation on how to do that with the cli? I'm new to that but would love to learn.

  • Jones01
    Jones01 Contributor

    @Parker_Lake

    if you connect with the cli tool

    https://domo-support.domo.com/s/article/360043437733?language=en_US

    Then run list-dataflow -i 96 -f mydataflow.json

    96 being the id of your data flow found in the url when viewing it in domo.

    image.png

    This will export the definition of the ETL into json.

    In the json you should be able to see the output dataset definition.

    image.png

    You can then replace the dataSourceId with the Id of the dataset you want to output to. I would also set the dataSourceName to the name of the dataset as well.

    image.png

    Once done run set-dataflow-properties -i 96 -d mydataflow.json.

    That should do it.

Categories