Magic ETL

Magic ETL

Update rows on ETL output

I have an ETL that produces an output where one of the columns is calculated using a formula. The output is generated using the "append" method and the input moved from being all time data to only L4D worth of data.
The problem I have is that, due to some business circumstances, I have to re-calculate that column but I cannot run it against the entire input DataSet anymore. To make it more interesting, the output DataSet / column pair are used on quite a few dashboards and I would like to prevent having to update all of them with a new DataSet.
Yes, I want to update the calculated column on the already existing output.
Is there any way you guys can think of that I can use to do this?

Best Answer

  • Coach
    edited September 2024 Answer ✓

    You could use a recursive type dataflow where you take your existing output dataset and use it as your input dataset in the same dataflow, update the calculation, and then save it back to the output dataset.

    Here's some documentation on recursive dataflows:

    https://domo-support.domo.com/s/article/360057087393?language=en_US

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**

Answers

Welcome!

It looks like you're new here. Members get access to exclusive content, events, rewards, and more. Sign in or register to get started.
Sign In