Update rows on ETL output

joserosapt
joserosapt Member
in Magic ETL

I have an ETL that produces an output where one of the columns is calculated using a formula. The output is generated using the "append" method and the input moved from being all time data to only L4D worth of data.
The problem I have is that, due to some business circumstances, I have to re-calculate that column but I cannot run it against the entire input DataSet anymore. To make it more interesting, the output DataSet / column pair are used on quite a few dashboards and I would like to prevent having to update all of them with a new DataSet.
Yes, I want to update the calculated column on the already existing output.
Is there any way you guys can think of that I can use to do this?

Best Answer

  • GrantSmith
    GrantSmith Coach
    edited September 23 Answer ✓

    You could use a recursive type dataflow where you take your existing output dataset and use it as your input dataset in the same dataflow, update the calculation, and then save it back to the output dataset.

    Here's some documentation on recursive dataflows:

    https://domo-support.domo.com/s/article/360057087393?language=en_US

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**

Answers

  • GrantSmith
    GrantSmith Coach
    edited September 23 Answer ✓

    You could use a recursive type dataflow where you take your existing output dataset and use it as your input dataset in the same dataflow, update the calculation, and then save it back to the output dataset.

    Here's some documentation on recursive dataflows:

    https://domo-support.domo.com/s/article/360057087393?language=en_US

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • joserosapt
    joserosapt Member

    I'll give it a try. Thanks Grant.

Categories