Adding source column in appended datasets using Magic ETL

Options
DomoATX
DomoATX Member
in Magic ETL

Hello,

I am trying to append a 8 datasets together and add a new column to the resulting output that is the source dataset for that row. That column is obviously not present in the original dataset. I just need to know where the data for that row originated so I can filter if needed. I have tried a few things but cannot seem to get this to work. Does anyone have any suggestions?

Thank you!

Tagged:

Best Answer

  • MichelleH
    MichelleH Coach
    edited October 2024 Answer ✓

    @DomoATX I would recommend adding an "Add Constants" tile to all 8 branches of the dataflow before they all merge into the "Append Rows" tile. Be sure that the column name in first step is the same for every tile. The only difference between the the tiles should be the Source Name in the third step.

    image.png

Answers

  • MichelleH
    MichelleH Coach
    edited October 2024 Answer ✓

    @DomoATX I would recommend adding an "Add Constants" tile to all 8 branches of the dataflow before they all merge into the "Append Rows" tile. Be sure that the column name in first step is the same for every tile. The only difference between the the tiles should be the Source Name in the third step.

    image.png

Categories