Can I see the basic dataset length between different steps of an etl flow?

ydigilov
ydigilov Member
in Magic ETL

For example, I want to know how many rows are in the table before and after a pivot.

Tagged:

Best Answer

  • GrantSmith
    GrantSmith Coach
    edited March 2024 Answer ✓

    Currently this isn't an option directly within Magic ETL but would be a much welcomed addition. I'd recommend adding an idea to the Idea Exchange for this.

    You could output your dataset before and after the pivot to new datasets and compare the difference in a more manual way.

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**

Answers

  • GrantSmith
    GrantSmith Coach
    edited March 2024 Answer ✓

    Currently this isn't an option directly within Magic ETL but would be a much welcomed addition. I'd recommend adding an idea to the Idea Exchange for this.

    You could output your dataset before and after the pivot to new datasets and compare the difference in a more manual way.

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • ArborRose
    ArborRose Coach

    I do it as Grant mentioned - add an output on the dataset can give you a dataset to debug. I label that output set with the word debug so they are easy to find and remove afterwards.

    ** Was this post helpful? Click Agree or Like below. **
    ** Did this solve your problem? Accept it as a solution! **

  • ydigilov
    ydigilov Member

    Ya that is super annoying… I feel like a small field that shows row/column # would be super helpful.

Categories