Can I see the basic dataset length between different steps of an etl flow?

For example, I want to know how many rows are in the table before and after a pivot.

Tagged:

Best Answer

  • GrantSmith
    GrantSmith Coach
    edited March 27 Answer ✓

    Currently this isn't an option directly within Magic ETL but would be a much welcomed addition. I'd recommend adding an idea to the Idea Exchange for this.

    You could output your dataset before and after the pivot to new datasets and compare the difference in a more manual way.

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**

Answers

  • GrantSmith
    GrantSmith Coach
    edited March 27 Answer ✓

    Currently this isn't an option directly within Magic ETL but would be a much welcomed addition. I'd recommend adding an idea to the Idea Exchange for this.

    You could output your dataset before and after the pivot to new datasets and compare the difference in a more manual way.

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • I do it as Grant mentioned - add an output on the dataset can give you a dataset to debug. I label that output set with the word debug so they are easy to find and remove afterwards.

    ** Was this post helpful? Click Agree or Like below. **
    ** Did this solve your problem? Accept it as a solution! **

  • Ya that is super annoying… I feel like a small field that shows row/column # would be super helpful.