Would expected that columns joined by would not remain duplicated in joint dataset

odedbadt
odedbadt
in Archive

When joining on a column, I’d expect that column to appear only once in the output data set since the two are expected to be identical rather than appearing twice with 1 and 2 suffixes

Comments

  • Valiant
    Valiant Coach

    Depending on the method of your join, you can remove the second instance of a column beforehand. 

     

    One example is if you're using the DataFusion, in the Preview window at the bottom, you can click the dropdown arrow next to the column name and say 'Ignore Column'. This will remove the duplicate from

    your final dataset.


    image.png

     

     

     

     

     

     

     

     

    If your using another method of joining, just let me know and I'll try to help out.

     

Categories