Duplicate Data

I combined two data sources and now have duplicate data how can I remove  duplicate data?


  • nalbright
    nalbright Contributor

    This discussion probably belongs in the subforum for data sources.  Nevertheless, is there any way that the data sources can be de-duplicated at the data source level?  I am assuming here that the duplicates are the same in every field, right?

    "When I have money, I buy books. When I have no money, I buy food." - Erasmus of Rotterdam
  • The data from the source is not duplicated however the result of combining data sources have created the duplicate data.

  • kshah008
    kshah008 Contributor

    Moved to Data Sources for better exposure ?

  • kshah008
    kshah008 Contributor

    Can anybody provide further assistance for @vcsmedia?

  • Why not use Magic ETL (AKA Dataflow) to remove duplicates? It's one of the ETL tools.