Fastest way to append? Magic seems a bit slow

DMJerry
DMJerry
in Magic ETL

Hello,

 

I am appending 2 datasets that have a only a few common columns to give me and my clients the ability to bring their plans in without having to join them and cause some duplications.  With that being said, does anyone know of a faster way to do this beside append in Magic?  I know that fusion cannot do this because the schema needs to be identical, like a union.

 

Any help would be greatly appreciated, as I am working on showing some of my non-technical clients how to be more self sufficient.

 

Appreciate you all.

 

Jerry

Comments

  • guitarhero23
    guitarhero23 Contributor

    How many columns, rows and how long is it taking? Also does the source data not have some sort of ID column to let you join via a MySQL dataflow or is it that the two datasets just don't share a common ID field to join on?


    **Make sure to like any users posts that helped you and accept the ones who solved your issue.**

Categories