09/18 PRODUCT RELEASE SNEAK: Magic ETL Updates

BenSchein

We are excited to release these new updates to Magic ETL! 

• Upsert Processing: Update rows in output datasets without reprocessing the full dataset, based on a unique row-level key. This replaces any of the remaining needs for recursive dataflows. This makes the pipeline pattern much more resilient and efficient due to an easy recovery process and no longer a need to reprocess data or perform complex comparison logic when updating an existing dataset. 
• ‘Remove Duplicates’ Tile: Now includes “Add All Columns” and a corresponding “Remove All Columns” buttons that allows for easy adding or removing of columns in bulk. 
• Increased Magic ETL Canvas Size: Build better, more organized DataFlows that are easier to document and easier to update. Perform all the operations necessary without having to arbitrarily split the flow into multiple flows due to the previous small canvas size. 
• Magic ETL Mini Map: Provides a better navigation experience with a mini map in the bottom right corner to quickly and easily see the layout of the tiles.  

Product sneak peaks are an exclusive perk for our Community members only 👏 

Please note: these features are scheduled to release on September 18, but subject to change and could lead to a delay in its deployment for an unknown amount of time.