Want to use Stacker, but don't know MySQL? Does the Stacker process take longer than expected and generates millions of rows? Ever wondered if there was another alternative to Stacker? Well, now there is by utilizing Magic ETL!
One day, I was developing a dataset with Magic ETL and one of the requirements was to add a column that identified where a particular quantity value came from. I had multiple input datasets that were being transformed and each primary key was a different data type; this is when I had an Aha moment.
I had a different dataset that was utilizing Stacker; this particular dataset had an average turnaround time of 4 hours and would generate 20+ million rows. I constantly changed the form dataset and sometimes would miss a syntax, thus rendering the Stacker to not process successfully. I started to break down the stacker plugin query and try to understand how it functioned. After analyzing the query and how it interacted with the form dataset, I was able to figure out which transformation blocks were required to replicate the Stacker.