Magic ETL - Allow group by without a grouping column

GrantSmith · October 2021

There are times when I want to calculate aggregated metrics across the entire dataset. Currently this isn't possible without adding a constant value column to group on which I then have to remove later in my pipeline. It'd be much smoother if the Group By tile allowed us to group across the entire dataset without having to use a bogus constant column.

ChristianW · October 2021

So what are you saying is that you just need a grand total? Maybe you can share an example of what you are trying to achieve

GrantSmith · October 2021

@ChristianW - Yes exactly what I'm looking to do but you can't get it without adding a constant value to group on in the group by tile. SQL and Window Functions don't require a column to perform a grand total.

ChristianW · October 2021

Sorry, but I am not sure if you can just add a grand total within the ETL, probably that would be the best to do in a card? However, since you mentioned window functions you can do the same with the Rank and Window tile:

Set the function as a Sum, select the column which contains your values and set it to unbounded to 0

Then you can set the order and partitions if you wish

AndreaHenderson · March 2024

Good idea - I get what you're saying. This is something I've run up against too. I'll review with the team.

AndreaHenderson · January 23

Good news - we were able to get this into the last code release. You should have this ability in your instance now. :) The box still says "Select column" but it will let you continue without doing so.

Magic ETL Ideas

Magic ETL Ideas

Magic ETL - Allow group by without a grouping column

Implemented · Last Updated January 23

Welcome!

Comments

Welcome!

Welcome!

Quick Links

Categories