Magic ETL - Allow group by without a grouping column

GrantSmith · 2021-10-06T11:56:46+00:00

There was an error rendering this rich post.

There are times when I want to calculate aggregated metrics across the entire dataset. Currently this isn't possible without adding a constant value column to group on which I then have to remove later in my pipeline. It'd be much smoother if the Group By tile allowed us to group across the entire dataset without having to use a bogus constant column.

Find more posts tagged with

Grouping

Magic ETL

Implemented

Status: Implemented

Comments

ChristianW

So what are you saying is that you just need a grand total? Maybe you can share an example of what you are trying to achieve

GrantSmith

@ChristianW - Yes exactly what I'm looking to do but you can't get it without adding a constant value to group on in the group by tile. SQL and Window Functions don't require a column to perform a grand total.

ChristianW

Sorry, but I am not sure if you can just add a grand total within the ETL, probably that would be the best to do in a card? However, since you mentioned window functions you can do the same with the Rank and Window tile:

Set the function as a Sum, select the column which contains your values and set it to unbounded to 0

Then you can set the order and partitions if you wish

AndreaHenderson

Good idea - I get what you're saying. This is something I've run up against too. I'll review with the team.

AndreaHenderson

Good news - we were able to get this into the last code release. You should have this ability in your instance now. :) The box still says "Select column" but it will let you continue without doing so.