Magic ETL - Allow group by without a grouping column

GrantSmith
GrantSmith Coach
edited March 2024 in Magic ETL Ideas

There are times when I want to calculate aggregated metrics across the entire dataset. Currently this isn't possible without adding a constant value column to group on which I then have to remove later in my pipeline. It'd be much smoother if the Group By tile allowed us to group across the entire dataset without having to use a bogus constant column.

**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**
Tagged:
12
12 votes

Implemented · Last Updated

Good news! This has now been implemented and you should see this in your instance now.

Comments

  • ChristianW
    ChristianW Member

    So what are you saying is that you just need a grand total? Maybe you can share an example of what you are trying to achieve

  • GrantSmith
    GrantSmith Coach

    @ChristianW - Yes exactly what I'm looking to do but you can't get it without adding a constant value to group on in the group by tile. SQL and Window Functions don't require a column to perform a grand total.

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • ChristianW
    ChristianW Member

    Sorry, but I am not sure if you can just add a grand total within the ETL, probably that would be the best to do in a card? However, since you mentioned window functions you can do the same with the Rank and Window tile:

    Set the function as a Sum, select the column which contains your values and set it to unbounded to 0

    aa.PNG








    Then you can set the order and partitions if you wish

    bb.PNG


  • AndreaHenderson
    AndreaHenderson Domo Product Manager

    Good idea - I get what you're saying. This is something I've run up against too. I'll review with the team.

    Domo Product Manager for Data Transformation (MagicETL)

  • AndreaHenderson
    AndreaHenderson Domo Product Manager

    Good news - we were able to get this into the last code release. You should have this ability in your instance now. :) The box still says "Select column" but it will let you continue without doing so.

    Screenshot 2025-01-23 at 9.06.50 AM.png
    Screenshot 2025-01-23 at 9.16.55 AM.png

    Domo Product Manager for Data Transformation (MagicETL)

Categories