MAX or SUM With Group BY ID

Options
user02996
user02996 Member
in Magic ETL

I'm looking for a Beast Mode formula to create a MAX calculation by ID in my table.

My resulting column should look like column B below.

 

I already tried a formula with Distinct and MAX but while the formula was valid, my attempt still failed at producing desired results. 

Keep in mind that in my scenario, column A is a calculated field already, don't know if that makes a difference.

 

Thanks!

 

IDcolumn Acolumn B - max aggregate
1101
1111
2101
2111
3100
3100

Best Answer

  • AS
    AS Coach
    Answer ✓

    What you want is an analytic function that evaluates the max of the ID window and adds a column with that value.

    See: https://my.vertica.com/docs/7.1.x/HTML/Content/Authoring/SQLReferenceManual/Functions/Analytic/MAXAnalytic.htm

     

    Domo has done some work on beast mode window functions but they aren't currently available, unfortunately.  For now you'd have to bring that into a dataflow where you CAN perform window functions. 

    Aaron
    MajorDomo @ Merit Medical

    **Say "Thanks" by clicking the heart in the post that helped you.
    **Please mark the post that solves your problem by clicking on "Accept as Solution"

Answers

  • AS
    AS Coach
    Answer ✓

    What you want is an analytic function that evaluates the max of the ID window and adds a column with that value.

    See: https://my.vertica.com/docs/7.1.x/HTML/Content/Authoring/SQLReferenceManual/Functions/Analytic/MAXAnalytic.htm

     

    Domo has done some work on beast mode window functions but they aren't currently available, unfortunately.  For now you'd have to bring that into a dataflow where you CAN perform window functions. 

    Aaron
    MajorDomo @ Merit Medical

    **Say "Thanks" by clicking the heart in the post that helped you.
    **Please mark the post that solves your problem by clicking on "Accept as Solution"
  • user02996
    user02996 Member

    @AS

    Thanks for providing this information. 
    You are correct, I just got off the phone with DOMO support and they said the same thing :(

    For now I'll have to use the dataflow.

    Best.

  • DanHoughton
    DanHoughton Member

    I was very excited to see beast mode window functions in the #DP18 videos, so hopefully it is now enabled. But if not, the best way I’ve found for doing table calculations is a redshift sql DataFlow. The syntax for window functions is actually very readable and straightforward. Much simpler than trying to get head round the equivalent “table calculations” in Excel Tableau.

     

    In your example it would be:

     

    select *,

    max(col) over (partition by id)

    from table

  • user02996
    user02996 Member

    thanks for suggesting sharing this work around. 

    I'll raise it's possibility to a colleague as I'm not familiar with a "redshift sql DataFlow"

     

    Cheers.

  • DanHoughton
    DanHoughton Member

    No probs. It's a Beta feature, so you will need to ask DomoSupport to turn it on. It appears as a choice when you press "SQL" type connector.

  • Unknown
    Unknown
    @user02996 wrote:

    I'm looking for a Beast Mode formula to create a MAX calculation by ID in my table.

    My resulting column should look like column B below.

     

    I already tried a formula with Distinct and MAX but while the formula was valid, my attempt still failed at producing desired results. 

    Keep in mind that in my scenario, column A is a calculated field already, don't know if that makes a difference.

     

    Thanks!

     

    IDcolumn Acolumn B - max aggregate
    1101
    1111
    2101
    2111
    3100
    3100

    ******************

    You can accomplish this in a beastmode. To test do the following:

    Create a Domo webform with the ID and Column A information listed above. Then in the analyzer create a table card and add a beastmode for Column B that looks like this:

        max(`Column A`) over(partition by `ID`) 

     

    Your result should be a table that looks like :

    ID Column A Column B

    1101
    1111
    2101
    2111
    3100
    3100
  • AS
    AS Coach

    @Wills Are these officially supported functions now?  They've been somewhat available in a hush-hush way for a bit, but without support, documentation, etc, I feel adoption isn't what it could be.

    Aaron
    MajorDomo @ Merit Medical

    **Say "Thanks" by clicking the heart in the post that helped you.
    **Please mark the post that solves your problem by clicking on "Accept as Solution"
  • Unknown
    Unknown

    The vertica beastmode functions used to be requested on/off item, meaning perpetual alpha/beta. These functions are now turned on for everyone by default but done so without documentation. So they are more like a secret menu item from in-n-out. This windowing function is not really supported due this lack of  documentation and the fact that it may be replaced completly with a magic ETL dataflow "Rank and Windowing" tile as the real long term method for windowing calculations. 

     

    So enjoy that is is there but support will always direct you to the magic tile.

  • user17188
    user17188 Member

    I don't understand the approach, if you make calculations in the ETL those values will be fixed, they can't evolve when filters are applied in the card

Categories