Magic ETL Dynamic Pivot

NateBI

Hi All,

Is this the only solution for dynamic pivoting? :

https://domo-support.domo.com/s/article/360042923454?language=en_US

Hoping for a simpler solution.

Kind regards,

GrantSmith

@NateBI

That's currently the only way to do a Dynamic Pivot. There isn't anything built into Magic that would allow you to do a pivot without previously knowing the values. You'd have to use a MySQL dataflow as documented in that article.

NateBI

Hi @GrantSmith , ok that's a shame but thank you!

RyanHartquist

Is there already somewhere to upvote a dynamic pivot tile in magic ETL?? I would love to upvote that bad boy :)

GregLaRose

I think I got this to work using the R scripts. I did it in 2 steps, because I am not that savvy in R.

!!!— here is the first Rscript tile, the purpose of this is to make all the names of my new columns in a format R can use, the column that houses my names is called PARTNO —-!!!

Import the domomagic library into the script.

library('domomagic')
library('janitor')
library('tidyverse')

read data from inputs into a data frame

input1 <- read.dataframe('Filter Rows')

write your script here

input1 <- input1 |>
mutate(
PARTNO = tolower(PARTNO),
PARTNO = trimws(PARTNO),
PARTNO = gsub("[^[:alnum:]]", "", PARTNO),
PARTNO = gsub("+", "_", PARTNO)
)

write a data frame so it's available to the next action

write.dataframe(input1)

!!!—- this is the second tile, I am making columns with the name in PARTNO, and the vlues from DATA1—-!!!

Import the domomagic library into the script.

library('domomagic')
library('tidyverse')
library('janitor')

read data from inputs into a data frame

input1 <- read.dataframe('Select Columns')

write your script here

input2 <- pivot_wider(
input1,
names_from = PARTNO,
values_from = DATA1,
values_fill = 0
)

write a data frame so it's available to the next action

write.dataframe(input2)

NateBI

Hi @GregLaRose thanks - I've done similar in the past with the Python tile - I wonder if scripts are still the only way!