Magic ETL | Remove Duplicates Tile | Select all fields option

Godiepi · 2022-09-27T15:31:51+00:00

There was an error rendering this rich post.

Godiepi

It would be good to have a "Select All Columns" option for the remove duplicates tile in magic

Find more posts tagged with

Implemented

Status: Implemented

Quick Links

Comments

jaeW_at_Onyx

@Godiepi that's a pretty obscure use case that you'd expect full-on row duplication.

you could use MD5() hashing to concatenate all the values together and then use a RowNumber + rank_window tile then filter where rownumber = 1

this is a classic way of handling identifying slowly changing dimension rows.

Billobi

I'd love to see a "select all" option in the remove duplicates tile, sort of like the same button on Select Columns where it loads up all the fields but then you can go back still and remove the ones you don't need or care about.

I see plenty of cases where there's a junky input (wonky APIs, spreadsheets uploaded directly from hell with way to many columns, etc.) that needs a quick/easy button to cleanup/massage things before starting to explore the rows.

The downside is it could easily pick up a null column and with existing behavior, return a zero row output. Bonus feature if the dedupe could skip null columns from inspection.

JasonAltenburg

I think this would be a good addition, even if it's just to speed up the adding of many columns to the tile. Instead of clicking individually 18 out of 20 rows, you could "select all" then remove the 2 you didn't want.

AndreaHenderson

This is a good idea, and something I've heard a few times now. I will be reviewing with my team. I think it would also be nice to have this same feature on any tile where you have the option to select columns.

Idea Categories

Alerts ideas
Alerts Product Enhancement Ideas
Analyzer Ideas
Analyzer Product Enhancement Ideas
APIs Ideas
API Product Enhancement Ideas
Apps Ideas
Apps Product Enhancement Ideas
Appstore Experience ideas
Appstore product enhancement ideas
App Studio Ideas
App Studio Product Enhancement Ideas
Beast Mode Ideas
Beast Mode Product Enhancement Ideas
Buzz & Navigation Ideas
Buzz & Navigation Ideas
Charting Ideas
Charting product enhancement requests
Cloud Amplifier Ideas
Cloud Amplifier Product Enhancement Ideas
Code Engine Ideas
Code Engine Product Enhancement Ideas
Community ideas
Ideas or feedback for the Domo Community or the Community Forums.
Connectors Ideas
Connectors Product Enhancement Ideas
Dashboard Ideas
Dashboard Product Enhancement Ideas
Datasets Ideas
Datasets Produce Enhancement Ideas
Domo AI ideas
Domo AI Product Enhancement Ideas
Domo Bricks Ideas
Domo Bricks Product Enhancement Ideas
Domo Developer Ideas
Domo Developer Product Enhancement Ideas
Domo Everywhere Ideas
Domo Everywhere Product Enhancement Ideas
Federated Ideas
Federated Product Enhancement Ideas
Global Ideas
Product enhancement ideas for Domo as a whole
Governance & Security Ideas
Governance & Security Product Enhancement Ideas
Jupyter Workspaces Ideas
Jupyter Workspaces Product Enhancement Ideas
Localization ideas
Localization product enhancement ideas
Magic ETL Ideas
Magic ETL Product Enhancement Ideas
Mobile Ideas
Mobile Product Enhancement Ideas
Reporting Ideas
Reporting Product Enhancement Ideas
Sandbox Ideas
Product enhancement ideas for Sandbox
Software Integration Ideas
Software integrations product enhancement ideas
SQL Dataflows Ideas
SQL Dataflows Product Enhancement Ideas
Variables Ideas
Variables Product Enhancement Ideas
Workbench Ideas
Workbench Product Enhancement Ideas
Workflows Ideas
Workflows Product Enhancement Ideas
Other Ideas
Other Product Enhancement Ideas