Magic ETL | Remove Duplicates Tile | Select all fields option
It would be good to have a "Select All Columns" option for the remove duplicates tile in magic
**Say 'Thanks' by clicking the thumbs up in the post that helped you.
**Please mark the post that solves your problem as 'Accepted Solution'
Comments
-
@Godiepi that's a pretty obscure use case that you'd expect full-on row duplication.
you could use MD5() hashing to concatenate all the values together and then use a RowNumber + rank_window tile then filter where rownumber = 1
this is a classic way of handling identifying slowly changing dimension rows.
Jae Wilson
Check out my 🎥 Domo Training YouTube Channel 👨💻
**Say "Thanks" by clicking the ❤️ in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"2 -
I'd love to see a "select all" option in the remove duplicates tile, sort of like the same button on Select Columns where it loads up all the fields but then you can go back still and remove the ones you don't need or care about.
I see plenty of cases where there's a junky input (wonky APIs, spreadsheets uploaded directly from hell with way to many columns, etc.) that needs a quick/easy button to cleanup/massage things before starting to explore the rows.
The downside is it could easily pick up a null column and with existing behavior, return a zero row output. Bonus feature if the dedupe could skip null columns from inspection.
1 -
I think this would be a good addition, even if it's just to speed up the adding of many columns to the tile. Instead of clicking individually 18 out of 20 rows, you could "select all" then remove the 2 you didn't want.
2 -
This is a good idea, and something I've heard a few times now. I will be reviewing with my team. I think it would also be nice to have this same feature on any tile where you have the option to select columns.
Domo Product Manager for Data Transformation (MagicETL)
1
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 296 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 614 Datasets
- 2.2K Magic ETL
- 3.8K Visualize
- 2.5K Charting
- 729 Beast Mode
- 53 App Studio
- 40 Variables
- 677 Automate
- 173 Apps
- 451 APIs & Domo Developer
- 45 Workflows
- 8 DomoAI
- 34 Predict
- 14 Jupyter Workspaces
- 20 R & Python Tiles
- 394 Distribute
- 113 Domo Everywhere
- 275 Scheduled Reports
- 6 Software Integrations
- 121 Manage
- 118 Governance & Security
- Domo Community Gallery
- 32 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive