Remove duplicate sites that have different 'operators'

Hello, I have a large list of sites where there are multiple duplicates of the same 'Site Address'. I can't just use the 'Remove Duplicates' tile in ETL as there can be multiple panels on one site.
I'm looking to sort the sites using the 'Latest update' date field. Then I'd like to remove sites that have the same address but with a different 'Operator'. This would leave me with a list of sites that are In Charge.
Best Answers
-
If I'm understanding correctly, I'd do a group by tile by Site, find the MAX(Latest Updated) and then do an inner join back on Site and MAX(Latest Updated) = LatestUpdated to only get the most recent rows per site.
0 -
Can you use 2 criteria for your remove duplicates tile: 'Site Address' and 'Panel'?
If not, you can use the Rank & Window tile and choose 'Latest Update' as the order and set 'Site Address' as the partition - here again you can use multiple fields if needed.
Next use a filter tile to only keep rows with the rank value you want to keep, presumably those with a rank of 1.If I solved your problem, please "accept" my answer as the solution
0
Answers
-
If I'm understanding correctly, I'd do a group by tile by Site, find the MAX(Latest Updated) and then do an inner join back on Site and MAX(Latest Updated) = LatestUpdated to only get the most recent rows per site.
0 -
Can you use 2 criteria for your remove duplicates tile: 'Site Address' and 'Panel'?
If not, you can use the Rank & Window tile and choose 'Latest Update' as the order and set 'Site Address' as the partition - here again you can use multiple fields if needed.
Next use a filter tile to only keep rows with the rank value you want to keep, presumably those with a rank of 1.If I solved your problem, please "accept" my answer as the solution
0
Categories
- All Categories
- 1.1K Product Ideas
- 1.1K Ideas Exchange
- 1.2K Connect
- 969 Connectors
- 257 Workbench
- Cloud Amplifier
- 1 Federated
- 2.4K Transform
- 76 SQL DataFlows
- 501 Datasets
- 1.8K Magic ETL
- 2.7K Visualize
- 2.2K Charting
- 375 Beast Mode
- 20 Variables
- 485 Automate
- 103 Apps
- 378 APIs & Domo Developer
- 6 Workflows
- 22 Predict
- 6 Jupyter Workspaces
- 16 R & Python Tiles
- 316 Distribute
- 64 Domo Everywhere
- 252 Scheduled Reports
- 59 Manage
- 59 Governance & Security
- 1 Product Release Questions
- 5K Community Forums
- 37 Getting Started
- 23 Community Member Introductions
- 63 Community Announcements
- 4.8K Archive