Append data issue using CSV upload
Hi All,
I'm uploading CSV file via workbench and I have scheduled every four hours. I'm getting all the records without any update. My requirement is to get all the records which are not present and which are present those records to be updated. But, what is happening is records which are present are not updating but adding an additional row. Please help with this. Thanks
Comments
-
Arav,
It sounds like what you need to do is run your file through a dataflow to remove duplicate rows every time it is uploaded and/or perhaps do a mysql transformation to tell it to keep only the most recent records in cases where there has been an update.
I hope that helps!
0 -
Hi User,
Thanks for the reply. Is there a way to use merge while uploading CSV file in the workbench. So, that it can search for already existing records and replace with new records. Also, using your solution, may I know exactly what is the process to follow?? Thanks.
0 -
I am not sure I understand what your are trying to do. Does the CSV file uploaded every 4 hours contain all records since the beggining of time or is there new data evety 4 hours? If you can elaborate I might be able to give you a simpler solution than below.
Use the info in the thread below to generate an appeding CSV dataset that will delete all duplicated rows
0
Categories
- All Categories
- 1.7K Product Ideas
- 1.7K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 295 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.8K Transform
- 98 SQL DataFlows
- 608 Datasets
- 2.1K Magic ETL
- 3.8K Visualize
- 2.5K Charting
- 713 Beast Mode
- 50 App Studio
- 39 Variables
- 669 Automate
- 170 Apps
- 447 APIs & Domo Developer
- 45 Workflows
- 7 DomoAI
- 34 Predict
- 14 Jupyter Workspaces
- 20 R & Python Tiles
- 391 Distribute
- 111 Domo Everywhere
- 274 Scheduled Reports
- 6 Software Integrations
- 116 Manage
- 113 Governance & Security
- Domo Community Gallery
- 31 Product Releases
- 9 Domo University
- 5.3K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 104 Community Announcements
- 4.8K Archive