Append data issue using CSV upload
Hi All,
I'm uploading CSV file via workbench and I have scheduled every four hours. I'm getting all the records without any update. My requirement is to get all the records which are not present and which are present those records to be updated. But, what is happening is records which are present are not updating but adding an additional row. Please help with this. Thanks
Comments
-
Arav,
It sounds like what you need to do is run your file through a dataflow to remove duplicate rows every time it is uploaded and/or perhaps do a mysql transformation to tell it to keep only the most recent records in cases where there has been an update.
I hope that helps!
0 -
Hi User,
Thanks for the reply. Is there a way to use merge while uploading CSV file in the workbench. So, that it can search for already existing records and replace with new records. Also, using your solution, may I know exactly what is the process to follow?? Thanks.
0 -
I am not sure I understand what your are trying to do. Does the CSV file uploaded every 4 hours contain all records since the beggining of time or is there new data evety 4 hours? If you can elaborate I might be able to give you a simpler solution than below.
Use the info in the thread below to generate an appeding CSV dataset that will delete all duplicated rows
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 297 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 614 Datasets
- 2.2K Magic ETL
- 3.8K Visualize
- 2.5K Charting
- 729 Beast Mode
- 53 App Studio
- 40 Variables
- 677 Automate
- 173 Apps
- 451 APIs & Domo Developer
- 45 Workflows
- 8 DomoAI
- 34 Predict
- 14 Jupyter Workspaces
- 20 R & Python Tiles
- 394 Distribute
- 113 Domo Everywhere
- 275 Scheduled Reports
- 6 Software Integrations
- 121 Manage
- 118 Governance & Security
- Domo Community Gallery
- 32 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive