Pydomo Stream API upload_part skipping files?
I am using pydomo to upload several gzipped files in parallel. (These gzipped csv files are parts of one large SQL table, broken approximately evenly.) However, once the execution is commited, there seems to be fewer rows than the original table. The difference in the number of rows seems to amount to the number of rows in one of the files meant to be uploaded.
Just like in the stream api example, I create an stream, I create an execution for that stream, and I use streams.upload_part() with the created stream and execution. Is there a way to return the status of streams.upload_part(), so that I know which files have failed?
Thanks!
Comments
-
Not sure abut the issue specifically, but our company open sourced a python script we wrote to use the streaming API. Maybe there's some useful code in there, or feel free to use it as is.
0
Categories
- All Categories
- 1.4K Product Ideas
- 1.4K Ideas Exchange
- 1.4K Connect
- 1.1K Connectors
- 282 Workbench
- 3 Cloud Amplifier
- 4 Federated
- 2.8K Transform
- 86 SQL DataFlows
- 548 Datasets
- 2.2K Magic ETL
- 3.2K Visualize
- 2.3K Charting
- 542 Beast Mode
- App Studio
- 26 Variables
- 566 Automate
- 134 Apps
- 411 APIs & Domo Developer
- 21 Workflows
- DomoAI
- 28 Predict
- 12 Jupyter Workspaces
- 16 R & Python Tiles
- 344 Distribute
- 86 Domo Everywhere
- 257 Scheduled Reports
- 1 Software Integrations
- 85 Manage
- 84 Governance & Security
- 6 Product Release Questions
- Community Forums
- 41 Getting Started
- 27 Community Member Introductions
- 81 Community Announcements
- 4.8K Archive