Pydomo Stream API upload_part skipping files?
I am using pydomo to upload several gzipped files in parallel. (These gzipped csv files are parts of one large SQL table, broken approximately evenly.) However, once the execution is commited, there seems to be fewer rows than the original table. The difference in the number of rows seems to amount to the number of rows in one of the files meant to be uploaded.
Just like in the stream api example, I create an stream, I create an execution for that stream, and I use streams.upload_part() with the created stream and execution. Is there a way to return the status of streams.upload_part(), so that I know which files have failed?
Thanks!
Comments
-
Not sure abut the issue specifically, but our company open sourced a python script we wrote to use the streaming API. Maybe there's some useful code in there, or feel free to use it as is.
0
Categories
- All Categories
- 1.4K Product Ideas
- 1.4K Ideas Exchange
- 1.4K Connect
- 1.1K Connectors
- 278 Workbench
- 4 Cloud Amplifier
- 4 Federated
- 2.7K Transform
- 89 SQL DataFlows
- 557 Datasets
- 2K Magic ETL
- 3.3K Visualize
- 2.3K Charting
- 571 Beast Mode
- 11 App Studio
- 27 Variables
- 579 Automate
- 141 Apps
- 414 APIs & Domo Developer
- 23 Workflows
- 1 DomoAI
- 28 Predict
- 12 Jupyter Workspaces
- 16 R & Python Tiles
- 352 Distribute
- 92 Domo Everywhere
- 258 Scheduled Reports
- 2 Software Integrations
- 92 Manage
- 89 Governance & Security
- 9 Product Release Questions
- Community Forums
- 42 Getting Started
- 28 Community Member Introductions
- 86 Community Announcements
- 4.8K Archive