Pydomo Stream API upload_part skipping files?

user16307

I am using pydomo to upload several gzipped files in parallel. (These gzipped csv files are parts of one large SQL table, broken approximately evenly.) However, once the execution is commited, there seems to be fewer rows than the original table. The difference in the number of rows seems to amount to the number of rows in one of the files meant to be uploaded. 

 

Just like in the stream api example, I create an stream, I create an execution for that stream, and I use streams.upload_part() with the created stream and execution. Is there a way to return the status of streams.upload_part(), so that I know which files have failed?

 

Thanks!

 

 

Unknown

Not sure abut the issue specifically, but our company open sourced a python script we wrote to use the streaming API. Maybe there's some useful code in there, or feel free to use it as is.

 

https://github.com/BlueBikeSolutions/domo-stream-uploader