PyDomo - DS_Update to Append Data?

andrew10196

Hello all,

I've written a script that ideally will create a datastream into Domo. At the moment though, I'm struggling to find a way to replace the update method of ds_update() from PyDomo. The default appears to be replacing the data, but I need to append the dataset.

Does anyone have any experience with this? Any help would be greatly appreciated? Thanks!

GrantSmith

pydomo/ds_update doesn't support append at this time. You could configure a recursive dataflow to append your data.

taylordomo

@andrew10196 I'm not 100% sure if this solves your problem but here is an example function that seems to work for me via domo.streams

def append_domo_dataset(domo, stream_id, part, csv):


    streams = domo.streams 
    
    # update method needs to be either 'REPLACE' or 'APPEND'
    execution = streams.create_execution(stream_id, update_method='APPEND')
    execution_id = execution['id']
    print('Created execution id number', execution_id, 'with update method', execution['updateMethod'])
    
    print('getting execution')
    retrieved_execution = streams.get_execution(stream_id, execution_id)
    print('Retrieved execution with id', retrieved_execution['id'])


    execution = streams.upload_part(stream_id, execution_id, part, csv)
    print('Uploaded part')


    committed_execution = streams.commit_execution(stream_id, execution_id)
    print('committed execution', committed_execution['id'])


    return stream_id, execution['id'], retrieved_execution['id'], committed_execution['id']

JuanRoaRojas

I need to do the same, the problem with "streams" is the data fortma must be CVS format, I would like to send a dataframe.

this method works but it can obly replace, dont allow the parrameter "update_method"

domo.ds_update(dataset_id,dataframe)