using Domo API and partition

mroker
mroker Member
in Magic ETL

Currently i want to append data using the API append method. However, i also want to update the last 2 days 2 a dataset on a cron job so that i do not miss a day. I know partitioning would only keep the unique record. Is it best to use recursion or partitioning for this?

Tagged:

Best Answer

  • GrantSmith
    GrantSmith Coach
    Answer ✓

    If you're pulling in Daily data and don't need to keep more than 3 years of data partitioning would be easiest for you to utilize.

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**

Answers

  • GrantSmith
    GrantSmith Coach
    Answer ✓

    If you're pulling in Daily data and don't need to keep more than 3 years of data partitioning would be easiest for you to utilize.

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • mroker
    mroker Member
    https://community-forums.domo.com/main/discussion/comment/89095#Comment_89095

    Ok, so the data is 500k rows for 1 day. For Domo, would this be considered too much to keep? Or should this be summarized? I really want to keep as close to original data as possible.

  • GrantSmith
    GrantSmith Coach

    Nope, this should be just fine.

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**

Categories