How to append monthly data?

eriena · 2022-01-05T20:50:52+00:00

There was an error rendering this rich post.

Hello,

Please let me ask how to append monthly data to accumulated data.

I want to append monthly data using DataSet via Email Connector on the accumulated data from January to April.

For example, I upload May data by using email connector in May, the output dataset will be for January-May data.

However, after that I upload the June data by email in June, the output data will be the Jan-Apr and June Datasets. Obviously, the data for May will be lost.

How can I append monthly data?

I thought that it could be solved by Appending Update mode in DataSet via Email Connector, but it seemed that DataSet via Email Connector can't set append.

Thank you.

Find more posts tagged with

Accepted answers

GrantSmith

Hi @eriena

You'll want to utilize a recursive dataflow. The knowledge base has several different articles on how to do this. Here's the Magic ETL version:

https://domohelp.domo.com/hc/en-us/articles/360057087393-Creating-a-Recursive-Snapshot-DataFlow-in-the-New-Magic-ETL

MarkSnodgrass

the dataset via e-mail connector does have an update mode of append, but it can be challenging if you are toggling back and forth and not lose what is currently stored.

I might suggest a recursive dataflow. Here is the KB article on how to create it in Magic ETL.

https://domohelp.domo.com/hc/en-us/articles/360057087393-Creating-a-Recursive-Snapshot-DataFlow-in-the-New-Magic-ETL

All comments

GrantSmith

Hi @eriena

You'll want to utilize a recursive dataflow. The knowledge base has several different articles on how to do this. Here's the Magic ETL version:

https://domohelp.domo.com/hc/en-us/articles/360057087393-Creating-a-Recursive-Snapshot-DataFlow-in-the-New-Magic-ETL

MarkSnodgrass

the dataset via e-mail connector does have an update mode of append, but it can be challenging if you are toggling back and forth and not lose what is currently stored.

I might suggest a recursive dataflow. Here is the KB article on how to create it in Magic ETL.

https://domohelp.domo.com/hc/en-us/articles/360057087393-Creating-a-Recursive-Snapshot-DataFlow-in-the-New-Magic-ETL

eriena

@GrantSmith

@MarkSnodgrass

Thank you so much for sharing the article. I will read the article.

eriena

Hello,

@GrantSmith

@MarkSnodgrass

I could solve my issue.

Thank you so much for your advise.