Recursive dataflow Issue - No Data

Hulachic5 · December 2020

Aloha All:

I have a recursive dataflow that is wiping out my start and end dates when the new data is uploaded.

Current data has the start and end dates; however, the historical data is missing the dates. The dates were originally there in the initial upload.

My recursive has a join the new data and historical data. Then I do an append to finish off the dataflow.

HELP... ;-).

GrantSmith · December 2020

Hi @Hulachic5

Are you utilizing Magic ETL 1.0 or 2.0?

A typical reason I've seen is that there's a difference in how Magic 2.0 compares NULL values to Magic 1.0. Because of this if you're following the old instructions for Magic 1.0 on a Magic 2.0 DataFlow it can cause you to lose your historical dataset. You need to make sure your filter is using the correct logic (using a formula to compare to NULL instead of != 'Delete').

Magic ETL 2.0 documentation: https://knowledge.domo.com/Prepare/DataFlow_Tips_and_Tricks/Creating_a_Recursive%2F%2FSnapshot_DataFlow_in_Magic_ETL_v2_(Beta)

Magic ETL 1.0 documentation:

https://knowledge.domo.com/Prepare/DataFlow_Tips_and_Tricks/Creating_a_Recursive%2F%2FSnapshot_ETL_DataFlow

Recursive dataflow Issue - No Data

Comments

Categories