Recursive dataflow Issue - No Data

Hulachic5

Aloha All:

 

I have a recursive dataflow that is wiping out my start and end dates when the new data is uploaded.

 

Current data has the start and end dates; however, the historical data is missing the dates.  The dates were originally there in the initial upload.

 

My recursive has a join the new data and historical data.  Then I do an append to finish off the dataflow.

 

HELP... ;-).

 

 

GrantSmith

Hi @Hulachic5 

 

Are you utilizing Magic ETL 1.0 or 2.0?

 

A typical reason I've seen is that there's a difference in how Magic 2.0 compares NULL values to Magic 1.0.  Because of this if you're following the old instructions for Magic 1.0 on a Magic 2.0 DataFlow it can cause you to lose your historical dataset. You need to make sure your filter is using the correct logic (using a formula to compare to NULL instead of != 'Delete').

 

Magic ETL 2.0 documentation: https://knowledge.domo.com/Prepare/DataFlow_Tips_and_Tricks/Creating_a_Recursive%2F%2FSnapshot_DataFlow_in_Magic_ETL_v2_(Beta)

 

Magic ETL 1.0 documentation:

https://knowledge.domo.com/Prepare/DataFlow_Tips_and_Tricks/Creating_a_Recursive%2F%2FSnapshot_ETL_DataFlow