Where is my data going??

ljb18

My data seems to be disappearing between the ETL and the final data that it actually outputs. Here are some pictures to try to explain what's happening. The first image shows the preview on the final tile in the workflow (being the output file titled Work Numbers (Final)). The second image shows the same chunk of data, using that same output and examining the data with "Views Explorer."

Where did my data go? Absolutely NOTHING changed between these two steps. It's driving me crazy that it's seemingly there, but then disappears, thus preventing me from being able to use it at all.

ColemenWilson

In MagicETL you are only previewing 100 rows. I see in the second image that there are 1,737 unique values for the BMI Work Number in your final output data. It appears that the data is there and that there are also null values for that field.

ColemenWilson

In MagicETL you are only previewing 100 rows. I see in the second image that there are 1,737 unique values for the BMI Work Number in your final output data. It appears that the data is there and that there are also null values for that field.

ljb18

I understand that there's more data that isn't shown in the preview, but that doesn't really answer the question because I'm looking at the exact same chunk of data in both screenshots. If I filter just for the track title names that I'm showing in the preview section, it still shows all that data erased. There is nowhere in my entire data set where "TRACK TITLE: With Version" with a value of "Grits 'n Gravy" has a "BMI Work Number" of "51911889" outside of the preview. So I don't understand where it's going.

ljb18

Actually I increased it to 400k and now it's showing it as null lol… I'm not really sure what's going on. I'm going to take a deeper look into the data. Sorry, looks like I don't understand how the preview works and you were probably right 😅