How to create a recursive dataflow with multiple unique dimensions?

Stephanie_Price · 2024-01-18T22:09:32+00:00

There was an error rendering this rich post.

I am working with a dataset now that several unique components, including date. Within a given day, there are about 12-15 new records produced based on these dimensions.

I tried creating a unique identifier that concatenates these dimensions (including date) with the hopes of creating a unique ID that will distinguish old data vs new data; however, the field is too long and as a result is truncated.

Attached is an example of what the data looks like everyday.

Has anyone else run into this/have solutions to this?

Thank you!

Find more posts tagged with

Dataset

Data Flows

Accepted answers

GrantSmith

Are you attempting to utilize a single field in your recursive dataflow join for your key field? You should be able to select multiple key columns which uniquely identify each record. Just make sure you're joining on all of your key columns in the join

All comments

GrantSmith

Stephanie_Price

Thank you @GrantSmith