Datasets Ideas

Datasets Ideas

Dataset Groups

I would love to see a more organized way to group datasets together and limit the number of datasets that are in view during a search. We have too many datasets with similar names and it gets difficult to find them sometimes unless you remember and search the full name.

Tagged:
2
2 votes

Active · Last Updated

Comments

  • I build "core" ETL datasets, that I then call within other ETLs.

    Many of our datasets come through API calls. I need to join labels to the identifiers for them to make more sense or to standardize name. Such as insurance company ids that we want to have common labels. So I will build out the base ETLs so they become reusable.

    If my dataset is part of a raw API call, I add something like "jsn" to the name. If the dataset is an ETL flow, I add "df" for data flow.

    I also use filter "tags" to identify groups to review. For example…all the scheduled API calls that run have a tag called "schedule". If I want to review those to make sure everything ran that day, I simply pull up the tag list for "schedule"

    image.png

    ** Was this post helpful? Click Agree or Like below. **
    ** Did this solve your problem? Accept it as a solution! **

  • I agree with @ArborRose, using tags and standardizing your dataset names can help with this.

Welcome!

It looks like you're new here. Members get access to exclusive content, events, rewards, and more. Sign in or register to get started.
Sign In