Magic ETL Ideas

Magic ETL Ideas

Dataflow or View Query to run AFTER user filter pages

Member
edited August 2023 in Magic ETL Ideas

Sometimes it can be really difficult to build an end dataset that will be able to calculate the metrics that my users care about on the fly in a beastmode. For example:

image.png

This contains 3 different fixed functions so that I can show a certain metric dynamically to the user. Because of the high computation (mixed with a big dataset powering it), I get the following error:

image.png

I know that the way around this is that we can create a dynamic view of our main dataset based on whatever the user filters instead of housing it in a beastmode. Or even having it trigger an ETL. I know that a lot of ETL's take time to process, but there's got to be someway we can fix problems like this.

1
1 votes

Active · Last Updated

Welcome!

It looks like you're new here. Members get access to exclusive content, events, rewards, and more. Sign in or register to get started.
Sign In