Best practice for removing historical values

I have a snapshot dataflow that has captured bad values. I only need to filter out those values that don't match the current format. What is the best practice for this?
Best Answers
-
You can add multiple conditions to a filter tile, then there is the option of "all" or "any" of the rules to be true. Basically, logical "AND" or logical "OR". If it's more complex than that, you can create a "formula rule" within the filter tile. KB article about filter formula
0 -
Yep, you would do what @DavidChurchman said and set each of those 3 conditions as conditions in the filter with "Include rows that meet ALL of the following rules" set.
If I solved your problem, please "accept" my answer as the solution
1
Answers
-
Can you search for the rows that don't match the current format in a dynamic way? If so you could just apply a filter tile to the ETL to remove the rows that don't match. How do you identify the bad rows?
If I solved your problem, please "accept" my answer as the solution
0 -
@colemenwilson do you know the best way to utilize the filter formula tile to exclude multiple values? ex:
column1 != 'one'
column1 != 'two'
column1 != 'three'
Is there a way to do this in one formula?
0 -
You can add multiple conditions to a filter tile, then there is the option of "all" or "any" of the rules to be true. Basically, logical "AND" or logical "OR". If it's more complex than that, you can create a "formula rule" within the filter tile. KB article about filter formula
0 -
Yep, you would do what @DavidChurchman said and set each of those 3 conditions as conditions in the filter with "Include rows that meet ALL of the following rules" set.
If I solved your problem, please "accept" my answer as the solution
1
Categories
- All Categories
- 1.1K Product Ideas
- 1.1K Ideas Exchange
- 1.2K Connect
- 970 Connectors
- 259 Workbench
- Cloud Amplifier
- 1 Federated
- 2.4K Transform
- 76 SQL DataFlows
- 502 Datasets
- 1.8K Magic ETL
- 2.7K Visualize
- 2.2K Charting
- 379 Beast Mode
- 21 Variables
- 487 Automate
- 104 Apps
- 379 APIs & Domo Developer
- 6 Workflows
- 22 Predict
- 6 Jupyter Workspaces
- 16 R & Python Tiles
- 319 Distribute
- 67 Domo Everywhere
- 252 Scheduled Reports
- 59 Manage
- 59 Governance & Security
- 1 Product Release Questions
- 5K Community Forums
- 37 Getting Started
- 23 Community Member Introductions
- 64 Community Announcements
- 4.8K Archive