Effect of adding new column to imported data on an existing dataset/dataflow
Good afternoon! Not sure if I'm using the correct search terms but we haven't been able to find anything related to this question by one of our managers, and before changing anything we wanted to confirm whether or not it would cause any dataset/dataflow or card issues.
We currently upload a file to Box each week, which is then imported into a dataset that's converted to a dataflow (certain columns not being used are removed, that's all), & then joined with another dataflow that serves as the final dataflow for cards.
Would adding a column to the original Box file that's NOT going to be used in any of the dataflows cause issues, or will it be fine since it's not being pulled utilized (basically, it's going to be imported into the dataset, nothing further)? We're trying to eliminate as much manual manipulation for uploads to Box where an API is not available.
If you need anything further to assist on this, please don't hesitate to ask! And as always, thanks for your time and any assistance/information you can provide!
Best Answer
-
I haven't tested this specifically with a Box dataset. However, we do this quite often with ODBC datasources in our environment. It has yet to cause any issues on our end with cards/dataflows. If we need the newly added columns, it's a matter of opening the dataflows and adding those columns where needed.
Hope that helps,
ValiantSpur
3
Answers
-
I haven't tested this specifically with a Box dataset. However, we do this quite often with ODBC datasources in our environment. It has yet to cause any issues on our end with cards/dataflows. If we need the newly added columns, it's a matter of opening the dataflows and adding those columns where needed.
Hope that helps,
ValiantSpur
3 -
Thanks, @Valiant, appreciate your reply! Obviously, we can download the existing Box file and attempt to add the column to see what, if anything, happens and revert back if there are issues so I think we'll give it a shot based on your experience with regards to ODBC datasets. As always, thanks for your assistance and clarification!
1 -
@John-Peddle You're very welcome. Glad I could help!
1 -
I use Box religiously, and have not had any issues when input files have additional fields.
As @Valiant says, even if you want to use those fields, the update to the dataflow is quick and easy.
If you have datasets with formats that might change, it would be wise to build in a QC mechanism which will alert you if the input columns do change, even though they don't cause an issue. It can be as simple as verifying the number of columns which upload. I also sometimes include QC outputs in my dataflows so that I can check in and make sure everything is ship shape.
DataMaven
Breaking Down Silos - Building Bridges
**Say "Thanks" by clicking a reaction in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 101 SQL DataFlows
- 622 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 748 Beast Mode
- 59 App Studio
- 41 Variables
- 686 Automate
- 176 Apps
- 453 APIs & Domo Developer
- 47 Workflows
- 10 DomoAI
- 36 Predict
- 15 Jupyter Workspaces
- 21 R & Python Tiles
- 396 Distribute
- 113 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 125 Manage
- 122 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 109 Community Announcements
- 4.8K Archive