Dataset reference in Python by identifier instead of name
To identify input dataset by identifier instead of name, very useful for working with Python modules, as right now you need to update the source code when changing a name.
Comments
-
Is this within the Python tile in MagicETL or when using Jupyter? (Or some other python integration?)
0 -
Python tile.
0 -
Whether you can identify an input dataset by identifier instead of name largely depends on the capabilities and features of the Python integration within your specific ETL tool or data platform.
- In MagicETL: If you are working within the Python tile in MagicETL, you would need to check if MagicETL allows dataset referencing by identifiers (like unique IDs or keys) instead of names. This feature might be available in the tool's documentation or you might need to explore the tool's interface to see if datasets can be referenced by properties other than their names.
- In Jupyter or Other Python Integrations: If you are working in a Jupyter notebook or another Python integration within the platform, you typically have more flexibility. Python scripts can be written to accept parameters or read configuration files, allowing you to change input datasets without modifying the source code. This approach requires setting up your Python environment to dynamically accept dataset identifiers, which can be passed as arguments or read from an external configuration.
In both cases, it's beneficial to consult the specific documentation of your ETL tool or data platform to understand the best practices for handling dataset references. If the tool supports API access or external configuration files, these can be utilized to make your ETL processes more dynamic and less dependent on hard-coded values."
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 297 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 614 Datasets
- 2.2K Magic ETL
- 3.8K Visualize
- 2.5K Charting
- 729 Beast Mode
- 53 App Studio
- 40 Variables
- 677 Automate
- 173 Apps
- 451 APIs & Domo Developer
- 45 Workflows
- 8 DomoAI
- 34 Predict
- 14 Jupyter Workspaces
- 20 R & Python Tiles
- 394 Distribute
- 113 Domo Everywhere
- 275 Scheduled Reports
- 6 Software Integrations
- 121 Manage
- 118 Governance & Security
- Domo Community Gallery
- 32 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive