Dataset reference in Python by identifier instead of name

user17188 · 2023-07-13T12:23:53+00:00

There was an error rendering this rich post.

To identify input dataset by identifier instead of name, very useful for working with Python modules, as right now you need to update the source code when changing a name.

Find more posts tagged with

Python

Submitted and awaiting review from product team

Status: Submitted and awaiting review from product team

Quick Links

Comments

timehat

Is this within the Python tile in MagicETL or when using Jupyter? (Or some other python integration?)

user17188

Python tile.

KrunalLathiya

Whether you can identify an input dataset by identifier instead of name largely depends on the capabilities and features of the Python integration within your specific ETL tool or data platform.

In MagicETL: If you are working within the Python tile in MagicETL, you would need to check if MagicETL allows dataset referencing by identifiers (like unique IDs or keys) instead of names. This feature might be available in the tool's documentation or you might need to explore the tool's interface to see if datasets can be referenced by properties other than their names.
In Jupyter or Other Python Integrations: If you are working in a Jupyter notebook or another Python integration within the platform, you typically have more flexibility. Python scripts can be written to accept parameters or read configuration files, allowing you to change input datasets without modifying the source code. This approach requires setting up your Python environment to dynamically accept dataset identifiers, which can be passed as arguments or read from an external configuration.

In both cases, it's beneficial to consult the specific documentation of your ETL tool or data platform to understand the best practices for handling dataset references. If the tool supports API access or external configuration files, these can be utilized to make your ETL processes more dynamic and less dependent on hard-coded values."

Idea Categories

Alerts ideas
Alerts Product Enhancement Ideas
Analyzer Ideas
Analyzer Product Enhancement Ideas
APIs Ideas
API Product Enhancement Ideas
Apps Ideas
Apps Product Enhancement Ideas
Appstore Experience ideas
Appstore product enhancement ideas
App Studio Ideas
App Studio Product Enhancement Ideas
Beast Mode Ideas
Beast Mode Product Enhancement Ideas
Buzz & Navigation Ideas
Buzz & Navigation Ideas
Charting Ideas
Charting product enhancement requests
Cloud Amplifier Ideas
Cloud Amplifier Product Enhancement Ideas
Code Engine Ideas
Code Engine Product Enhancement Ideas
Community ideas
Ideas or feedback for the Domo Community or the Community Forums.
Connectors Ideas
Connectors Product Enhancement Ideas
Dashboard Ideas
Dashboard Product Enhancement Ideas
Datasets Ideas
Datasets Produce Enhancement Ideas
Domo AI ideas
Domo AI Product Enhancement Ideas
Domo Bricks Ideas
Domo Bricks Product Enhancement Ideas
Domo Developer Ideas
Domo Developer Product Enhancement Ideas
Domo Everywhere Ideas
Domo Everywhere Product Enhancement Ideas
Federated Ideas
Federated Product Enhancement Ideas
Global Ideas
Product enhancement ideas for Domo as a whole
Governance & Security Ideas
Governance & Security Product Enhancement Ideas
Jupyter Workspaces Ideas
Jupyter Workspaces Product Enhancement Ideas
Localization ideas
Localization product enhancement ideas
Magic ETL Ideas
Magic ETL Product Enhancement Ideas
Mobile Ideas
Mobile Product Enhancement Ideas
Reporting Ideas
Reporting Product Enhancement Ideas
Sandbox Ideas
Product enhancement ideas for Sandbox
Software Integration Ideas
Software integrations product enhancement ideas
SQL Dataflows Ideas
SQL Dataflows Product Enhancement Ideas
Variables Ideas
Variables Product Enhancement Ideas
Workbench Ideas
Workbench Product Enhancement Ideas
Workflows Ideas
Workflows Product Enhancement Ideas
Other Ideas
Other Product Enhancement Ideas