Workbench Query Parameters
Is it possible to use query parameters in workbench?
Can the parameter receive it's value from a query on a domo dataset?
Here is what we are trying to do:
We have some large tables that we would like to refresh often. Currently they are uploaded using the Replace method.
We would like instead to use the Append method and push only data that is not yet in Domo.
Unfortuanly we have no way of tracking changes to our data from our side, however if we could get the MAX(Id) of one of the fields then it would be possible to know what to push.
The question is then: Can I query the Dataset in Domo first to get the MAX(Id) and use that in a paremeter in workbench to select our data where the Id > @parameter?
Thanks for the help!
Comments
-
Hey SamC,
It sounds like you would benefit from a recursive dataflow in this situation. It will update as an Append, only bringing in new values, and also update existing values that may have changed since the previous import.
If that sounds like something that would work for you, please check out the article for it here:
Thanks
Jarvis
0 -
Hi Jarvice,
Unfortunantly this is not possible given that we have now way of pushing only new values because there is no timestamp of any kind.
But due to the data size we would like to avoid uploading it everyday.
What would potentialy work is if workbench was able to first query the dataset to get the largest ID. Is that possible?
Thanks,
Sam
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 297 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 614 Datasets
- 2.2K Magic ETL
- 3.8K Visualize
- 2.5K Charting
- 729 Beast Mode
- 53 App Studio
- 40 Variables
- 677 Automate
- 173 Apps
- 451 APIs & Domo Developer
- 45 Workflows
- 8 DomoAI
- 34 Predict
- 14 Jupyter Workspaces
- 20 R & Python Tiles
- 394 Distribute
- 113 Domo Everywhere
- 275 Scheduled Reports
- 6 Software Integrations
- 121 Manage
- 118 Governance & Security
- Domo Community Gallery
- 32 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive