Using Replacement Variable with sql query on workbench
I am trying to use replacement variable with my sql query to append data. I have table in database with about 16 million rows and thus a full replace would not be feasible. I have already referred to KB documentation and my sql query is a select statement with the column name in the where clause as well as order by clause. I have the following mentioned under "Replacement Variable" tab. Column: id and value: !{lastvalue:id}!
I have followed the following steps:
- used select statement (SELECT id, name, source, dateAdded FROM tablename)
- under the Replacement tab (Column: id and value: !{lastvalue:id}!
- Update method Replace.
- When I execute this job I am receiving the following message "Replacing last value query parameter at position 1341.
Can someone help me understand what am I missing here.
Best Answer
-
it looks like you're not using the replacement variable in your SQL statement it should look like this:
SELECT id, name, source, dateAdded FROM tablename WHERE id > !{lastvalue:id}! ORDER BY id ASC
and then make sure to seed your replacement variable with an id that you would like to start importing with, then once it runs successfully your value will be updated with the last value that you imported.
https://domo-support.domo.com/s/article/360042932734?language=en_US
1
Answers
-
it looks like you're not using the replacement variable in your SQL statement it should look like this:
SELECT id, name, source, dateAdded FROM tablename WHERE id > !{lastvalue:id}! ORDER BY id ASC
and then make sure to seed your replacement variable with an id that you would like to start importing with, then once it runs successfully your value will be updated with the last value that you imported.
https://domo-support.domo.com/s/article/360042932734?language=en_US
1 -
Thank You! I missed to seed the replacement variable with id. I was able to resolve this issue by adding a value to the replacement variable.
1
Categories
- All Categories
- 2K Product Ideas
- 2K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 311 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 3.8K Transform
- 657 Datasets
- 115 SQL DataFlows
- 2.2K Magic ETL
- 815 Beast Mode
- 3.3K Visualize
- 2.5K Charting
- 81 App Studio
- 45 Variables
- 775 Automate
- 190 Apps
- 481 APIs & Domo Developer
- 81 Workflows
- 23 Code Engine
- 40 AI and Machine Learning
- 20 AI Chat
- 1 AI Playground
- 1 AI Projects and Models
- 18 Jupyter Workspaces
- 410 Distribute
- 120 Domo Everywhere
- 280 Scheduled Reports
- 10 Software Integrations
- 144 Manage
- 140 Governance & Security
- 8 Domo Community Gallery
- 48 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 114 Community Announcements
- 4.8K Archive