Using Replacement Variable with sql query on workbench
I am trying to use replacement variable with my sql query to append data. I have table in database with about 16 million rows and thus a full replace would not be feasible. I have already referred to KB documentation and my sql query is a select statement with the column name in the where clause as well as order by clause. I have the following mentioned under "Replacement Variable" tab. Column: id and value: !{lastvalue:id}!
I have followed the following steps:
- used select statement (SELECT id, name, source, dateAdded FROM tablename)
- under the Replacement tab (Column: id and value: !{lastvalue:id}!
- Update method Replace.
- When I execute this job I am receiving the following message "Replacing last value query parameter at position 1341.
Can someone help me understand what am I missing here.
Best Answer
-
it looks like you're not using the replacement variable in your SQL statement it should look like this:
SELECT id, name, source, dateAdded FROM tablename WHERE id > !{lastvalue:id}! ORDER BY id ASC
and then make sure to seed your replacement variable with an id that you would like to start importing with, then once it runs successfully your value will be updated with the last value that you imported.
https://domo-support.domo.com/s/article/360042932734?language=en_US
1
Answers
-
it looks like you're not using the replacement variable in your SQL statement it should look like this:
SELECT id, name, source, dateAdded FROM tablename WHERE id > !{lastvalue:id}! ORDER BY id ASC
and then make sure to seed your replacement variable with an id that you would like to start importing with, then once it runs successfully your value will be updated with the last value that you imported.
https://domo-support.domo.com/s/article/360042932734?language=en_US
1 -
Thank You! I missed to seed the replacement variable with id. I was able to resolve this issue by adding a value to the replacement variable.
1
Categories
- All Categories
- 1.9K Product Ideas
- 1.9K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 305 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 3K Transform
- 111 SQL DataFlows
- 649 Datasets
- 2.2K Magic ETL
- 4K Visualize
- 2.5K Charting
- 777 Beast Mode
- 75 App Studio
- 43 Variables
- 735 Automate
- 186 Apps
- 471 APIs & Domo Developer
- 64 Workflows
- 14 DomoAI
- 40 Predict
- 17 Jupyter Workspaces
- 23 R & Python Tiles
- 405 Distribute
- 117 Domo Everywhere
- 278 Scheduled Reports
- 10 Software Integrations
- 138 Manage
- 135 Governance & Security
- 8 Domo Community Gallery
- 44 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 113 Community Announcements
- 4.8K Archive