Using Replacement Variable with sql query on workbench
I am trying to use replacement variable with my sql query to append data. I have table in database with about 16 million rows and thus a full replace would not be feasible. I have already referred to KB documentation and my sql query is a select statement with the column name in the where clause as well as order by clause. I have the following mentioned under "Replacement Variable" tab. Column: id and value: !{lastvalue:id}!
I have followed the following steps:
- used select statement (SELECT id, name, source, dateAdded FROM tablename)
- under the Replacement tab (Column: id and value: !{lastvalue:id}!
- Update method Replace.
- When I execute this job I am receiving the following message "Replacing last value query parameter at position 1341.
Can someone help me understand what am I missing here.
Best Answer
-
it looks like you're not using the replacement variable in your SQL statement it should look like this:
SELECT id, name, source, dateAdded FROM tablename WHERE id > !{lastvalue:id}! ORDER BY id ASC
and then make sure to seed your replacement variable with an id that you would like to start importing with, then once it runs successfully your value will be updated with the last value that you imported.
https://domo-support.domo.com/s/article/360042932734?language=en_US
1
Answers
-
it looks like you're not using the replacement variable in your SQL statement it should look like this:
SELECT id, name, source, dateAdded FROM tablename WHERE id > !{lastvalue:id}! ORDER BY id ASC
and then make sure to seed your replacement variable with an id that you would like to start importing with, then once it runs successfully your value will be updated with the last value that you imported.
https://domo-support.domo.com/s/article/360042932734?language=en_US
1 -
Thank You! I missed to seed the replacement variable with id. I was able to resolve this issue by adding a value to the replacement variable.
1
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 101 SQL DataFlows
- 622 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 747 Beast Mode
- 59 App Studio
- 41 Variables
- 686 Automate
- 176 Apps
- 453 APIs & Domo Developer
- 47 Workflows
- 10 DomoAI
- 36 Predict
- 15 Jupyter Workspaces
- 21 R & Python Tiles
- 395 Distribute
- 113 Domo Everywhere
- 276 Scheduled Reports
- 6 Software Integrations
- 125 Manage
- 122 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 109 Community Announcements
- 4.8K Archive