Replacement Variables in Amazon Athena Connector Queries
Hi,
I am new to Domo and struggling with Append mode updates in the Amazon Athena JDBC 2.0 Connector.
I have managed to get a base query running to pull data out of Athena correctly.
Now, I am trying to parameterise the query to Athena to only append a subset of rows which have been added since the last time the query ran.
My understanding is that I should be able to use a WHERE clause like:
WHERE date_parse(SUBSTRING(timestamp, 1, 19), '%Y-%m-%dT%H:%i:%s') > !{lastvalue:timestampasdatetime}!
which I am hoping would look in the last row of the data already in the table and find the timestampasdatetime column of that row and then use that value in the where clause of the next query to the same Athena table.
However, this does not seem to work. It looks like the !{lastvalue:timestampasdatetime}! is not being replaced with a proper value before being sent to Athena.
Can anyone advise how I can make this work?
Thanks in advance,
Richard.
Comments
-
Hi @rhardy ,
Here's some more info on the append method - you'd probably want upsert enabled for this connector to achieve what you're looking for, as it's available for the connector: https://knowledge.domo.com/Connect/Managing_DataSets/DataSet_Update_Methods
Here is documentation on the Amazon Athena connector - https://knowledge.domo.com/Connect/Connecting_to_Data_with_Connectors/Configuring_Each_Connector/Database_Connectors/Amazon_Athena%2F%2FAmazon_Athena_JDBC_2.0_Connector
I hope this helps!
0
Categories
- All Categories
- 1.7K Product Ideas
- 1.7K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 295 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.8K Transform
- 97 SQL DataFlows
- 608 Datasets
- 2.1K Magic ETL
- 3.8K Visualize
- 2.4K Charting
- 710 Beast Mode
- 50 App Studio
- 39 Variables
- 668 Automate
- 170 Apps
- 446 APIs & Domo Developer
- 45 Workflows
- 7 DomoAI
- 33 Predict
- 13 Jupyter Workspaces
- 20 R & Python Tiles
- 391 Distribute
- 111 Domo Everywhere
- 274 Scheduled Reports
- 6 Software Integrations
- 116 Manage
- 113 Governance & Security
- Domo Community Gallery
- 31 Product Releases
- 9 Domo University
- 5.3K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 103 Community Announcements
- 4.8K Archive