S3 Connector - Copy Command
Hello,
I'm here to ask you if it possible somehow to solve the following scenario.
In an external S3 bucket I have hundreds of files for a single table (one file per each day, that is how we partition the table).
The first question I want to ask is: it is possible to import this table by performing something similar to a copy command? I have been trying to use the S3 Advanced Connectors, but I don't think the logic behind the connector is this one because it is taking a lot of time to load, as if it was parsing the json and not simply moving files.
Second question, that is based on the first, is the following: every day we update the table by deleting the last 7 files (that is, the last 7 days) and adding new 7 files containing updated data. Would it be possible to replicate the behavior on Domo, either by just deleting all files and moving them all back to Domo or by just doing this with the last 7 files?
Thanks in advance
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 102 SQL DataFlows
- 626 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 753 Beast Mode
- 61 App Studio
- 41 Variables
- 692 Automate
- 177 Apps
- 456 APIs & Domo Developer
- 49 Workflows
- 10 DomoAI
- 38 Predict
- 16 Jupyter Workspaces
- 22 R & Python Tiles
- 398 Distribute
- 115 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 130 Manage
- 127 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 11 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 110 Community Announcements
- 4.8K Archive