Connect to SFTP - Select ALL files in root directory
Hello, I'm here to ask you if there is any possibility with the built-in connectors to connect to an SFTP server and get the data coming from ALL .csv files in the root directory (supposing all files have the same schema).
This is because I'm receiving new files on a daily/weekly basis and I would definitely want to automatize the process of importing them to Domo.
If (as I think) this is not doable, do you think it is possible to create a custom connector for doing this? If so, how can I connect through SFTP in javascript?
Comments
-
Hi @usergru
It's not possible with the SFTP connector however have you thought about utilizing workbench, scheduling an SFTP sync to download files in the folder to a DataSync folder and let workbench handle creating any jobs that are needed? https://domohelp.domo.com/hc/en-us/articles/4407019838487-Configuring-a-DataSync-Folder-in-Workbench-5-1
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**1 -
We did not think about Workbench because we would like to avoid needing a local machine running this and if I'm not wrong this is what Workbench is based on, am I right?
May a custom connector be a possible solution to avoid local applications?
0 -
A custom connector may prove to be difficult as it's must be written on ES5 which is an older version. You may be able to hack something together to interact with an SFTP folder, pull all the files and then loop through all of the files but you'll be restricted to what you can utilize. I'd be interested to hear if you're able to get one written and working.
Workbench does run on a machine (virtual or physical) within your own intranet.
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**1 -
Just FYI, we opted for a python script working with Stream API. Creating a connector was not feasible for us.
1
Categories
- 10.5K All Categories
- 8 Connect
- 918 Connectors
- 250 Workbench
- 467 Transform
- 1.7K Magic ETL
- 69 SQL DataFlows
- 477 Datasets
- 193 Visualize
- 252 Beast Mode
- 2.1K Charting
- 11 Variables
- 17 Automate
- 354 APIs & Domo Developer
- 89 Apps
- 3 Workflows
- 20 Predict
- 5 Jupyter Workspaces
- 15 R & Python Tiles
- 246 Distribute
- 62 Domo Everywhere
- 243 Scheduled Reports
- 21 Manage
- 42 Governance & Security
- 173 Product Ideas
- 1.2K Ideas Exchange
- 12 Community Forums
- 27 Getting Started
- 14 Community Member Introductions
- 55 Community News
- 4.5K Archive