S3 Advanced Connector Not Loading JSON Files

pstrauss

I'm trying to automatically load all files ending in ".json" from an S3 bucket using the S3 Advanced Connector. However, no data is loading. I set the File Name field to ".json" and the File Name Match Type to "File name contains the specified string."

I have no problem reading individual files from this bucket without a problem using the standard S3 connector. Any ideas what I might be doing wrong?

On a related note, will the S3 Advanced Connector automatically load each file only one time? That's the behavior we would like - we're basically streaming JSON log files into a bucket and need each one added to Domo, and each log is in a separate file.

I've attached screenshots of my connector settings, as well as a screenshot of my test file bucket showing some example file names.

ArborRose

I'm about to be configuring the same thing. A few things you might try…

Check your IAM role for permissions.
Since you are trying to load files with ".json", set the file name field to "*.json".
Make sure files are truly formatted JSON.
Make sure your files are not being overwritten or deleted.

ArborRose

I'm about to be configuring the same thing. A few things you might try…

Check your IAM role for permissions.
Since you are trying to load files with ".json", set the file name field to "*.json".
Make sure files are truly formatted JSON.
Make sure your files are not being overwritten or deleted.