Can't pull in JSON from S3 connector

user14700

I'm trying to pull in a few json files from the S3 connector and one of the files throws up this error:

 Failed parsing JSON source: JsonReader at line 1 column 24976613 to Json

 

The other two json files ran successfully and are very similar to the one that isn't pulling. I'm unsure on how to troubleshoot this.

GrantSmith

Hi @user14700 

Have you tried downloading your file manually and then using an online JSON parser to see if there's a formatting issue with your file?

user14700

Haven't thought of that, i'll give that a try right now!

user14700

I tried an online JSON parser and it was formatted correctly so I don't think there's an issue there. Is there a limit how many rows I can pull in? It's around 437k rows with only like 5 columns.

jaeW_at_Onyx

maybe try uploading a subset of the data?

do you have clean key-value pairs, or do your values occasionally contain arrays? 

user14700

Just tried uploading it with different sizes. I'm starting to think there is a cap because I uploaded 3/4 the size and it worked normally but when I removed a few dozen rows, I get the same error. It also says Updated:Invalid date on the top however there's no date field in the JSON file.

GrantSmith

The other test you can do is test the final 1/4 in a separate file to confirm is a size issue and not a record formatting issue in the file.