Not sure what this AWS Lambda error I'm getting from trying to extract domo datasets

user14700 · March 2019

What does this error from AWS Lambda mean?

[
  "{\"status\":404,\"statusReason\":\"Not Found\",\"toe\":\"FJACDOT2HE-250JI-8N0AH\"}"
]

guitarhero23 · April 2019

My message seems to have disappeared.... At risk of this showing up twice I'm posting it again.

-----------------------

I took your code and tested it out using the Base64 Authorization as documented in the developer documentation instead of how you did it and it worked. (Note, I ran this locally, not in AWS but that shouldn't make a difference since you're just returning the HTTP response)

import requests


def get_dataset(id):
# Get Access Token and Domo API Response
    base64auth = 'InsertBase64_ID+Secret'
    r = requests.get("https://api.domo.com/oauth/token?grant_type=client_credentials&scope=data",
                     headers={'Authorization': 'Basic ' + base64auth})
    tkn_response = r.json()
    tkn = tkn_response['access_token']
    headers = {
'Content-Type': 'application/json',
        'Authorization': 'bearer ' + tkn,
        'content-encoding': 'utf-8'
    }
    url = "https://api.domo.com/v1/datasets/" + str(id) + "/data"
    resp = requests.get(url, headers=headers)

# convert csv string to list
    print(resp.text.splitlines())
return resp.text.splitlines()


get_dataset('78c41cbc-43d4-4dba-a638-86b67cd86356')

Output (printed)

['667b327f-67f6-4d74-9d4a-5d0697b938cf, General Ledger Detail Lookup,Travis Simpson,2019-01-11 14:21:01,2016-12-07 17:53:47,2019-0............]

You can use this to help you with that type of authorization https://developer.domo.com/explorer#!/auth

guitarhero23 · April 2019

Can you provide the Lambda code? Is this a response from the Domo API that you're getting with a call from a Lambda function?

user14700 · April 2019

Here's the code I'm using. The references is just AWS and DOMO API stuff.

import requests
import reference


def get_dataset(self, id):
    # Get Access Token and Domo API Response
    r = requests.get("https://api.domo.com/oauth/token?grant_type=client_credentials&scope=data",
                     auth=(reference.CLIENT_ID, reference.CLIENT_SECRET))
    tkn_response = r.json()
    tkn = tkn_response['access_token']
    headers = {
        'Content-Type': 'application/json',
        'Authorization': 'bearer ' + tkn,
        'content-encoding': 'utf-8'
    }
    url = "https://api.domo.com/v1/datasets/" + str(id) + "/data"
    resp = requests.get(url, headers=headers)

    # convert csv string to list
    return resp.text.splitlines()

guitarhero23 · April 2019

I took your code and tested it out using the Base64 Authorization as documented in the developer documentation instead of how you did it and it worked. (Note, I ran this locally, not in AWS but that shouldn't make a difference since you're just returning the HTTP response)

import requests


def get_dataset(id):
# Get Access Token and Domo API Response
    base64auth = 'InsertBase64_ID+Secret'
    r = requests.get("https://api.domo.com/oauth/token?grant_type=client_credentials&scope=data",
                     headers={'Authorization': 'Basic ' + base64auth})
    tkn_response = r.json()
    tkn = tkn_response['access_token']
    headers = {
'Content-Type': 'application/json',
        'Authorization': 'bearer ' + tkn,
        'content-encoding': 'utf-8'
    }
    url = "https://api.domo.com/v1/datasets/" + str(id) + "/data"
    resp = requests.get(url, headers=headers)

# convert csv string to list
    print(resp.text.splitlines())
return resp.text.splitlines()


get_dataset('78c41cbc-43d4-4dba-a638-86b67cd86356')

Output (printed)

['667b327f-67f6-4d74-9d4a-5d0697b938cf, General Ledger Detail Lookup,Travis Simpson,2019-01-11 14:21:01,2016-12-07 17:53:47,2019-0............]

You can use this to help you with that type of authorization https://developer.domo.com/explorer#!/auth

guitarhero23 · April 2019

My message seems to have disappeared.... At risk of this showing up twice I'm posting it again.

-----------------------

I took your code and tested it out using the Base64 Authorization as documented in the developer documentation instead of how you did it and it worked. (Note, I ran this locally, not in AWS but that shouldn't make a difference since you're just returning the HTTP response)

import requests


def get_dataset(id):
# Get Access Token and Domo API Response
    base64auth = 'InsertBase64_ID+Secret'
    r = requests.get("https://api.domo.com/oauth/token?grant_type=client_credentials&scope=data",
                     headers={'Authorization': 'Basic ' + base64auth})
    tkn_response = r.json()
    tkn = tkn_response['access_token']
    headers = {
'Content-Type': 'application/json',
        'Authorization': 'bearer ' + tkn,
        'content-encoding': 'utf-8'
    }
    url = "https://api.domo.com/v1/datasets/" + str(id) + "/data"
    resp = requests.get(url, headers=headers)

# convert csv string to list
    print(resp.text.splitlines())
return resp.text.splitlines()


get_dataset('78c41cbc-43d4-4dba-a638-86b67cd86356')

Output (printed)

['667b327f-67f6-4d74-9d4a-5d0697b938cf, General Ledger Detail Lookup,Travis Simpson,2019-01-11 14:21:01,2016-12-07 17:53:47,2019-0............]

You can use this to help you with that type of authorization https://developer.domo.com/explorer#!/auth

user14700 · April 2019

So really dumb question but the line where you have:

base64auth = 'InsertBase64_ID+Secret'

is that where I sub out the InsertBase64_ID with the Client ID and the Secret with Client Secret?

guitarhero23 · April 2019

You would want to get the base64 encoded version of your client secret and client ID combined. You could do this in code but I found it easiest to go to that Domo developer site I mentioned in the comment and generate it there. If you scroll down on that page it has a spot you can fill in your Client ID and Secret and on the right it should show you the Base64 version of those two things combined. You could do something like import base64 and run a function from that to do it yourself but I say just go to https://developer.domo.com/explorer#!/auth and do it there, screenshot below with an altered CLIENT ID + SECRET

user14700 · April 2019

Ah ok thank you so much! I encountered an addditional problem after this though. I got this error:

{
  "errorMessage": "get_dataset() takes 1 positional argument but 2 were given",
  "errorType": "TypeError",
  "stackTrace": [
    "  File \"/var/runtime/bootstrap.py\", line 119, in handle_event_request\n    response = request_handler(event, lambda_context)\n"
  ]
}

People on stackoverflow were saying that I need to add self as an additonal parameter for the function. But then it throws this error and now I'm stuck at how to get past it:

{
  "errorMessage": "get_dataset() missing 1 required positional argument: 'id'",
  "errorType": "TypeError",
  "stackTrace": [
    "  File \"/var/lang/lib/python3.7/imp.py\", line 234, in load_module\n    return load_source(name, filename, file)\n",
    "  File \"/var/lang/lib/python3.7/imp.py\", line 171, in load_source\n    module = _load(spec)\n",
    "  File \"<frozen importlib._bootstrap>\", line 696, in _load\n",
    "  File \"<frozen importlib._bootstrap>\", line 677, in _load_unlocked\n",
    "  File \"<frozen importlib._bootstrap_external>\", line 728, in exec_module\n",
    "  File \"<frozen importlib._bootstrap>\", line 219, in _call_with_frames_removed\n",
    "  File \"/var/task/get_domo_dataset.py\", line 25, in <module>\n    get_dataset('78c41cbc-43d4-4dba-a638-86b67cd86356')\n"
  ]
}

guitarhero23 · April 2019

Ah the classic solve one thing just to find out something else is also wrong.

I did change in mine to remove self only because to test it for you I didn't need that. Did you try it with and without it in you're real code? Also what exactly is the end product of what you're producing? I'm interested. My guess seeing as how it's bootstrap is you're presenting the data on the web? So like someone goes to a page and or does an action and it makes a call via API Gateway + Lambda and returns the data which is then represented on the page? Generally Self would be inherited from a parent class or something however if you are just making it a single function without a parent class you may or may not need it (I'm an amateur coder myself so don't take my word as authority). It does sound like the Self is messing it up because it's expecting you to supply the dataset ID and a value for Self

Not sure what this AWS Lambda error I'm getting from trying to extract domo datasets

Best Answer

Answers

Categories