Error creating query using python and pydomo

taylordomo
taylordomo Member
edited March 2021 in APIs & Domo Developer

Hello,

When attempting to query a dataset with a simple query

query = {"sql": "SELECT * FROM table"}

I get this exception

Exception: Error creating query: {"status":400,"statusReason":"Bad Request","message":"Cannot deserialize instance of `java.lang.String` out of START_OBJECT token"


Using domo.ds_meta and domo.ds_get work fine, but I need to be able to query a larger dataset.


Thank for any help you can offer!

Tagged:

Best Answers

  • GrantSmith
    GrantSmith Coach
    Answer ✓

    Hi @taylordomo

    Do you have any extra code / context for how you're calling ds_query?

    Are you passing your dictionary as the query or just the query string? Looking at the code for the query function it looks like it does the packaging automatically for you so you shouldn't need to pass in {"sql": "select * from table"} but rather just pass in your query itself "select * from table"

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • taylordomo
    taylordomo Member
    Answer ✓

    Yes! Changing the query to a string worked. Now that I look around, I am not sure where I got the idea that I needed a dictionary. For others that have this same issue:

    query = "SELECT * FROM table"

    df = domo.ds_query(dataset_id=dataset_id,  query=query,  return_data=True)

    Is the correct code to get the querying to work. Query needs to be a string, not a dictionary.

    Appreciate the help!

  • taylordomo
    taylordomo Member
    Answer ✓

    Hi, I wanted to follow up on this thread in case someone else has an issue running ds_query. For me, as of December 2022, if the query string has incorrect sql syntax, I receive this exception error:

    Exception: Error creating query: There was a problem executing the SQL query: Underlying service error: Internal Server Error

    I am not sure why it says it's an internal error because it's just a sql syntax error. Some tips for getting your syntax correct.

    • The simplest query you can run is to select all. If you have a dataset with less than 1 million rows, I would recommend this first to make sure your client id, secret id, and dataset id all check out.
    2022-12-07 10_52_32-get_data.py - 2023 comp - Visual Studio Code.png
    • that said, I'm betting the main use case for using ds_query is to actually select specific columns and filter using where. To select particular columns, if the column does not have any spaces in the name, you can type it how it's spelt.
    2022-12-07 10_59_22-get_data.py - 2023 comp - Visual Studio Code.png
    • if the column name has spaces, I've found that using back quotes works for me
    image.png


    • then if you want to filter, obviously use the WHERE clause
    • one thing to be diligent on, is to make sure you have space between table and WHERE so I add a space or two after table (blue arrow)
    2022-12-07 11_05_20-● get_data.py - 2023 comp - Visual Studio Code.png


    Hopefully this helps someone get started with this function!

Answers

  • jaeW_at_Onyx
    jaeW_at_Onyx Coach

    what happens when you don't use SELECT * and actually select column names?

    Jae Wilson
    Check out my 🎥 Domo Training YouTube Channel 👨‍💻

    **Say "Thanks" by clicking the ❤️ in the post that helped you.
    **Please mark the post that solves your problem by clicking on "Accept as Solution"
  • taylordomo
    taylordomo Member

    Hey, I appreciate the idea! I'm getting the same exception with any of these:

    {"sql": "SELECT name, id FROM table"}

    {"sql": "SELECT name, id FROM table Limit 3"}

  • GrantSmith
    GrantSmith Coach
    Answer ✓

    Hi @taylordomo

    Do you have any extra code / context for how you're calling ds_query?

    Are you passing your dictionary as the query or just the query string? Looking at the code for the query function it looks like it does the packaging automatically for you so you shouldn't need to pass in {"sql": "select * from table"} but rather just pass in your query itself "select * from table"

    **Was this post helpful? Click Agree or Like below**
    **Did this solve your problem? Accept it as a solution!**
  • taylordomo
    taylordomo Member
    Answer ✓

    Yes! Changing the query to a string worked. Now that I look around, I am not sure where I got the idea that I needed a dictionary. For others that have this same issue:

    query = "SELECT * FROM table"

    df = domo.ds_query(dataset_id=dataset_id,  query=query,  return_data=True)

    Is the correct code to get the querying to work. Query needs to be a string, not a dictionary.

    Appreciate the help!

  • taylordomo
    taylordomo Member
    Answer ✓

    Hi, I wanted to follow up on this thread in case someone else has an issue running ds_query. For me, as of December 2022, if the query string has incorrect sql syntax, I receive this exception error:

    Exception: Error creating query: There was a problem executing the SQL query: Underlying service error: Internal Server Error

    I am not sure why it says it's an internal error because it's just a sql syntax error. Some tips for getting your syntax correct.

    • The simplest query you can run is to select all. If you have a dataset with less than 1 million rows, I would recommend this first to make sure your client id, secret id, and dataset id all check out.
    2022-12-07 10_52_32-get_data.py - 2023 comp - Visual Studio Code.png
    • that said, I'm betting the main use case for using ds_query is to actually select specific columns and filter using where. To select particular columns, if the column does not have any spaces in the name, you can type it how it's spelt.
    2022-12-07 10_59_22-get_data.py - 2023 comp - Visual Studio Code.png
    • if the column name has spaces, I've found that using back quotes works for me
    image.png


    • then if you want to filter, obviously use the WHERE clause
    • one thing to be diligent on, is to make sure you have space between table and WHERE so I add a space or two after table (blue arrow)
    2022-12-07 11_05_20-● get_data.py - 2023 comp - Visual Studio Code.png


    Hopefully this helps someone get started with this function!

Categories