agib•2y ago

BigQuery API did not answer query in time

I'm playing around with Windmill Cloud (trial). I've created a BigQuery resource and a SQL script that uses that resource:

-- @schema (string)
-- @table (string)

EXECUTE IMMEDIATE FORMAT("SELECT * FROM %s.%s LIMIT 100", @schema, @table)

-- @schema (string)
-- @table (string)

EXECUTE IMMEDIATE FORMAT("SELECT * FROM %s.%s LIMIT 100", @schema, @table)

When I test the script with certain tables I get "BigQuery API did not answer query in time". Any idea what is going on here?

9 Replies

rubenf•2y ago

Do you have the same issue using a big query library in python or typescript ?

agibOP•2y ago

Hmm I didn't try directly. Would I just use the resource dict to make the bigquery connection? I was having trouble with:

from google.cloud import bigquery
from google.oauth2 import service_account

from google.cloud import bigquery
from google.oauth2 import service_account

in python

agibOP•2y ago

Ah, fixed with:

agibOP•2y ago

Ah yup ok so using the python libraries worked fine

rubenf•2y ago

@Hugo when you have time if you could look at that one

Hugo•2y ago

we have a timeout of 10s on bigquery queries, should i increase it to 200s (maximum)?

rubenf•2y ago

you can increase it to the instance max timeout the same one we have for normal jobs