i got a postgres script with two commands: CREATE TABLE and CREATE INDEX it returns an error: ``` E

D

Damian Szetela•10/30/23, 9:08 AM

@rubenf you can find my app json attached to the message I sent to Faton on 27.10.2023 17:20

AAlper i got a postgres script with two commands: CREATE TABLE and CREATE INDEX it ret...

S

Sindre•10/30/23, 9:17 AM

I would go for something like this https://hub.windmill.dev/scripts/postgresql/1294/execute-query-and-return-results-postgresql and not use the mysql/postgres script type. as far as I know It's not posssible to execute 2 commands with them

Script 'Execute Query and return results' for postgresql | Windmill...

How to Execute Query and return results for postgresql : Executes an arbitrary query and return the row results

R

rubenf•10/30/23, 9:56 AM

@Defri have you look at the CLI section in the detail page of the script ?

R

rubenf•10/30/23, 9:56 AM

It will display the full command with args

R

rubenf•10/30/23, 9:59 AM

R

rubenf•10/30/23, 9:59 AM

bottom right

A

AlperOP•10/30/23, 11:07 AM

python script with "sklearn" dependency fails with:

from sklearn.cluster import KMeans
ModuleNotFoundError: No module named 'sklearn'

from sklearn.cluster import KMeans
ModuleNotFoundError: No module named 'sklearn'

from sklearn.cluster import KMeans
ModuleNotFoundError: No module named 'sklearn'

from sklearn.cluster import KMeans
ModuleNotFoundError: No module named 'sklearn'

R

rubenf•10/30/23, 11:10 AM

looks like sklearn need a remapping to scikit-learn

DDefri is possible to running go get before running script ?. i need to invalidate cach...

R

rubenf•10/30/23, 11:10 AM

that sounds like a bug, we will add to backlog

A

AlperOP•10/30/23, 11:13 AM

adding this on the top helped:

#requirements:
#scikit-learn

#requirements:
#scikit-learn

#requirements:
#scikit-learn

#requirements:
#scikit-learn

R

rubenf•10/30/23, 11:17 AM

yeah in next commit this will be remapped automatically

A

AlperOP•10/30/23, 11:19 AM

please also create a mapping from

umap

umap

umap

umap to

umap-learn

umap-learn

umap-learn

umap-learn

R

rubenf•10/30/23, 11:23 AM

both are done in latest

R

rubenf•10/30/23, 11:23 AM

@Defri are you sure your go get are working at all ?

R

rubenf•10/30/23, 11:24 AM

i'm pretty sure the only way to pin dependencies is to use the require syntax

R

rubenf•10/30/23, 11:24 AM

which is written in the comments

A

AlperOP•10/30/23, 11:32 AM

is it possible to render plotly charts in windmill ui?

    import plotly.express as px

    fig = px.scatter(x=x, y=y, color=color)
    fig.show()

    import plotly.express as px

    fig = px.scatter(x=x, y=y, color=color)
    fig.show()

    import plotly.express as px

    fig = px.scatter(x=x, y=y, color=color)
    fig.show()

    import plotly.express as px

    fig = px.scatter(x=x, y=y, color=color)
    fig.show()

R

rubenf•10/30/23, 11:32 AM

only if you export it as an image

R

rubenf•10/30/23, 11:32 AM

and then show it as a base64

R

rubenf•10/30/23, 11:32 AM

you can write a function for that

R

rubenf•10/30/23, 11:33 AM

so yes, but require a bit more code

A

AlperOP•10/30/23, 11:39 AM

just to clarify: that would only show the base64 string, not the actual image, right?

R

rubenf•10/30/23, 11:39 AM

no it would show the image

R

rubenf•10/30/23, 11:39 AM

see corresponding docs about rich display rendering

A

AlperOP•10/30/23, 11:46 AM

i'm doing something wrong:

      return {
        "png": {
          "content": base64.b64encode(png_data),
        }
      }

      return {
        "png": {
          "content": base64.b64encode(png_data),
        }
      }

      return {
        "png": {
          "content": base64.b64encode(png_data),
        }
      }

      return {
        "png": {
          "content": base64.b64encode(png_data),
        }
      }

output:

JSON is too large to be displayed in full
png : -
content : "b'iVBORw0KGg[...]

JSON is too large to be displayed in full
png : -
content : "b'iVBORw0KGg[...]

JSON is too large to be displayed in full
png : -
content : "b'iVBORw0KGg[...]

JSON is too large to be displayed in full
png : -
content : "b'iVBORw0KGg[...]

R

rubenf•10/30/23, 11:50 AM

the fact it's prefixed with b' is suspicious

R

rubenf•10/30/23, 11:50 AM

but it might be a very big image as well

R

rubenf•10/30/23, 11:50 AM

how big is your content string?

A

AlperOP•10/30/23, 11:55 AM

length is 49608

R

rubenf•10/30/23, 11:56 AM

on latest this should work

R

rubenf•10/30/23, 11:56 AM

you should try on app.windmill.dev

A

AlperOP•10/30/23, 12:07 PM

restarted my windmill server to pull the latest changes and now the db is flooded with these logs:

db-1                      | 2023-10-30 12:05:28.511 UTC [54] ERROR:  cached plan must not change result type
db-1                      | 2023-10-30 12:05:28.511 UTC [54] STATEMENT:  UPDATE queue
db-1                      |                    SET running = true
db-1                      |                      , started_at = coalesce(started_at, now())
db-1                      |                      , last_ping = now()
db-1                      |                      , suspend_until = null
db-1                      |                    WHERE id = (
db-1                      |                        SELECT id
db-1                      |                        FROM queue
db-1                      |                        WHERE running = false AND scheduled_for <= now() AND tag = ANY($1)
db-1                      |                        ORDER BY scheduled_for, created_at
db-1                      |                        FOR UPDATE SKIP LOCKED
db-1                      |                        LIMIT 1
db-1                      |                    )
db-1                      |                    RETURNING *
db-1                      | 2023-10-30 12:05:28.512 UTC [73] ERROR:  cached plan must not change result type
db-1                      | 2023-10-30 12:05:28.512 UTC [73] STATEMENT:  UPDATE queue
db-1                      |                    SET running = true
db-1                      [...]

db-1                      | 2023-10-30 12:05:28.511 UTC [54] ERROR:  cached plan must not change result type
db-1                      | 2023-10-30 12:05:28.511 UTC [54] STATEMENT:  UPDATE queue
db-1                      |                    SET running = true
db-1                      |                      , started_at = coalesce(started_at, now())
db-1                      |                      , last_ping = now()
db-1                      |                      , suspend_until = null
db-1                      |                    WHERE id = (
db-1                      |                        SELECT id
db-1                      |                        FROM queue
db-1                      |                        WHERE running = false AND scheduled_for <= now() AND tag = ANY($1)
db-1                      |                        ORDER BY scheduled_for, created_at
db-1                      |                        FOR UPDATE SKIP LOCKED
db-1                      |                        LIMIT 1
db-1                      |                    )
db-1                      |                    RETURNING *
db-1                      | 2023-10-30 12:05:28.512 UTC [73] ERROR:  cached plan must not change result type
db-1                      | 2023-10-30 12:05:28.512 UTC [73] STATEMENT:  UPDATE queue
db-1                      |                    SET running = true
db-1                      [...]

db-1                      | 2023-10-30 12:05:28.511 UTC [54] ERROR:  cached plan must not change result type
db-1                      | 2023-10-30 12:05:28.511 UTC [54] STATEMENT:  UPDATE queue
db-1                      |                    SET running = true
db-1                      |                      , started_at = coalesce(started_at, now())
db-1                      |                      , last_ping = now()
db-1                      |                      , suspend_until = null
db-1                      |                    WHERE id = (
db-1                      |                        SELECT id
db-1                      |                        FROM queue
db-1                      |                        WHERE running = false AND scheduled_for <= now() AND tag = ANY($1)
db-1                      |                        ORDER BY scheduled_for, created_at
db-1                      |                        FOR UPDATE SKIP LOCKED
db-1                      |                        LIMIT 1
db-1                      |                    )
db-1                      |                    RETURNING *
db-1                      | 2023-10-30 12:05:28.512 UTC [73] ERROR:  cached plan must not change result type
db-1                      | 2023-10-30 12:05:28.512 UTC [73] STATEMENT:  UPDATE queue
db-1                      |                    SET running = true
db-1                      [...]

db-1                      | 2023-10-30 12:05:28.511 UTC [54] ERROR:  cached plan must not change result type
db-1                      | 2023-10-30 12:05:28.511 UTC [54] STATEMENT:  UPDATE queue
db-1                      |                    SET running = true
db-1                      |                      , started_at = coalesce(started_at, now())
db-1                      |                      , last_ping = now()
db-1                      |                      , suspend_until = null
db-1                      |                    WHERE id = (
db-1                      |                        SELECT id
db-1                      |                        FROM queue
db-1                      |                        WHERE running = false AND scheduled_for <= now() AND tag = ANY($1)
db-1                      |                        ORDER BY scheduled_for, created_at
db-1                      |                        FOR UPDATE SKIP LOCKED
db-1                      |                        LIMIT 1
db-1                      |                    )
db-1                      |                    RETURNING *
db-1                      | 2023-10-30 12:05:28.512 UTC [73] ERROR:  cached plan must not change result type
db-1                      | 2023-10-30 12:05:28.512 UTC [73] STATEMENT:  UPDATE queue
db-1                      |                    SET running = true
db-1                      [...]

it retries indefinitely every millisecond

R

rubenf•10/30/23, 12:08 PM

you need to restart all of them

R

rubenf•10/30/23, 12:08 PM

not just your server

A

AlperOP•10/30/23, 12:08 PM

i did, using

docker compose down && docker compose up -d

docker compose down && docker compose up -d

docker compose down && docker compose up -d

docker compose down && docker compose up -d

AAlper i did, using `docker compose down && docker compose up -d`

R

rubenf•10/30/23, 12:11 PM

It's from a container that has not restarted

R

rubenf•10/30/23, 12:11 PM

Or that isn't on same version

JJim Is there a way to see when a worker is busy?

R

rubenf•10/30/23, 12:12 PM

It's exposed in the Prometheus metrics

A

AlperOP•10/30/23, 12:18 PM

@rubenf you're right i had to manually

docker pull

docker pull

to ensure that all containers are up to date

new problem now though as the web app is still not showing up. docker logs for caddy show this:

caddy-1                   | {"level":"error","ts":1698668186.8462517,"logger":"http.log.error","msg":"dial tcp 172.24.0.15:8000: connect: connection refused","request":{"remote_ip":"99.222.22.99","remote_port":"11906","proto":"HTTP/1.1","method":"GET","host":"something.net:9000","uri":"/","headers":{"Cache-Control":["max-age=0"],"User-Agent":["Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36"],"Accept-Encoding":["gzip, deflate"],"Accept-Language":["de-DE,de;q=0.9,en-US;q=0.8,en;q=0.7,lb;q=0.6"],"Connection":["keep-alive"],"Upgrade-Insecure-Requests":["1"],"Accept":["text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"],"Cookie":[]}},"duration":0.002089665,"status":502,"err_id":"0rzabz7tt","err_trace":"reverseproxy.statusError (reverseproxy.go:1184)"}

caddy-1                   | {"level":"error","ts":1698668186.8462517,"logger":"http.log.error","msg":"dial tcp 172.24.0.15:8000: connect: connection refused","request":{"remote_ip":"99.222.22.99","remote_port":"11906","proto":"HTTP/1.1","method":"GET","host":"something.net:9000","uri":"/","headers":{"Cache-Control":["max-age=0"],"User-Agent":["Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36"],"Accept-Encoding":["gzip, deflate"],"Accept-Language":["de-DE,de;q=0.9,en-US;q=0.8,en;q=0.7,lb;q=0.6"],"Connection":["keep-alive"],"Upgrade-Insecure-Requests":["1"],"Accept":["text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"],"Cookie":[]}},"duration":0.002089665,"status":502,"err_id":"0rzabz7tt","err_trace":"reverseproxy.statusError (reverseproxy.go:1184)"}

caddy-1                   | {"level":"error","ts":1698668186.8462517,"logger":"http.log.error","msg":"dial tcp 172.24.0.15:8000: connect: connection refused","request":{"remote_ip":"99.222.22.99","remote_port":"11906","proto":"HTTP/1.1","method":"GET","host":"something.net:9000","uri":"/","headers":{"Cache-Control":["max-age=0"],"User-Agent":["Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36"],"Accept-Encoding":["gzip, deflate"],"Accept-Language":["de-DE,de;q=0.9,en-US;q=0.8,en;q=0.7,lb;q=0.6"],"Connection":["keep-alive"],"Upgrade-Insecure-Requests":["1"],"Accept":["text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"],"Cookie":[]}},"duration":0.002089665,"status":502,"err_id":"0rzabz7tt","err_trace":"reverseproxy.statusError (reverseproxy.go:1184)"}

caddy-1                   | {"level":"error","ts":1698668186.8462517,"logger":"http.log.error","msg":"dial tcp 172.24.0.15:8000: connect: connection refused","request":{"remote_ip":"99.222.22.99","remote_port":"11906","proto":"HTTP/1.1","method":"GET","host":"something.net:9000","uri":"/","headers":{"Cache-Control":["max-age=0"],"User-Agent":["Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36"],"Accept-Encoding":["gzip, deflate"],"Accept-Language":["de-DE,de;q=0.9,en-US;q=0.8,en;q=0.7,lb;q=0.6"],"Connection":["keep-alive"],"Upgrade-Insecure-Requests":["1"],"Accept":["text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"],"Cookie":[]}},"duration":0.002089665,"status":502,"err_id":"0rzabz7tt","err_trace":"reverseproxy.statusError (reverseproxy.go:1184)"}

S

Sindre•10/30/23, 12:20 PM

if the connection is refused you should check the logs on the server. I assume there is some kind of error message there.

A

AlperOP•10/30/23, 12:22 PM

this is the output from

docker compose logs

docker compose logs

therefore there are no other server logs than those from

caddy

caddy

caddy

caddy as seen above

S

Sindre•10/30/23, 12:26 PM

no other server logs? you should def be seeing other logs.
what does

docker logs windmill_server

docker logs windmill_server

docker logs windmill_server

docker logs windmill_server where "windmill_server" is the container show? nothing?

A

AlperOP•10/30/23, 12:32 PM

# docker compose logs windmill_server
windmill_server-1  | 2023-10-30T12:14:11.758240Z  INFO windmill: Mode not specified, defaulting to standalone
windmill_server-1  | 2023-10-30T12:14:11.758295Z  INFO windmill: Connecting to database...
windmill_server-1  | 2023-10-30T12:14:11.784252Z  INFO windmill: Database connected
windmill_server-1  | 2023-10-30T12:14:11.786103Z  INFO windmill: PostgreSQL version: PostgreSQL 14.9 (Debian 14.9-1.pgdg120+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit (windmill require PG >= 14)

# docker compose logs windmill_server
windmill_server-1  | 2023-10-30T12:14:11.758240Z  INFO windmill: Mode not specified, defaulting to standalone
windmill_server-1  | 2023-10-30T12:14:11.758295Z  INFO windmill: Connecting to database...
windmill_server-1  | 2023-10-30T12:14:11.784252Z  INFO windmill: Database connected
windmill_server-1  | 2023-10-30T12:14:11.786103Z  INFO windmill: PostgreSQL version: PostgreSQL 14.9 (Debian 14.9-1.pgdg120+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit (windmill require PG >= 14)

# docker compose logs windmill_server
windmill_server-1  | 2023-10-30T12:14:11.758240Z  INFO windmill: Mode not specified, defaulting to standalone
windmill_server-1  | 2023-10-30T12:14:11.758295Z  INFO windmill: Connecting to database...
windmill_server-1  | 2023-10-30T12:14:11.784252Z  INFO windmill: Database connected
windmill_server-1  | 2023-10-30T12:14:11.786103Z  INFO windmill: PostgreSQL version: PostgreSQL 14.9 (Debian 14.9-1.pgdg120+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit (windmill require PG >= 14)

# docker compose logs windmill_server
windmill_server-1  | 2023-10-30T12:14:11.758240Z  INFO windmill: Mode not specified, defaulting to standalone
windmill_server-1  | 2023-10-30T12:14:11.758295Z  INFO windmill: Connecting to database...
windmill_server-1  | 2023-10-30T12:14:11.784252Z  INFO windmill: Database connected
windmill_server-1  | 2023-10-30T12:14:11.786103Z  INFO windmill: PostgreSQL version: PostgreSQL 14.9 (Debian 14.9-1.pgdg120+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit (windmill require PG >= 14)

nothing more than that

A

AlperOP•10/30/23, 12:32 PM

logs suspicously similar to windmill worker outputs

i got a postgres script with two commands: CREATE TABLE and CREATE INDEX it returns an error: ``` E

Similar Threads

Similar Threads

Similar Threads