how can you make docker containers running on Windmill access the same networking as the rest of the

how can you make docker containers running on Windmill access the same networking as the rest of the Windmill services?

I added a redis instance to the docker compose file. I have a Python script running on Windmill that accesses this redis instance successfully

    conn = redis.Redis(host="redis", port=6379, db=0)
    return conn.set("0", "0")

    conn = redis.Redis(host="redis", port=6379, db=0)
    return conn.set("0", "0")

    conn = redis.Redis(host="redis", port=6379, db=0)
    return conn.set("0", "0")

    conn = redis.Redis(host="redis", port=6379, db=0)
    return conn.set("0", "0")

I have a docker container running after I followed the documentation on how to setup docker. The script to run it is as follows:

docker run --rm \
-e REDIS_HOSTNAME=redis \
-e REDIS_PORT=6379 \
$IMAGE

docker run --rm \
-e REDIS_HOSTNAME=redis \
-e REDIS_PORT=6379 \
$IMAGE

docker run --rm \
-e REDIS_HOSTNAME=redis \
-e REDIS_PORT=6379 \
$IMAGE

docker run --rm \
-e REDIS_HOSTNAME=redis \
-e REDIS_PORT=6379 \
$IMAGE

I get the following error (container running JVM code):

Caused by: java.net.UnknownHostException: redis

Caused by: java.net.UnknownHostException: redis

This means that my code inside my container was not able to resolve that redis = my redis instance, but the python code was able to.

Nnsadeh how can you make docker containers running on Windmill access the same networkin...

nsadehOP•6/8/24, 7:33 PM

I tried adding a network to the docker compose and connecting the worker and redis, but that caused the worker to be unable to execute docker commands

Rrubenf cors on app.windmill.dev

Kelora•6/8/24, 7:42 PM

wouldnt CORS apply to both widgets?

rubenf•6/8/24, 7:44 PM

@Kelora not necessarily since the origin domain is different but i'm not a cors expert

rubenf•6/8/24, 7:44 PM

I can just tell you that pdf on external domains on app.windmill.dev do not work because of CORS

Kelora•6/8/24, 7:50 PM

ok gotcha

Nnsadeh I tried adding a network to the docker compose and connecting the worker and red...

nsadehOP•6/8/24, 10:01 PM

So I ended up just hosting my own redis on a remote VM as a solution, but I wish I was able to connect to the local redis instance

Nnsadeh how can you make docker containers running on Windmill access the same networkin...

Tiago Serafim•6/8/24, 10:17 PM

When you connect via python, you're connecting from within a WM worker that has access to the internal Docker network.
When you connect using the

docker run

docker run

, you're running a docker client that lives inside the worker, and this client is connecting to the host system, therefore, if you want to connect from there, your have to expose the redis container to the host.

TTiago Serafim When you connect via python, you're connecting from within a WM worker that has ...

nsadehOP•6/8/24, 10:18 PM

yes, thanks, I am aware of the DIND situation. I experimented with different configurations to expose the custom image to the docker-compose network but couldn't manage to make it work. Some network configs made the container hang up indefinitely without any error logs.

My devops friend suggested I could "flatten out" the network topology with K8s but I decided that the extra time was better spent on setting up a remote redis instance instead and making it an API. that beign said it's less secure as securing redis over the internet isn't trivial

Nnsadeh yes, thanks, I am aware of the DIND situation. I experimented with different con...

Tiago Serafim•6/8/24, 10:19 PM

Oh, that's weird

Kelora•6/9/24, 1:17 AM

might be completely k8s specific but has anyone used gpu accelerated windmill workers? havent tried to implement it myself yet but I assume that's possible

rubenf•6/9/24, 1:17 AM

Yes we have customers doing that

Kelora•6/9/24, 1:18 AM

and they don't count as vCPUs in the EE licensing?

Kelora•6/9/24, 1:18 AM

(beyond the CPUs used by the workers)

rubenf•6/9/24, 1:18 AM

The GPUs themselves no

Kelora•6/9/24, 1:18 AM

ok ty

D3SL•6/9/24, 9:35 AM

Is there a way to use native mysql scripts with listy inputs? For example

where iso2c IN(:input)

where iso2c IN(:input)

where

:input

:input

is more than one value? Or maybe a better way of asking is what sort of operations do those scripts support, since I've gotten some unexpected behavior out of them once or twice.

rubenf•6/9/24, 9:42 AM

Windmill simply use prepared statements, so anything that is supported by msql prepared statements will work, and anything that isn't won't.

D3SL•6/9/24, 10:25 AM

ahhh okay. That explains why a few things like trying to pull shenanigans with stored procedures worked in a SQL browser but not those. Thanks.

henri-c•6/10/24, 12:06 PM

Hi @mbaum! You can use webhooks that are generated for every deployed scripts and flows https://www.windmill.dev/docs/core_concepts/webhooks

Webhooks | Windmill

Webhooks are a way to interact with Windmill using standard web technologies.

rubenf•6/10/24, 1:26 PM

@Craig can you give me the job id

JJosh Good morning. There's a new a bug that has emerged. If you have a button tied to...

rubenf•6/10/24, 1:27 PM

on it

rubenf•6/10/24, 10:04 PM

Hi @paul , if you can write the schema as a result of the last job, we can add support for picking it up from there

rubenf•6/10/24, 10:05 PM

And currently no you cannot embed an app as an approval form but we're thinking of adding it as a feature. Most likely, it will be app embedding a flow that has approval steps

henri-c•6/11/24, 9:40 AM

Hi @Steve CL ! Sorry I'll clarify the docs & Pricing page asap

As the AI suggests, using BigQuery in itself does not require an Enterprise license since you can just create a BigQuery resource and use from scripts in TypeScript, Python etc.

However, the BigQuery runtime, available as a native script language in Windmill, is under Enterprise (or cloud plans) license

In other words: nothing forbids you from interacting with BigQuery in Windmill community edition, it's just the BigQuery runtime that is under Enterprise Edition for more convenience

rubenf•6/11/24, 10:57 AM

Apologies, we will improve our documentation. The expectation would be that you're inside a VPC and do not expose 5432 past your ingress, it's just a way to connect from the rest of your VPC. As to changeme being the password, we can re-iterate that it is meant to be changed in the self-host doc

rubenf•6/11/24, 12:04 PM

Thank you for the feedback. Wrt to documentation, it's also open-source so if you're up for it, you could even do a contribution with the notes around security, otherwise I will do it later this week: https://github.com/windmill-labs/windmilldocs

GitHub

GitHub - windmill-labs/windmilldocs

Contribute to windmill-labs/windmilldocs development by creating an account on GitHub.

rubenf•6/11/24, 12:06 PM

but yes, in general, you should always secure your VPC and never expose 5432 to your ingress, and I mean VPC ingress by that. The large majority of production use is through AWS/GCP/Azure and that's the default there wrt to the VPC Ingress/Load balancer/etc

JJosh Would it be possible to hide error messages like these in DB Studio tables while...

Faton•6/12/24, 5:16 PM

Hey, sure will work on that soon

JJosh any word on when we might get forms that support value and label for select enum...

Faton•6/12/24, 5:19 PM

I'll work on that by the end of the week!