WindmillWWindmill
Powered by
andnessA
Windmill•3y ago•
1 reply
andness

Hi, I'm trying out Windmill for

Hi, I'm trying out Windmill for orchestrating our analytics workflows, and as part of that I tried porting some existing code. The code interfaces with Clickhouse, so I have a small shared component for running Clickhouse queries. For simplicity say my
script
script
module depends the
shared
shared
module. I got this working fine, but then I was going to write
script2
script2
which also uses the
shared
shared
module, and as part of that I added a dependency to
shared
shared
.

After doing that I noticed that the schedule that is invoking
script
script
is failing with the error "ModuleNotFoundError: No module named 'clickhouse_driver'". "clichouse_driver" is the module I added to
shared
shared
.

To me it appears that the automatic module installation doesn't notice that the upstream
shared
shared
dependency has had a dependency change so when it attempt to run
script
script
it doesn't run pip install and as a result this fails.

To check this theory I made a spurious change to
script
script
and saved it again, and that fixed it.

I'm not sure I like this automagic dependency management, I think I would prefer to just manage a requirements.txt file like I'm used to and I don't consider that a hassle at all. But the issue I ran into here is a showstopper really as it would cause all scripts to break every time a dependency is added to one of the shared modules.
WindmillJoin
3,362Members
Resources
Recent Announcements

Similar Threads

Was this page helpful?
Recent Announcements
henri-c

Weekly kenote to tell you about our latest updates https://discord.com/channels/930051556043276338/1278977038430240813 https://youtube.com/live/2dGd9TdT8xs?feature=share

henri-c · 4d ago

Pyra

### HTTP tracing (EE) Capture HTTP requests made by job scripts as observability spans Features: - View HTTP request traces (method, URL, status, timing) in the job details UI - Auto-instrumentation for Native TypeScript, MITM proxy for other languages - Integrates with external OpenTelemetry collectors changelog: https://www.windmill.dev/changelog/http-tracing docs: https://www.windmill.dev/docs/advanced/instance_settings#http-tracing Additionally jobs memory metrics are now fully OSS!

Pyra · 2w ago

henri-c

First keynote of the year here https://discord.com/channels/930051556043276338/1278977038430240813 🙂

henri-c · 4w ago

Similar Threads

trying out windmill.dev
kimsiaKkimsia / general
2y ago
hello 🙂 trying out windmill and my
NackiNNacki / general
3y ago
I'm working on using windmill as our
sledgeSsledge / general
2y ago