WindmillWWindmill
Powered by
DaanD
Windmillโ€ข15mo agoโ€ข
6 replies
Daan

Question on scaling strategy in Docker

We have defined a set of worker groups (small / med / large) in our compose file, in line with our license, with a certain memory cap. We are running into issues though where sometimes, processes are killed due to excessive memory use, while sufficient memory is still available on the system. We see a big reduction in complexity & better use of resources if we could just set a total memory pool to docker / windmill (e.g. 8GB) & then define a single worker group which can then be used for all jobs - from small to large, up to a total memory use across all owrkers of 8GB, (as example), in line with our EE license. Is this flexibility possible?
WindmillJoin
3,362Members
Resources
Recent Announcements

Similar Threads

Was this page helpful?
Recent Announcements
henri-c

Weekly kenote to tell you about our latest updates https://discord.com/channels/930051556043276338/1278977038430240813 https://youtube.com/live/2dGd9TdT8xs?feature=share

henri-c ยท 4d ago

Pyra

### HTTP tracing (EE) Capture HTTP requests made by job scripts as observability spans Features: - View HTTP request traces (method, URL, status, timing) in the job details UI - Auto-instrumentation for Native TypeScript, MITM proxy for other languages - Integrates with external OpenTelemetry collectors changelog: https://www.windmill.dev/changelog/http-tracing docs: https://www.windmill.dev/docs/advanced/instance_settings#http-tracing Additionally jobs memory metrics are now fully OSS!

Pyra ยท 2w ago

henri-c

First keynote of the year here https://discord.com/channels/930051556043276338/1278977038430240813 ๐Ÿ™‚

henri-c ยท 4w ago

Similar Threads

auto scaling workers
pixeleetPpixeleet / help
2y ago
Docker
BlitlineBBlitline / help
5mo ago
Windmill on Windows without a Docker
ึ„ส€ึ…ส„ษ›ึ†ึ…ส€ี”ึ„ส€ึ…ส„ษ›ึ†ึ…ส€ / help
15mo ago
Windmill Server Stuck On Boot [ docker ]
Alex NunesAAlex Nunes / help
2y ago