Bilge
Bilge2w ago

Worker on demand

Instead of having workers running full time, is it possible to have a worker spin-up only when there are jobs to process? (e.g. with AWS Fargate)
5 Replies
rubenf
rubenf2w ago
with autoscaling you can but you need EE
fooosieee
fooosieee2w ago
u can use aws auto scaling make sure u put enough worker on the server
rubenf
rubenf2w ago
Windmill autoscaling work alongside the node autoscaler such as AWS autoscaling group and cluster autoscaling, it's not a replacement for it, it's complementary
Bilge
BilgeOP2w ago
I don't see how I can use AWS in silo without support from the software. I want to scale down to zero, so if there is no signal from Windmill to let the scale group know it needs to "boot up" then I fail to see how that could even work
fooosieee
fooosieee2w ago
but if u wanna scale down to 0 just shutdown entire stack and then use lambda or anything boot it up if u dont need a worker u dont the stack