Enter
Enter•2y ago

How can I delete all workers?

We have a number of workers in a vacuum!
27 Replies
Enter
EnterOP•2y ago
We've added TIMEOUT=1000 on workers
rubenf
rubenf•2y ago
Hi @heyenter , what do you mean by workers in a vacuum and what do you mean by deleting a worker ? Are you just referring to seeing them in the workers page even though they are off ?
Enter
EnterOP•2y ago
Enter
EnterOP•2y ago
We have workflows in progress but they don't end in success or error!
rubenf
rubenf•2y ago
can you go on one of them and see the detail of the status
Enter
EnterOP•2y ago
Enter
EnterOP•2y ago
@.atoo
rubenf
rubenf•2y ago
That looks like a failure, can you show more of the flow so that I can see why it didn't end
atoo
atoo•2y ago
This error is normal since all of our workers get stucked so this specific code didn't get executed in time. I thought this is our fault since we set the timeout too high. But the error that we can't fix is this one :
atoo
atoo•2y ago
It happens from time to time, but when we start at scaling on high threads it's start happening
rubenf
rubenf•2y ago
Did you increase the max connection of your postgres ?
atoo
atoo•2y ago
Yes we looked into it, @heyenter changed this value but not seem to have an effect
Enter
EnterOP•2y ago
150 yes Maybe more is needed?
rubenf
rubenf•2y ago
how many servers and workers do you use ?
Enter
EnterOP•2y ago
1 server + 25 workers on the same server*
rubenf
rubenf•2y ago
then yes you need more
Enter
EnterOP•2y ago
Maybe add some calculations to the documentation?
rubenf
rubenf•2y ago
so 25 replicas of the worker container with NUM_WORKERS=1 ?
Enter
EnterOP•2y ago
For x worker, you need to have x cpu/ram and x pg pool 1 docker container with NUM_WORKERS=25
rubenf
rubenf•2y ago
oh then you wouldn't need more but you shouldn't do that
Enter
EnterOP•2y ago
Ok I understand I'm going to add workers containers
rubenf
rubenf•2y ago
do you have 1 server and 1 worker container right now ?
Enter
EnterOP•2y ago
Yes !
rubenf
rubenf•2y ago
ok, then yes please create 25 replicas with NUM_WORKERS=1 I will actually make that the default too many people are shooting themselves in the foot and increase your max connection also you might not need 25 workers unless you have 25vCPU?
Enter
EnterOP•2y ago
😂 haha no 4 cpu We're going to review our installation
rubenf
rubenf•2y ago
spawn 8 replicas at most
Enter
EnterOP•2y ago
Ok