WindmillWWindmill
Powered by
KasparK
Windmillโ€ข16mo agoโ€ข
26 replies
Kaspar

In a flow, is it possible to invoke for-loop parallelism on a single worker, to save on cost

Hey!

So I have a flow which uses an SDK which is not very optimized and does a slow API call. This ends up racking up a lot of worker execution seconds, and Windmill cloud bill along with it.

I don't want to ditch the usage of the SDK. One solution would be to re-factor the slow to try to do all the necessary slow calls in a single step, i.e. I would handle the for-loop in the .js level, not the flow level.

I would prefer to keep the flow structure and optimize on the level of Windmill worker usage. Any way to do this?
WindmillJoin
3,362Members
Resources
Recent Announcements

Similar Threads

Was this page helpful?
Recent Announcements
henri-c

Weekly kenote to tell you about our latest updates https://discord.com/channels/930051556043276338/1278977038430240813 https://youtube.com/live/2dGd9TdT8xs?feature=share

henri-c ยท 4d ago

Pyra

### HTTP tracing (EE) Capture HTTP requests made by job scripts as observability spans Features: - View HTTP request traces (method, URL, status, timing) in the job details UI - Auto-instrumentation for Native TypeScript, MITM proxy for other languages - Integrates with external OpenTelemetry collectors changelog: https://www.windmill.dev/changelog/http-tracing docs: https://www.windmill.dev/docs/advanced/instance_settings#http-tracing Additionally jobs memory metrics are now fully OSS!

Pyra ยท 2w ago

henri-c

First keynote of the year here https://discord.com/channels/930051556043276338/1278977038430240813 ๐Ÿ™‚

henri-c ยท 4w ago

Similar Threads

for loop unresponsive in a flow
BravoBBravo / help
15mo ago
Single script with long running loop vs flow loop feature
benBben / help
4w ago
How to add a while loop in a flow?
BurdBBurd / help
14mo ago
Is it possible to query a flow's progress using the Rest API?
fr3fouFfr3fou / help
12mo ago