WindmillWWindmill
Powered by
sledgeS
Windmill•15mo ago•
9 replies
sledge

Worker caching weirdness

We are using a web KV store. For a specific key we have written three blobs of JSON - each write with a different number of array elements in this order (5, 8, and 16). We have a simple windmill typescript script that fetches the data and logs the number of array elements. When we run that script on the windmill deploy (self-hosted EE) the workers get a variety of responses from the fetch (sometimes 5, someimtes 8, sometimes 16). Its like windmill has cached the internal fetch results and is returning that instead of doing the actual fetch. Which seems weird to me - since its just running our script on a worker. However, if I run the exact same fetch on a cloud-hosted windmill, the script always gets 16 elements (which is all that instance has ever seen). Is WM doing something like this or have we just hit some weird distributed caching problem with the KV store we're using?

The fetch is simple:

let result = await fetch(url)
let data = await result.json()
console.log(data.length)
WindmillJoin
3,362Members
Resources
Recent Announcements

Similar Threads

Was this page helpful?
Recent Announcements
henri-c

Weekly kenote to tell you about our latest updates https://discord.com/channels/930051556043276338/1278977038430240813 https://youtube.com/live/2dGd9TdT8xs?feature=share

henri-c · 4d ago

Pyra

### HTTP tracing (EE) Capture HTTP requests made by job scripts as observability spans Features: - View HTTP request traces (method, URL, status, timing) in the job details UI - Auto-instrumentation for Native TypeScript, MITM proxy for other languages - Integrates with external OpenTelemetry collectors changelog: https://www.windmill.dev/changelog/http-tracing docs: https://www.windmill.dev/docs/advanced/instance_settings#http-tracing Additionally jobs memory metrics are now fully OSS!

Pyra · 2w ago

henri-c

First keynote of the year here https://discord.com/channels/930051556043276338/1278977038430240813 🙂

henri-c · 4w ago

Similar Threads

Scheduled job caching
baptisteaBbaptistea / help
13mo ago
Worker configuration
AlainAAlain / help
6mo ago
Results caching for imported scripts
Oleksandr ManakovOOleksandr Manakov / help
14mo ago
Worker on demand
BilgeBBilge / help
16mo ago