Cloud logging
Hey Team, I have a self-hosted windmill setup on Kubernetes on Google Cloud. I have workers running - and google logs explorer setup to capture the STDOUT of the worker. In the google cloud platform logs explorer I currently get the following logs of the worker
1. Ping check every 5 seconds with memory usage
2. Audit logs
3. Jobs execution stats (Running status, job ID, completed / failed etc)
However I don't get the logs of the actual script running within the worker. That is available on the windmill UI, but requires that I setup a volume mount for /tmp/windmill/logs , and log files will be stored there.
Neither that, or storage in S3 is ideal, I want to print the logs of the script to the main worker STDOUT so it can be captured within google cloud logs explorer
Any ideas on how I can achieve this?
Sample logs I'm getting today (Note that the logs of the script itself are not available. Only worker health / status logs are)
1 Reply
Hi, it's intended. We will do integration with different log explorers later as an ee feature by doing an API call at the end of the job rather than using stdout.