Cloud logging
Hey Team, I have a self-hosted windmill setup on Kubernetes on Google Cloud. I have workers running - and google logs explorer setup to capture the STDOUT of the worker. In the google cloud platform logs explorer I currently get the following logs of the worker
1. Ping check every 5 seconds with memory usage
2. Audit logs
3. Jobs execution stats (Running status, job ID, completed / failed etc)
However I don't get the logs of the actual script running within the worker. That is available on the windmill UI, but requires that I setup a volume mount for /tmp/windmill/logs , and log files will be stored there.
Neither that, or storage in S3 is ideal, I want to print the logs of the script to the main worker STDOUT so it can be captured within google cloud logs explorer
Any ideas on how I can achieve this?
Sample logs I'm getting today (Note that the logs of the script itself are not available. Only worker health / status logs are)
1. Ping check every 5 seconds with memory usage
2. Audit logs
3. Jobs execution stats (Running status, job ID, completed / failed etc)
However I don't get the logs of the actual script running within the worker. That is available on the windmill UI, but requires that I setup a volume mount for /tmp/windmill/logs , and log files will be stored there.
Neither that, or storage in S3 is ideal, I want to print the logs of the script to the main worker STDOUT so it can be captured within google cloud logs explorer
Any ideas on how I can achieve this?
Sample logs I'm getting today (Note that the logs of the script itself are not available. Only worker health / status logs are)
