fr3fou•4mo ago

`ApiError: Internal Server Error` when writing a 2MB csv file

Using the wmill.writeS3File function to write a small csv file from ~20k lines and it seems to give this error.

ApiError: Internal Server Error
ApiError: Internal Server Error
    at catchErrorCodes (file:///tmp/windmill/cache/deno/npm/registry.npmjs.org/windmill-client/1.365.0/dist/core/request.js:224:15)
    at file:///tmp/windmill/cache/deno/npm/registry.npmjs.org/windmill-client/1.365.0/dist/core/request.js:269:45
    at Generator.next (<anonymous>)
    at fulfilled (file:///tmp/windmill/cache/deno/npm/registry.npmjs.org/windmill-client/1.365.0/dist/core/request.js:5:58)
    at eventLoopTick (ext:core/01_core.js:168:7)

ApiError: Internal Server Error
ApiError: Internal Server Error
    at catchErrorCodes (file:///tmp/windmill/cache/deno/npm/registry.npmjs.org/windmill-client/1.365.0/dist/core/request.js:224:15)
    at file:///tmp/windmill/cache/deno/npm/registry.npmjs.org/windmill-client/1.365.0/dist/core/request.js:269:45
    at Generator.next (<anonymous>)
    at fulfilled (file:///tmp/windmill/cache/deno/npm/registry.npmjs.org/windmill-client/1.365.0/dist/core/request.js:5:58)
    at eventLoopTick (ext:core/01_core.js:168:7)

If I try the same script with less data (thus making the file smaller), e.g. 5k csv lines it works fine. Upping it to 10k (it's ~1MB then), it still crashes. I'm also confident that it's not the serialization that's failing and it is indeed the call to writeS3File. Running CE v1.365.0, self hosted, Deno TypeScript, Self Hosted Minio

1 Reply

fr3fou•4mo ago

right, taking a closer look at the worker logs:

InternalErr(\"Error finishing multipart upload: Generic S3 error: Client error with status 408 Request Timeout: Request timeout\")

InternalErr(\"Error finishing multipart upload: Generic S3 error: Client error with status 408 Request Timeout: Request timeout\")

clearly gives me the answer :D - updated my nginx ingress to add some timeout annotations and that fixed it