trying out windmill.dev
Since this is my first encounter with windmill.dev I’m thinking of trying it out for my own personal use case
I have a monthly housekeeping task where I need to download pdf from my digital invoices from the emails
Upload the pdf to google drive...
apache iceberg / asset view
Hi @kimsia , you're correct that right now dagster focus on assets while windmill focus on compute. One way to see it is that windmill is lower level than dagster and you can build your own asset abstraction on top of it. We emphasize using object stores such as S3 by passing pointers/reference to it as input or output. When doing that, you can preview parquet files directly in the ui and cache based on etags.
The asset view is an abstraction on top of that we will build based on apache iceberg later but for now some of it you will have to decide for yourself. On the other hand, windmill is a lot more performant and flexible than dagster with respect to execution...
No concurrency limits is the right way
No concurrency limits is the right way to do it. WDYM by none of them will actually execute ?
Is there a way to create a form that can take a variable number of arguments?
Hi @paul , if you can write the schema as a result of the last job, we can add support for picking it up from there
any recommendations for python scripts
any recommendations for python scripts throwing "RuntimeError: can't start new thread"? i thought about reducing the number of workers on each server (some have 8). but maybe there is a better way like increasing limits?
I'm working on using windmill as our
I'm working on using windmill as our platform for all integrations of our ERP with external APIs. We need to integrate with stripe for credit card processing. We want to use the stripe checkout form, which means redirecting to their URL after running some code to create the checkout session. I built a script that is triggered at this URL:
https://app.windmill.dev/api/w/velvac-ifs-integrations/jobs/run_wait_result/p/f/stripe/internal_checkout
With token-in-query, I should be able to just hit this from a link in the browser. But since I do not have access to the response object in that typescript function, I do not see how I can redirect to the URL for the stripe checkout. Is there a way to get access to the response object so I can do a redirect?...
Hi, I have a script that is suddenly
Hi, I have a script that is suddenly failing quite often with the error
ExecutionErr: error during execution of the script: process terminated by signal: Some( 9, ), stopped_signal: None, core_dumped: false...
Hi, I think the ActiveDirectory module
Hi, I think the ActiveDirectory module is only available on windows and can't be installed on other platforms. Depending on what your need is, you might find alternative modules available on PSGallery (e.g. AzureAD)
i have the following use case
i have the following use case
in a flow i have two consecutive scripts:
1. fetch auth token (cached for 1 hour)
2. do request with auth token...
@Lysanleo on EE we have a new way to use
@Lysanleo on EE we have a new way to use local codebases which use a bundler under the hood
@Alper we expose prometheus metrics and
@Alper we expose prometheus metrics and those should be inferrable from those but note that this quarter we are working on a big push to observability which those kind of alerts would be part of
can you try on another smaller workspace
can you try on another smaller workspace to see if it's workspace specific
Is it possible to have a for or while
Is it possible to have a for or while loop in a flow that feeds the result of the previous iteration into the next iteration?
I basically have a list of transformations to apply on the initial input data. Each iteration takes the previous result and applies the next transformation....