Windmill

W

Windmill

Join the community to ask questions about Windmill and get answers from other members.

Join

help

general

changelog

windmill cache vs redis

I was wondering if I should stick to windmill in-built cache, or use redis instead. Im working with quite a lot of data and Im wondering how robust is windmill cache mechanism

Passing Pandas Dataframe Object between componenets.

I feel like I'm missing something but when I try to pass a Pandas Dataframe object from one script to another it becomes a different datatype. Do I need to setup S3 Storage in order to pass objects between scripts?

TypeScript(Deno) unable to find types

Imports in TypeScript(Deno) are causing errors: ``` // Cannot find module 'npm:windmill-client@1.415.1' or its corresponding type declarations.(2307) import * as wmill from "npm:windmill-client@1.415.1"...
No description

weird dependency issue

I have a simple script that connects via SFTP, unzips an archive and returns text content of that unzipped file. It works well during testing but when Im trying to deploy it, I get a dependency issue: error: Could not resolve: "@aws-sdk/client-s3". Maybe you need to "bun install"?. There's no s3 use whatsoever in this script
No description

Realtime timestamp

How do i insert a realtime timestamp on insertion in a mongodb collection?I´ve tried different methods but none worked
No description

What's the recommended way to run dbt transformations?

Currently migrating from a Prefect pipeline which uses https://github.com/datarootsio/prefect-dbt-flow and was wondering how I can run my dbt models in Windmill. This library automatically makes a new Task/Node in the DAG for each dbt model. I'm not really sure what the best way is to pull your dbt files (.sql models & yaml configurations) into Windmill, as well as running them using the dbt CLI. One way I thought of is to package my dbt models (and dbt CLI tool) in a Docker image, which I would then pull from a private registry inside Windmill. This, however, won't handle the breaking-down-into-multiple-tasks (scripts in Windmill) part. Any ideas? I'm also considering trying sqlmesh but I've never used it, but I think it has a similar "deployment" model....

Dev/Prod envs using 2 instances (Community Edition)

Would I encounter any issues if I have 2 GitHub branches: - dev - master and use wmill sync push in a GitHub Action [with 2 different domains / tokens]?...

Is there a way to wait until a recompute function finish?

I am trying to change the state with the result of a background script from a frontend script, is that possible? Eg.: if (typeof (state.system) === 'undefined') {...

Stepper Component Question

I'm having trouble understanding how to do error checking when trying to advance the next step in the stepper but still allowing the user to go backwards. My script attached to the stepper component looks like this. ```def main(stepIndex: int,month:int, year:int,preview_df_exists:list): if stepIndex == 0: if not month or month == 0 or not year: raise Exception("Please Enter a Month and Year.")...

MongoDB deprecation

the resourse type mongodb_rest will no longer be useful for new projects because , the endpoints will be deprecated(https://www.mongodb.com/pt-br/docs/atlas/app-services/deprecation/#std-label-app-services-deprecation). How can I adapt the scripts already created in the mongodb_rest hub to mongodb?

Im getting a authorization error when testing the "Public Form". Also i cannot upload a S3 File

How can i fix it? I need to use the form as public form. Also, the filw upload progress get stuck. Is there a configuration to allow public file uploads to S3? Update: when im logged in, i can upload the files and the flow works fine. But i need it to be available to public access....
No description

Flow start error "InternalErr: Err: Internal: module was not convertible to acceptable value missing

Hi guys, I created some scripts standalone in python which work great, now i want to chain them via flows. It is pretty basic and simpel, I am now trying to run only the first script but i get this error. Where do I look?? Can't figure out where the error comes from....
No description

Delegate in metada

Hi , I'm trying to create a data handler in windmill dev web ui. I'm faced with the challenge of solving the delegate of a data insertion. In the metadata settings, how can I overcome this and set an option that indicates who made the insertion request?

Errors loading flows and apps on Windmill's Home page

Hello everyone! I am experiencing and weird issue that i hadn't before. When I create a flow or an app, it exist in db (app and flow tables), but it doesn't appears in the home page. It did not happen before, but since a few days i am experiencing this bug. Also it happened that when i access the home page, all scripts, flows and apps are not visible because the filter 'include without main function' is always true by default... not sure if this is the cause, but when i turn it off, it loads the...

Unable to use new Spotify OAuth provider

Hi there, Earlier this week, my PR to add a new OAuth provider for Spotify was merged. (https://github.com/windmill-labs/windmill/pull/4581) I've updated the docker images in my self-hosted instance to the release that includes this commit (1.412.0) so that I can try out the new provider....
No description

Typescript error main.main

Hello, good afternoon, does anyone know this error? It occurs in my Typescript steps

10 minutes run limit ?

Hello, I have a flow that includes a task that can take longer than 10 minutes. I notice my flow fails systematically silently at 10 minutes precisely, no matter what script it is in the flow. I have tried: - changing the Time window in seconds in concurrency at the flow level (to 800)...

Weird script python problem

I have an interesting case: I have a python code that returns the transcript from an YouTube video. The transcript is returned if I run in my Windmill installed using docker-compose in my local machine - I used the commands from github. In the windmill SAAS it is not working - it shows the message that the video doesn't have the transcript (but it does). In my VPS installation is not working as well, showing the same error as the SAAS - I installed using the latest version today - 10/23/24 The pictures show Python Code below in comment...
No description

Ansible not usable

Hey all, I am not sure what I messed up but I can’t run Ansible Playbooks for some reason.. once I try to hit Test I get this error here: error during execution of the script:\nNot found: Couldn't find ansible-playbook at /usr/local/bin/ansible-playbook. This probably means that you are not using the windmill-full image. Please use the image windmill-full for your instance in order to run rust jobs. However Googling and asking ChatGPT didn’t get me to some windmill-full images but only to some photographs of some old rusty windmills… any idea on what I can do? I have used the quick start docker compose guide… Thanks in advance...

Multiple main in bundle relative path for preview

Hello, I tried using the beta feature bundle relative paths for preview. I looked at the code that was bundled in the preview, and if multiple functions/variables have the same name, it changes them to function1, function2, etc. The same applies to the main functions. But I think the main function of the script we want to execute might become main1/main2, and therefore the parameters are no longer correct. The main() function should always be the main function of the current script ?...