Setting up a trigger when integrating with BigQuery
I want to only trigger the script when there is a file in my storage (BigQuery) has been modified. What kind of trigger should I set up and use to trigger processing in Windmill?
5 Replies
Hi, best would be that you externally set a webhook for those changes that target windmill but otherwise you would have a regular schedule that poll for new changes with a custom script.
thank you! What about the Kafka triggers?
The process that I wanted to set up is the following.
I wanted to create a Pub/Sub topic in BigQuery and a cloud function that will listen to it and send a webhook to Windmill if certain events are happening (like, updates/deletions).
So would setting a Kafka trigger do the same job ?
You can indeed
Just note that Kafka is ee
what is ee?
Kafka triggers
Entreprise edition