Anya
Anya2mo ago

Setting up a trigger when integrating with BigQuery

I want to only trigger the script when there is a file in my storage (BigQuery) has been modified. What kind of trigger should I set up and use to trigger processing in Windmill?
5 Replies
rubenf
rubenf2mo ago
Hi, best would be that you externally set a webhook for those changes that target windmill but otherwise you would have a regular schedule that poll for new changes with a custom script.
Anya
AnyaOP2mo ago
thank you! What about the Kafka triggers? The process that I wanted to set up is the following. I wanted to create a Pub/Sub topic in BigQuery and a cloud function that will listen to it and send a webhook to Windmill if certain events are happening (like, updates/deletions). So would setting a Kafka trigger do the same job ?
rubenf
rubenf2mo ago
You can indeed Just note that Kafka is ee
Anya
AnyaOP2mo ago
what is ee?
rubenf
rubenf2mo ago
Kafka triggers Entreprise edition

Did you find this page helpful?