For playbooks to be executed in windmill they need to be windmill "scripts". So you will need to make a script out of each playbook. Importing a bunch of playbooks from a repo is not supported out of the box but it should be easy to automate with the windmill cli.
Currently, only static inventories are supported, they are stored as a windmill resource.