weyp

Server API for inference on vision-language models form HF

Ready to use llama.cpp python server with OpenAI compatible API and autodownloader for HF models