franc2002/wyoming-whisper-cpp repository overview

⁠NOTE

if you are interest in this project, you may want to use this instead https://hub.docker.com/r/franc2002/wyoming-parakeet⁠

⁠Simple STT server using wyoming protocol and whisper.cpp.

Currently built for:

• vulkan (with mesa driver)
• rocm 6.3, 7.2

Rocm builds tend to have better performance than vulkan, but limited support on only some amd radeon gpu. See amd website for more information.

It is possible to build other images for CUDA, OpenVINO and other framework supported by whisper.cpp.

Whisper.cpp permits to use quantized models, with the benefits to reduce memory and disk space requirements and, depending on the hardware, increase the processing efficiency.

See github for source code and other info: https://github.com/albe873/wyoming-whisper-cpp⁠