pool

llama.cpp for quantizing and inferencing large language models in C++

https://github.com/knguyen298/llama-swap-gfx906

Llama.cpp server bundled with 2 general small AI.

Alpine python image with AWS command-line tools.

Example NodeJS app