IBM Granite 4.0 Tiny Q8 GGUF Rust Distroless - CPU
Rust distroless Arcee trinity-nano CPU inference
Rust distroless OpenAI gpt-oss-20b cuda inference - GPU
Rust distroless qwen3-reranker-8B
Rust distroless qwen3-embed-06b
Rust distroless qwen3-reranker-0.6B
Rust distroless qwen3-embed-06b