arbidev

creates passthrough endpoint that makes infinity server's reranker response compatible with Cohere

image of https://github.com/theroyallab/tabbyAPI, using repo Dockerfile. suitable for kubernetes.

Pre-built image of https://github.com/oobabooga/text-generation-webui with TORCH_CUDA_ARCH=8.9