tenhkspark/gemma-4-v2 repository overview

⁠Gemma 4 26B-A4B on DGX Spark, v2

Serving image for the NVFP4 build of Gemma 4 26B-A4B on a single DGX Spark (vLLM 0.28). Model weights: tenhkspark/gemma-4-26B-A4B-NVFP4-lmhead⁠. Setup files and documentation: tenhkspark/gemma4-spark⁠.

docker pull tenhkspark/gemma-4-v2:v2
cp gemma4-v2*.env gemma4-v2-serve.sh chat_template.jinja ~/gemma4-spark/
cd ~/gemma4-spark && ./gemma4-v2-serve.sh --env gemma4-v2-balanced.env up

The server listens on port 8890 (/v1/chat/completions).

⁠Tags

• v2 (also latest)

Use of the model remains subject to the Gemma Terms of Use.