Sign inSign up

rayproject/ray-llm

By rayproject

Updated about 6 hours ago

Developer ready Docker Image for Ray with LLM.

Image
2

100K+

rayproject/ray-llm repository overview

This image is an extension of the rayproject/ray image. It includes extended requirements to use ray[llm]

Tags

  • :latest - The most recent Ray release.
  • :2.x.x - A specific release build.
  • :nightly - The most recent nightly build.
Suffixes
  • -cu12x - These are based off of an NVIDIA CUDA image. They require the Nvidia Docker Runtime to be installed on the host for the container to access GPUs.

Other Images

License

Apache-2.0

Tag summary

Content type

Image

Digest

sha256:639db14e8

Size

10.7 GB

Last updated

about 6 hours ago

docker pull rayproject/ray-llm:nightly-py312-cu130