Sign inSign up

rayproject/ray-llm

By rayproject

•Updated about 2 hours ago

Developer ready Docker Image for Ray with LLM.

Image
2

100K+

rayproject/ray-llm repository overview

This image is an extension of the rayproject/ray⁠ image. It includes extended requirements to use ray[llm]

⁠Tags

  • :latest⁠ - The most recent Ray release.
  • :2.x.x - A specific release build.
  • :nightly⁠ - The most recent nightly build.
⁠Suffixes
  • -cu12x - These are based off of an NVIDIA CUDA image. They require the Nvidia Docker Runtime⁠ to be installed on the host for the container to access GPUs.

⁠Other Images

⁠License

Apache-2.0⁠

Tag summary

Content type

Image

Digest

sha256:36f3b535d…

Size

10.6 GB

Last updated

about 2 hours ago

docker pull rayproject/ray-llm:nightly-py312-cu130