openeuler/livy repository overview

⁠Quick reference

• The official Livy docker image.

• Maintained by: openEuler CloudNative SIG⁠.

• Where to get help: openEuler CloudNative SIG⁠, openEuler⁠.

⁠Livy | openEuler

Current Livy docker images are built on the openEuler⁠. This repository is free to use and exempted from per-user rate limits.

Livy is the blazing-fast, scalable SQL query engine for modern data analytics.

Learn more on Livy website⁠.

⁠Supported tags and respective Dockerfile links

The tag of each livy docker image is consist of the version of livy and the version of basic image. The details are as follows

⁠Usage

In this usage, users can select the corresponding {Tag} based on their requirements.

• Pull the openeuler/livy image from docker

  docker pull openeuler/livy:{Tag}
  

  Copy

• Run the container in the background

  docker run -d -p 8998:8998 -v /path/to/livy.conf:/opt/livy/conf/livy.conf --name livy openeuler/livy:{Tag}
  

  Copy

  Options description:

  • -p, Specifies the port number (must match livy.server.port in livy.conf)
  • -v, Specifies the Livy configuration file livy.conf

• Test Submitting a Spark Job

  Try submitting a simple Spark job (e.g., PySpark or Scala code) through Livy to verify full functionality. For example:

  curl -X POST \
  -H "Content-Type: application/json" \
  -d '{"kind": "spark"}' \
  http://localhost:8998/sessions
  

  Copy

  If a session ID (e.g., {"id":0,...}) is returned, it indicates successful integration between Livy and Spark.

• Check Session Status

  Run the following command to check the real-time status of session 0:

  curl http://localhost:8998/sessions/0
  

  Copy

  If the response shows "state": "idle", the Spark session is ready for code submission. If it returns "error", check the logs for troubleshooting.

• Start using Livy

  Once the Livy server is running, you can connect to it on port 8998 (this can be changed with the livy.server.port config option). Some examples to get started are provided here⁠, or you can check out the API documentation:

  • REST API⁠
  • Programmatic API⁠

⁠Question and answering

If you have any questions or want to use some special features, please submit an issue or a pull request on openeuler-docker-images⁠.