cucker/ceph_daemon repository overview

⁠ceph_daemon

⁠What's ceph_daemon image

Based on image ceph/daemon, fixed some shell scripts bug.

⁠Supported tags and respective Dockerfile links

• latest⁠

⁠How to use this image

Reference ceph/daemon⁠

• For example

  • OSD_TYPE=directory

    First, in the host make the disk partion or vg/lv mount on /ceph-rbd

    docker run -d --privileged --restart=always --name osd \
     --net host \
     --pid=host \
     -v /etc/ceph:/etc/ceph \
     -v /var/lib/ceph:/var/lib/ceph \
     -v /dev/:/dev/ \
     -v /ceph-rbd:/var/lib/ceph/osd \
     -e OSD_TYPE=directory \
     cucker/ceph_daemon osd
    

    Copy

  • OSD_TYPE=disk

    docker run -d --name osd \
     --restart=always \
     --net=host \
     --privileged=true \
     --pid=host \
     -v /etc/ceph:/etc/ceph \
     -v /var/lib/ceph/:/var/lib/ceph/ \
     -v /dev/:/dev/ \
     -v /run/udev/:/run/udev/ \
     -e OSD_DEVICE=/dev/sdb \
     -e OSD_TYPE=disk \
     -e OSD_BLUESTORE=1 \
     cucker/ceph_daemon osd
    

    Copy

    docker run -d --name osd \
     --restart=always \
     --net=host \
     --privileged=true \
     --pid=host \
     -v /etc/ceph:/etc/ceph \
     -v /var/lib/ceph/:/var/lib/ceph/ \
     -v /dev/:/dev/ \
     -v /run/udev/:/run/udev/ \
     -e OSD_DEVICE=/dev/sdb \
     -e OSD_BLUESTORE_BLOCK_DB=<vg/lv01 or partion_of_disk> \
     -e OSD_TYPE=disk \
     -e OSD_BLUESTORE=1 \
     cucker/ceph_daemon osd
    

    Copy

    docker run -d --name osd \
     --restart=always \
     --net=host \
     --privileged=true \
     --pid=host \
     -v /etc/ceph:/etc/ceph \
     -v /var/lib/ceph/:/var/lib/ceph/ \
     -v /dev/:/dev/ \
     -v /run/udev/:/run/udev/ \
     -e OSD_DEVICE=/dev/sdb \
     -e OSD_BLUESTORE_BLOCK_DB=<vg/lv01 or partion_of_disk> \
     -e OSD_BLUESTORE_BLOCK_WAL=<vg/lv02 or partion_of_disk> \
     -e OSD_TYPE=disk \
     -e OSD_BLUESTORE=1 \
     cucker/ceph_daemon osd
    

    Copy

⁠Fixed bugs

• when OSD_TYPE=directory or ceph/daemon, osd_directory, the OSD size max is 100GiB.

  there is a case like this. ref ceph osd df size shows wrong, smaller number⁠

  docker run -d --privileged --restart=always --name osd \
   --net host \
   --pid=host \
   -v /etc/ceph:/etc/ceph \
   -v /var/lib/ceph:/var/lib/ceph \
   -v /dev/:/dev/ \
   -v /ceph-rbd:/var/lib/ceph/osd \
   -e OSD_TYPE=directory \
   ceph/daemon osd
  

  Copy

  docker create --privileged --restart=always --name osd_04 \
   --net host \
   --pid=host \
   -v /etc/ceph:/etc/ceph \
   -v /var/lib/ceph:/var/lib/ceph \
   -v /dev/:/dev/ \
   -v /osd/sdc/:/var/lib/ceph/osd \
   -e OSD_TYPE=directory \
   ceph/daemon osd
  

  Copy

• fixed ceph-disk: command not found

  OSD_TYPE=disk and OSD_BLUESTORE=1

  docker run --name osd \
   --restart=always \
   --net=host \
   --privileged=true \
   --pid=host \
   -v /etc/ceph:/etc/ceph \
   -v /var/lib/ceph/:/var/lib/ceph/ \
   -v /dev/:/dev/ \
   -v /run/udev/:/run/udev/ \
   -e OSD_DEVICE=/dev/sdb \
   -e OSD_TYPE=disk \
   -e OSD_BLUESTORE=1 \
   ceph/daemon osd
  

  Copy

  /opt/ceph-container/bin/osd_disk_prepare.sh: line 46: ceph-disk: command not found
  

  Copy

  use ceph-volume instead of ceph-disk

• fixed BLUESTORE bugs

⁠Others

• How to debug ceph/daemon

  docker run -dit --privileged --restart=always --name osd_test \
   --net host \
   --pid=host \
   -v /etc/ceph:/etc/ceph \
   -v /var/lib/ceph:/var/lib/ceph \
   -v /dev/:/dev/ \
   -v /osd/sdc/:/var/lib/ceph/osd \
   -e OSD_TYPE=directory \
   --entrypoint /usr/bin/bash \
   ceph/daemon read
   
   // Enter container
   docker exec -it osd_test bash
  

  Copy