Troubleshoot Ceph Storage with Ceph Tool for OpenShift Data Foundation

Image by Leo Hau from Pixabay

You may want to troubleshoot some Ceph storage issue that are coming from OpenShift Data Foundation (ODF). In the rook operator based Ceph storage solution, you can deploy the “rook-ceph-tools” deployment to have the ceph command line tool for the troublshooting purpose. In the ODF operator the ceph command line tool is actually available.

Launch of the Ceph Command Line Tool

Exec into the rook-ceph-operator pod in the ODF namespace,

oc -n openshift-storage exec -it rook-ceph-operator-5ff898fc8-pppgd -- bash

cd /var/lib/rook/openshift-storage
ls
client.admin.keyring  openshift-storage.config

The file openshift-storage.config availalble in the /var/lib/rook/openshift-storage directory can be used to as the ceph config file where the MON hosts and the admin client’s keyring are defined.

[global]
fsid                = 520035a-0552-461a-a194-46dca45ba8fc
mon initial members = j k h
mon host            = [v2:172.30.26.44:3300, v1:172.30.26.44:6789], [v2:172.30.16.22:3300, v1:172.30.16.22:6789], [v2:172.30.140.78:3300, v1:172.30.140.78:6789]

...

[osd]
osd_memory_target_cgroup_limit_ratio = 0.8
[client.admin]
keyring = /var/lib/rook/openshift-storage/client.admin.keyring