Ceph常見問題(持續匯總中)
問題1,ceph application not enabled on 1 pool(s)
解決方法, 手工給pool追加application
root@ceph-node3:~# ceph osd pool application enable cephfs_data cephfs
root@ceph-node3:~# ceph osd pool application enable cephfs_metadata cephfs
root@ceph-node3:~# ceph osd pool application enable rbd rbd --yes-i-really-mean-it
問題2, authentication error connecting to the cluster
root@ceph-client:~# ceph -s
2017-08-05 19:27:40.722096 7fa149759700 0 librados: client.admin authentication
[errno 1] error connecting to the cluster
解決方法
root@ceph-admin:~/my-cluster# ceph-deploy install ceph-client
root@ceph-admin:~/my-cluster# ceph-deploy --overwrite-conf admin ceph-client
root@ceph-client:~# ceph -s
cluster:
id: 135bca7f-4582-4d35-a1fa-aa9b86b9c730
health: HEALTH_OK
services:
mon: 3 daemons, quorum ceph-node1,ceph-node2,ceph-node3
mgr: ceph-node3(active), standbys: ceph-node2, ceph-node1
mds: 1/1/1 up {0=ceph-node3=up:active}, 2 up:standby
osd: 3 osds: 3 up, 3 in
rgw: 3 daemons active
data:
pools: 7 pools, 68 pgs
objects: 212 objects, 3394 bytes
usage: 3509 MB used, 27211 MB / 30720 MB avail
pgs: 68 active+clean
root@ceph-client:~#
問題3, feature set mismatch
在CephFS, RBD測試過程遭遇這個問題, Mount Ceph FS with the Kernel Driver
root@ceph-client:~# mount /root/test_fs
mount error 110 = Connection timed out
root@ceph-client:/var/log# tail -f syslog
Aug 5 14:03:06 ceph-client kernel: [ 565.194592] libceph: mon0 192.168.56.201:6789 feature set mismatch, my 107b84a842aca < servers 40107b84a842aca, missing 400000000000000
解決方法
root@ceph-client:/var/log# ceph osd crush tunables hammer
root@ceph-client:/var/log# ceph osd crush reweight-all
問題4, librados: client.bootstrap-rgw authentication error (1) Operation not permitted
解決方法, 重新copy key到正確路徑
root@ceph-admin:~/my-cluster# cp ceph.bootstrap-rgw.keyring /var/lib/ceph/bootstrap-rgw/ceph.keyring
問題5, s3cmd 無法生成bucket, gaierror: [Errno -2] Name or service not known
問題6, IE無法訪問Bucket - AccessDenied
http://192.168.56.200:7480/my-new-bucket
<?xml version="1.0" encoding="UTF-8"?>
-<Error>
<Code>AccessDenied</Code>
<BucketName>my-new-bucket</BucketName>
<RequestId>tx000000000000000000007-00598d4b45-78a3e-default</RequestId>
<HostId>78a3e-default-default</HostId>
</Error>
問題7, 需要disable 4個features,才能mount起來cephfs使用
問題8, osd pg number exceeds 300
解決方法
在ceph-admin上更新配置文件!
vi /root/my-cluster/ceph.conf
mon_pg_warn_max_per_osd = 1000
同步最新配置文件到整個Cluster
ceph-deploy --overwrite-conf config push ceph-admin ceph-node1 ceph-node2 ceph-node3
重啟各個Mon, OSD
root@ceph-node3:/etc/ceph# systemctl restart ceph-mon.target
root@ceph-node3:/etc/ceph# systemctl restart ceph-osd.target
問題9, 在fstab中添加rdb device的mount entry, 導致系統不能自動啟動,需要每次執行
rbd map rbd/rbd_test_image --id admin --keyring /etc/ceph/ceph.client.admin.keyring
這個問題需要進一步trouble shooting
問題10, Failed to start Ceph object storage daemon 系統啟動時遭遇這個failure
推薦閱讀: