Troublehtml
I'm practice setting up ceph cluster using VMs. Everything went smoothly util "ceph-deploy mon create-initial". The following are WARN and ERROR message abstracted from log: .... [ceph_deploy.mon][WARNIN] mon.ceph1 monitor is not yet in quorum, tries left: 5 [ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying [ceph1][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph1.asok mon_status [ceph_deploy.mon][WARNIN] mon.ceph1 monitor is not yet in quorum, tries left: 4 [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying .... [ceph_deploy.gatherkeys][WARNIN] Unable to find /etc/ceph/ceph.client.admin.keyring on ceph1 ... [ceph_deploy.gatherkeys][WARNIN] Unable to find /etc/ceph/ceph.client.admin.keyring on ceph2 .... [ceph_deploy.gatherkeys][WARNIN] Unable to find /etc/ceph/ceph.client.admin.keyring on ceph3 [ceph_deploy][ERROR ] KeyNotFoundError: Could not find keyring file: /etc/ceph/ceph.client.admin.keyring on host ceph1, /etc/ceph/ceph.client.admin.keyring on host ceph2, /etc/ceph/ceph.client.admin.keyring on host ceph3 ===end=== I'm following this doc:https://www.suse.com/documentation/ses-2/book_storage_admin/data/ceph_install_ceph-deploy.html#ceph_install_ceph-deploy_eachnode
workaroundnode
Aha, looks it works now! So I can make progress and create OSDs ;-) ceph@ceph1:~> sudo ceph-create-keys --verbose --id ceph1 INFO:ceph-create-keys:Talking to monitor... INFO:ceph-create-keys:Talking to monitor... INFO:ceph-create-keys:Talking to monitor... INFO:ceph-create-keys:Talking to monitor... Executing on each node, then: ceph@admin:~/ceph-deploy> ceph-deploy gatherkeys ceph1 ceph2 ceph3 [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for /etc/ceph/ceph.client.admin.keyring [ceph1][DEBUG ] connection detected need for sudo [ceph1][DEBUG ] connected to host: ceph1 [ceph1][DEBUG ] detect platform information from remote host [ceph1][DEBUG ] detect machine type [ceph1][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][DEBUG ] Got ceph.client.admin.keyring key from ceph1. [ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for /var/lib/ceph/bootstrap-osd/ceph.keyring [ceph1][DEBUG ] connection detected need for sudo [ceph1][DEBUG ] connected to host: ceph1 [ceph1][DEBUG ] detect platform information from remote host [ceph1][DEBUG ] detect machine type [ceph1][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][DEBUG ] Got ceph.bootstrap-osd.keyring key from ceph1. [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for /var/lib/ceph/bootstrap-mds/ceph.keyring [ceph1][DEBUG ] connection detected need for sudo [ceph1][DEBUG ] connected to host: ceph1 [ceph1][DEBUG ] detect platform information from remote host [ceph1][DEBUG ] detect machine type [ceph1][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][DEBUG ] Got ceph.bootstrap-mds.keyring key from ceph1. [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for /var/lib/ceph/bootstrap-rgw/ceph.keyring [ceph1][DEBUG ] connection detected need for sudo [ceph1][DEBUG ] connected to host: ceph1 [ceph1][DEBUG ] detect platform information from remote host [ceph1][DEBUG ] detect machine type [ceph1][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][DEBUG ] Got ceph.bootstrap-rgw.keyring key from ceph1.