ceph叢集安裝報錯解決方法

1.建立金鑰時報錯

[root@node1 ~]#  ceph-deploy gatherkeys node1

[node1][DEBUG ] get remote short hostname

[node1][DEBUG ] fetch remote file

[node1][INFO  ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --admin-daemon=/var/run/ceph/ceph-mon.node1.asok mon_status

[node1][ERROR ] Not yet quorum for 'node1'

[ceph_deploy.gatherkeys][ERROR ] Failed to connect to host:node1

[ceph_deploy.gatherkeys][INFO  ] Destroy temp directory /tmp/tmpMfWp77

[ceph_deploy][ERROR ] RuntimeError: Failed to connect any mon

解決方法:

[root@node1 ~]# systemctl  stop firewalld

[root@node1 ~]# systemctl   disable firewalld

Removed symlink /etc/systemd/system/multi-user.target.wants/firewalld.service.

Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.

[root@node1 ~]# ceph-deploy --overwrite-conf  mon create-initial

2.使用ceph認證許可權問題

[root@node1 ~]# /bin/ceph --cluster=ceph osd stat --format=json

2019-04-25 09:16:31.404 7f5a501ac700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory

2019-04-25 09:16:31.404 7f5a501ac700 -1 monclient: ERROR: missing keyring, cannot use cephx for authentication

[errno 2] error connecting to the cluster

解決方法:

[root@node1 ~]# find / -name ceph.client.admin.keyring

/root/ceph.client.admin.keyring

[root@node1 ~]# cp -a  /root/ceph.client.admin.keyring  /etc/ceph/

[root@node1 ~]# chmod +r ceph.client.admin.keyring

[root@node1 ~]# /bin/ceph --cluster=ceph osd stat --format=json

{"epoch":7,"num_osds":1,"num_up_osds":1,"num_in_osds":1,"full":false,"nearfull":false,"num_remapped_pgs":0}

[root@node1 ~]# ceph health

HEALTH_WARN no active mgr

[root@node1 ~]#

3.使用ceph health顯示沒有啟用mgr

[root@node1 ~]# ceph health

HEALTH_WARN no active mgr

[root@node1 ~]#

解決方法:

[root@node1 ~]# ceph-deploy mgr create node1 node2 node3    --建立mgr程式

[root@node1 ~]# ceph health

HEALTH_OK

[root@node1 ~]# ceph mgr metadata

4.安裝好ceph後系統重啟報錯(進入不了終端)

Restarting network (Via systemctl): Error getting authority: Error initializing authority: Could not connect: No such file or directory (g-io-error-quark,1)

Welcome to emergency mode!Aftle logging in,type "journalcel -xb" to view

system logs,"systemctl reboot" to reboot,"systemctl default" or ^D to

try again to boot into default mode.

Give root password for maintenance

(  Control-D   )

login incorrect

解決方法:

註釋osd磁碟分割槽,不能將osd分割槽掛載,否則會進入不了系統,也可在分割槽的defaults後面加入nofail引數,用逗號隔開

[root@node2 ~]# cat /etc/fstab 

# /etc/fstab

# Created by anaconda on Wed Apr 24 20:17:43 2019

# Accessible filesystems, by reference, are maintained under '/dev/disk'

# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info

UUID=2096e465-9251-4dd7-93c7-a163adba6209    /                       xfs     defaults        0 0

UUID=76236dfd-510d-4d33-9071-3f2ecfeee3f7     /boot                   xfs     defaults        0 0

# UUID=zDLnfa-iAwr-yp1k-C19m-8oOC-iLmS-agJarY   /data            ext4   defaults        0 0     --註釋osd磁碟分割槽,不能掛載

UUID=e1f86a97-a02f-47aa-bd1e-6aaae4db60f7 swap                     swap    defaults      0 0

[root@node2 ~]#