openKylin论坛
标题: Ceph快速配置 [打印本页]
作者: dragonfly 时间: 2013-4-29 21:55
标题: Ceph快速配置
本帖最后由 dragonfly 于 2013-4-30 22:34 编辑
Ceph快速配置
两台机器：一台server，一台client，安装ubuntu12.04
其中，server安装时，另外分出两个区，作为osd0、osd1的存储，没有的话，系统安装好后，使用loop设备虚拟出两个也可以。
步骤：
1、服务端安装CEPH (MON、MDS、OSD)
2、添加key到APT中，更新sources.list，安装ceph
#sudo wget -q -O- 'https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc' | sudo apt-key add -
# sudo apt-get update && sudo apt-get install ceph
3、查看版本
# ceph-v //将显示ceph的版本和key信息
如果没有显示，请执行如下命令
# sudo apt-get update && apt-get upgrade
4、在/etc/ceph/下创建ceph.conf配置文件，并将配置文件拷贝到其它服务端。
# For version 0.55 and beyond, you must explicitly enable
# or disable authentication with "auth" entries in [global].
auth cluster required = none
auth service required = none
auth client required = none
#The following assumes ext4 filesystem.
filestore xattr use omap = true
# For Bobtail (v 0.56) and subsequent versions, you may
# add settings for mkcephfs so that it will create and mount
# the file system on a particular OSD for you. Remove the comment `#`
# character for the following settings and replace the values
# in braces with appropriate values, or leave the following settings
# commented out to accept the default values. You must specify the
# --mkfs option with mkcephfs in order for the deployment script to
# utilize the following settings, and you must define the 'devs'
# option for each osd instance; see below.
osd mkfs options xfs = -f # default for xfs is "-f"
osd mount options xfs = rw,noatime # default mount option is "rw,noatime"
# For example, for ext4, the mount option might look like this:
#osd mkfs options ext4 = user_xattr,rw,noatime
# Execute $ hostname to retrieve the name of your host,
# and replace {hostname} with the name of your host.
# For the monitor, replace {ip-address} with the IP
mon addr = 192.168.4.165:6789
# For Bobtail (v 0.56) and subsequent versions, you may
# add settings for mkcephfs so that it will create and mount
# the file system on a particular OSD for you. Remove the comment `#`
# character for the following setting for each OSD and specify
# a path to the device if you use mkcephfs with the --mkfs option.
5、创建目录
sudo mkdir -p /var/lib/ceph/osd/ceph-0
sudo mkdir -p /var/lib/ceph/osd/ceph-1
sudo mkdir -p /var/lib/ceph/mon/ceph-a
sudo mkdir -p /var/lib/ceph/mds/ceph-a
6、创建分区与挂载
fdisk /dev/sda //创建sda6分区
mkfs.xfs -f /dev/sda7
mount /dev/sda7 /var/lib/ceph/osd/ceph-0 (第一次必须先挂载分区写入初始化数据)
7、执行初始化
sudo mkcephfs -a -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.keyring
8、启动
# sudo service ceph -a start
9、执行健康检查
sudo ceph health
如果返回的是 HEALTH_OK,代表成功！
出现： HEALTH_WARN 576 pgs stuck inactive; 576 pgs stuck unclean; no osds之类的，请执行：
#ceph pg dump_stuck stale
#ceph pg dump_stuck inactive
#ceph pg dump_stuck unclean
再次健康检查是，应该是OK
注意：重新执行如下命令#sudo mkcephfs -a -c /etc/ceph/ceph.conf -k ceph.keyring前，所有服务端停止ceph服务在清空创建的四个目录：/var/lib/ceph/osd/ceph-0、/var/lib/ceph/osd/ceph-1、 /var/lib/ceph/mon/ceph-a、/var/lib/ceph/mds/ceph-a
#/etc/init.d/ceph stop
# rm –frv /var/lib/ceph/osd/ceph-0/*
# rm –frv /var/lib/ceph/osd/ceph-1/*
# rm –frv /var/lib/ceph/mon/ceph-a/*
# rm –frv /var/lib/ceph/mds/ceph-a/*
三、 CephFS的使用
在客户端上操作：
sudo mkdir /mnt/mycephfs
sudo mount -t ceph {ip-address-of-monitor}:6789:/ /mnt/mycephfs
或者
sudo mkdir /home/{username}/cephfs
sudo ceph-fuse -m {ip-address-of-monitor}:6789 /home/{username}/cephfs
# df –h 查看
作者: 昊在月儿湾 时间: 2013-4-30 19:58
健康检查时，出现 HEALTH_WARN 576 pgs stuck inactive; 576 pgs stuck unclean; no osds之类的，其实什么操作也可以不用进行，等 待一会再ceph health就是OK的，应该是启动后各节点上还有些初始化的工作没做
作者: 昊在月儿湾 时间: 2013-5-3 08:23
这篇文章的真正出处在这里， https://lists.launchpad.net/kyteam/dockv08PwxTHX.doc 。 我写的，传到了launchpad上，被人盗用了，呵呵
| 欢迎光临 openKylin论坛 (https://forum.openkylin.top/) |
Powered by Discuz! X3.3 |