ceph详细安装部署教程.docx

ceph详细安装部署教程.docx

《ceph详细安装部署教程.docx》由会员分享，可在线阅读，更多相关《ceph详细安装部署教程.docx（8页珍藏版）》请在冰豆网上搜索。

ceph详细安装部署教程

ceph详细安装部署教程（多监控节点）

一、前期准备安装ceph-deploy工具所有的服务器都是用root用户登录的1、安装环境系统centos-6.5设

备：

1台admin-node（ceph-ploy）1台monistor2台osd2、

关闭所有节点的防火墙及关闭selinux，重启机器。

serviceiptablesstopsed-i'/SELINUX/s/enforcing/disabled/'/etc/selinux/configchkconfigiptablesoff3、编辑admin-node节点的cephyum仓库vi/etc/yum.repos.d/ceph.repo[ceph-noarch]name=Cephnoarchpackagesbaseurl==1gpgcheck=1type=rpm-mdgpgkey=p=ceph.git;a=blob_plain;f=keys/release.asc4、安装搜狐的epel仓库rpm-ivh-6-8.noarch.rpm5、更新admin-node节点的yum源yumcleanallyumupdate-y6、在admin-node节点上建立一个ceph集群目录mkdir/cephcd/ceph7、在admin-node节点上安装ceph部署工具yuminstallceph-deploy-y8、配置admin-node节点的hosts文件vi/etc/hosts10.240.240.210admin-node10.240.240.211

node110.240.240.212node210.240.240.213node3二、配

置ceph-deploy部署的无密码登录每个ceph节点1、在每个Ceph节点上安装一个SSH服务器[ceph@node3~]$yuminstallopenssh-server-y2、配置您的admin-node管理节点与每个Ceph节点无密码的SSH访问。

[root@ceph-deployceph]#ssh-keygenGeneratingpublic/privatersakeypair.Enterfileinwhichtosavethekey（/root/.ssh/id_rsa）:

Enterpassphrase（emptyfornopassphrase）:

Entersamepassphraseagain:

Youridentificationhasbeensavedin/root/.ssh/id_rsa.Yourpublickeyhasbeensavedin/root/.ssh/id_rsa.pub.3、复制admin-node节点的秘钥到每个ceph节点ssh-copy-idroot@admin-nodessh-copy-idroot@node1ssh-copy-idroot@node2ssh-copy-idroot@node34、测试每台ceph节点不用密码是否可以登录sshroot@node1sshroot@node2sshroot@node35、修改admin-node管理节点的~/.ssh/config文件，这样它登录到Ceph节点创建的用户Hostadmin-nodeHostnameadmin-nodeUserroot

Hostnode1Hostnamenode1UserrootHostnode2Hostnamenode2UserrootHostnode3Hostnamenode3Userroot三、用ceph-deploy工具部署ceph集群

1、在admin-node节点上新建一个ceph集群

[root@admin-nodeceph]#ceph-deploynewnode1node2node3（执行这条命令后node1node2node3都作为了monitor节点，多个mon节点可以实现互备）[ceph_deploy.conf][DEBUG]foundconfigurationfileat:

/root/.cephdeploy.conf[ceph_deploy.cli][INFO]Invoked（1.5.3）:

/usr/bin/ceph-deploynewnode1node2node3[ceph_deploy.new][DEBUG]Creatingnewclusternamedceph[ceph_deploy.new][DEBUG]Resolvinghostnode1[ceph_deploy.new][DEBUG]Monitornode1at10.240.240.211[ceph_deploy.new][INFO]makingsure

passwordlessSSHsucceeds[node1][DEBUG]connectedtohost:

admin-node[node1][INFO]Runningcommand:

ssh-CT-oBatchMode=yesnode1[ceph_deploy.new][DEBUG]Resolvinghostnode2[ceph_deploy.new][DEBUG]Monitornode2at10.240.240.212[ceph_deploy.new][INFO]makingsure

passwordlessSSHsucceeds[node2][DEBUG]connectedtohost:

admin-node[node2][INFO]Runningcommand:

ssh-CT-oBatchMode=yesnode2[ceph_deploy.new][DEBUG]Resolvinghostnode3[ceph_deploy.new][DEBUG]Monitornode3at10.240.240.213[ceph_deploy.new][INFO]makingsure

passwordlessSSHsucceeds[node3][DEBUG]connectedtohost:

admin-node[node3][INFO]Runningcommand:

ssh-CT-oBatchMode=yesnode3[ceph_deploy.new][DEBUG]Monitorinitialmembersare['node1','node2','node3'][ceph_deploy.new][DEBUG]Monitoraddrsare['10.240.240.211','10.240.240.212','10.240.240.213'][ceph_deploy.new][DEBUG]Creatingarandommonkey...[ceph_deploy.new][DEBUG]Writinginitialconfigtoceph.conf...[ceph_deploy.new][DEBUG]Writingmonitorkeyringtoceph.mon.keyring...查看生成的

文件[root@admin-nodeceph]#lsceph.confceph.log

ceph.mon.keyring查看ceph的配置文件，三个节点都变为了控制节点[root@admin-nodeceph]#catceph.conf[global]auth_service_required=cephxfilestore_xattr_use_omap=trueauth_client_required=cephxauth_cluster_required=cephxmon_host=10.240.240.211,10.240.240.212,10.240.240.213mon_initial_members=node1,node2,node3fsid=4dc38af6-f628-4c1f-b708-9178cf4e032b[root@admin-nodeceph]#2、部署之前确保ceph每个节点没有ceph数据包（先清空之前所有的ceph数据，如果是新装不用执行此步

骤，如果是重新部署的话也执行下面的命令）

[root@ceph-deployceph]#ceph-deploypurgedata

admin-nodenode1node2node3[root@ceph-deployceph]#ceph-deployforgetkeys[root@ceph-deployceph]#ceph-deploypurgeadmin-nodenode1node2node3如果

是新装的话是没有任何数据的3、编辑admin-node节点的

ceph配置文件，把下面的配置放入ceph.conf中osdpooldefaultsize=24、在admin-node节点用ceph-deploy工具向各个节点安装ceph[root@admin-nodeceph]#ceph-deployinstalladmin-nodenode1node2node3[ceph_deploy.conf][DEBUG]foundconfigurationfileat:

/root/.cephdeploy.conf[ceph_deploy.cli][INFO]Invoked（1.5.3）:

/usr/bin/ceph-deployinstalladmin-nodenode1node2node3[ceph_deploy.install][DEBUG]Installingstableversionfireflyonclustercephhostsadmin-nodenode1node2node3[ceph_deploy.install][DEBUG]Detectingplatformforhostadmin-node...[admin-node][DEBUG]connectedtohost:

admin-node[admin-node][DEBUG]detectplatforminformationfromremotehost[admin-node][DEBUG]detectmachinetype[ceph_deploy.install][INFO]Distroinfo:

CentOS6.5Final[admin-node][INFO]installingcephon

admin-node[admin-node][INFO]Runningcommand:

yumcleanall[admin-node][DEBUG]Loadedplugins:

fastestmirror,refresh-packagekit,security[admin-node][DEBUG]Cleaningrepos:

CephCeph-noarchbaseceph-sourceepelextrasupdates[admin-node][DEBUG]CleaningupEverything[admin-node][DEBUG]Cleaninguplistoffastestmirrors[admin-node][INFO]Runningcommand:

yum-yinstallwget[admin-node][DEBUG]Loadedplugins:

fastestmirror,refresh-packagekit,security[admin-node][DEBUG]Determiningfastestmirrors[admin-node][DEBUG]*base:

[admin-node][DEBUG]*epel:

[admin-node][DEBUG]*extras:

[admin-node][DEBUG]*updates:

[admin-node][DEBUG]SettingupInstallProcess[admin-node][DEBUG]Packagewget-1.12-1.11.el6_5.x86_64alreadyinstalledandlatestversion[admin-node][DEBUG]Nothingtodo[admin-node][INFO]addingEPEL

repository[admin-node][INFO]Runningcommand:

wgethttp:

//dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-

6-8.noarch.rpm[admin-node][WARNIN]--2014-06-0722:

05:

34--

http:

//dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm[admin-node][WARNIN]Resolvingdl.fedoraproject.org...209.132.181.24,209.132.181.25,209.132.181.26,...[admin-node][WARNIN]Connectingtodl.fedoraproject.org|209.132.181.24|:

80...connected.[admin-node][WARNIN]HTTPrequestsent,awaitingresponse...200OK[admin-node][WARNIN]Length:

14540（14K）[application/x-rpm][admin-node][WARNIN]Savingto:

、epel-release-6-8.noarch.rpm.1'[admin-node][WARNIN]

[admin-node][WARNIN]0K

100%73.8K=0.2s[admin-node][WARNIN][admin-node][WARNIN]2014-06-0722:

05:

35（73.8KB/s）-、epel-release-6-8.noarch.rpm.1'saved[14540/14540][admin-node][WARNIN][admin-node][INFO]Runningcommand:

rpm-Uvh--replacepkgsepel-release-6*.rpm[admin-node][DEBUG]Preparing...

##################################################[admin-node][DEBUG]epel-release

##################################################[admin-node][INFO]Runningcommand:

rpm

--importse.asc[admin-node][INFO]Runningcommand:

rpm-Uvh--replacepkgs6.noarch.rpm[admin-node][DEBUG]Retrieving6.noarch.rpm[admin-node][DEBUG]Preparing...##################################################[admin-node][DEBUG]ceph-release##################################################[admin-node][INFO]Runningcommand:

yum-y-qinstallceph[admin-node][DEBUG]Packageceph-0.80.1-2.el6.x86_64alreadyinstalledandlatestversion[admin-node][INFO]Runningcommand:

ceph--version[admin-node][DEBUG]cephversion0.80.1（a38fe1169b6d2ac98b427334c12d7cf81f809b74）[ceph_deploy.install][DEBUG]Detectingplatformforhostnode1...[node1][DEBUG]connectedtohost:

node1[node1][DEBUG]detectplatforminformationfromremote

host[node1][DEBUG]detectmachinetype[ceph_deploy.install][INFO]Distroinfo:

CentOS6.4Final[node1][INFO]installingcephonnode1[node1][INFO]Runningcommand:

yumcleanall[node1][DEBUG]Loadedplugins:

fastestmirror,refresh-packagekit,security[node1][DEBUG]Cleaningrepos:

baseextrasupdates[node1][DEBUG]CleaningupEverything[node1][DEBUG]Cleaninguplistoffastestmirrors[node1][INFO]Runningcommand:

yum-yinstall

wget[node1][DEBUG]Loadedplugins:

fastestmirror,refresh-packagekit,security[node1][DEBUG]Determiningfastestmirrors[node1][DEBUG]*base:

[node1][DEBUG]*extras:

[node1][DEBUG]*updates:

[node1][DEBUG]SettingupInstallProcess[node1][DEBUG]ResolvingDependencies[node1][DEBUG]-->Runningtransactioncheck[node1][DEBUG]--->Packagewget.x86_640:

1.12-1.8.el6willbeupdated[node1][DEBUG]--->Packagewget.x86_640:

1.12-1.11.el6_5willbeanupdate[node1][DEBUG]-->FinishedDependencyResolution[node1][DEBUG][node1][DEBUG]

DependenciesResolved[node1][DEBUG][node1][DEBUG]

====================================[node1][DEBUG]PackageArchVersion

RepositorySize[node1][DEBUG]====================================[node1][D

EBUG]Updating:

[node1][DEBUG]wget

x86_641.12-1.11.el6_5updates

483k[node1][DEBUG][node1][DEBUG]TransactionSummary[node1][DEBUG]

====================================[node1][DEBUG]Upgrade1Package（s）[node1][DEBUG]

[node1][DEBUG]Totaldownloadsize:

483k[node1][DEBUG]DownloadingPackages:

[node1][DEBUG]Runningrpm_check_debug[node1][DEBUG]RunningTransactionTest[node1][DEBUG]TransactionTestSucceeded[node1][DEBUG]RunningTransactionUpdating:

wget-1.12-1.11.el6_5.x86_64

1/2Cleanup:

wget-1.12-1.8.el6.x86_64

2/2Verifying:

wget-1.12-1.11.el6_5.x86_64

1/2Verifying:

wget-1.12-1.8.el6.x86_64

2/2[node1][DEBUG][node1][DEBUG]Updated:

[node1][DEBUG]wget.x86_640:

1.12-1.11.el6_5

[node1][DEBUG][node1][DEBUG]Complete!

[node1][INFO]addingEPEL