corosync+pacemaker+drbd.docx
《corosync+pacemaker+drbd.docx》由会员分享，可在线阅读，更多相关《corosync+pacemaker+drbd.docx（23页珍藏版）》请在冰豆网上搜索。
corosync+pacemaker+drbd
目录
一、环境准备2
二、设置各节点互相解析2
1.设置主机名2
2.设置各节点ssh互信3
3.设置各节点时间同步3
4.设置各节点关闭防火墙及selinux3
三、corosync安装及配置4
1.corosync安装4
2.corosync配置4
四、Pacemaker安装配置5
1.pacemaker安装5
五、crmsh安装配置5
1.crmsh安装5
六、检查集群是否安装成功6
1.启动corosync6
2.查看启动信息6
七、drbd安装6
1.drbd安装包下载（node1node2同做）6
2.drbd编译安装（node1node2同做）7
3.检查drbd模块是否编译正确（node1node2同做）7
4.drbd配置7
5.添加共享硬盘（node1node2同做）8
6.drbd初始化（node1node2同做）9
7.启动drbd9
8.设置node1为主节点9
9.格式化并挂载9
10.设置node2为主节点9
八、oracle数据库安装10
1.源码包下载10
2.安装必要依赖软件（node1node2同做）10
3.添加用户名及用户组（node1node2同做）10
4.调整内核参数（node1node2同做）10
5.增加shell限制（node1node2同做）10
6.设置node1为主节点11
7.建立必要目录（node1node2同做）11
8.设置oracle环境变量（node1node2同做）11
9.解压oracle安装文件（只node1做）11
10.生成响应文件（只node1做）12
11.安装app12
12.配置监听13
13.建库13
14.将oracle做成服务（node1node2同做）13
九、corosync配置14
十、mysql加入corosync15
1.mysql安装（node1node2同做）15
2.修改mysql配置文件（node1node2同做）15
3.创建mysql数据目录15
4.配置mysql加入corosync15
十一、后期问题处理15
corosync+pacemaker+drbd
一、环境准备
1.虚拟机两台，centos6.532位以安装镜像光盘为yum源，添加两块网卡eth0，eth1
2.eth0为桥接配置文件如下：
DEVICE=eth0
TYPE=Ethernet
UUID=47d360e2-96c6-455b-bd36-b744371c708c
ONBOOT=yes
NM_CONTROLLED=yes
BOOTPROTO=static
IPADDR=10.10.10.20##node1为10.20node2为10.21
NETMASK=255.255.255.0
GATEWAY=10.10.10.1
eth1为nat配置文件如下：
DEVICE=eth1
TYPE=Ethernet
UUID=ff5bed04-b5e4-4977-912e-b0bdb04eedc3
ONBOOT=yes
NM_CONTROLLED=yes
BOOTPROTO=dhcp
3.vip为10.10.10.80
二、设置各节点互相解析
1.设置主机名
node1:
[root@node1~]#uname-n
[root@node1~]#cat/etc/hosts
127.0.0.1localhostlocalhost.localdomainlocalhost4localhost4.localdomain4
:
:
1localhostlocalhost.localdomainlocalhost6localhost6.localdomain6
10.10.10.20node1
10.10.10.21node2
10.10.10.80node
node2:
[root@node2~]#uname-n
[root@node2~]#cat/etc/hosts
127.0.0.1localhostlocalhost.localdomainlocalhost4localhost4.localdomain4
:
:
1localhostlocalhost.localdomainlocalhost6localhost6.localdomain6
10.10.10.20node1
10.10.10.21node2
10.10.10.80node
2.设置各节点ssh互信
node1:
[root@node1~]#ssh-keygen-trsa
[root@node1~]#yuminstallopenssh-clients–y
[root@node1~]#ssh-copy-id-i.ssh/id_rsa.pubroot@
node2:
[root@node2~]#ssh-keygen-trsa
[root@node2~]#yuminstallopenssh-clients–y
[root@node2~]#ssh-copy-id-i.ssh/id_rsa.pubroot@
3.设置各节点时间同步
node1:
[root@node1~]#hwclock–s
node2:
[root@node2~]#hwclock–s
4.设置各节点关闭防火墙及selinux
node1:
[root@node1~]#serviceiptablesstop
[root@node1~]#chkconfigiptablesoff
[root@node1~]#cat/etc/selinux/config
#ThisfilecontrolsthestateofSELinuxonthesystem.
#SELINUX=cantakeoneofthesethreevalues:
#enforcing-SELinuxsecuritypolicyisenforced.
#permissive-SELinuxprintswarningsinsteadofenforcing.
#disabled-NoSELinuxpolicyisloaded.
SELINUX=disabled
#SELINUXTYPE=cantakeoneofthesetwovalues:
#targeted-Targetedprocessesareprotected,
#mls-MultiLevelSecurityprotection.
SELINUXTYPE=targeted
node2:
[root@node2~]#serviceiptablesstop
[root@node2~]#chkconfigiptablesoff
[root@node2~]#cat/etc/selinux/config
#ThisfilecontrolsthestateofSELinuxonthesystem.
#SELINUX=cantakeoneofthesethreevalues:
#enforcing-SELinuxsecuritypolicyisenforced.
#permissive-SELinuxprintswarningsinsteadofenforcing.
#disabled-NoSELinuxpolicyisloaded.
SELINUX=disabled
#SELINUXTYPE=cantakeoneofthesetwovalues:
#targeted-Targetedprocessesareprotected,
#mls-MultiLevelSecurityprotection.
SELINUXTYPE=targeted
三、corosync安装及配置
1.corosync安装
node1:
[root@node1~]#yuminstallcorosync
node2:
[root@node2~]#yuminstallcorosync
2.corosync配置
node1:
●创建corosync配置文件
[root@node1~]#cat/etc/corosync/corosync.conf
#Pleasereadthecorosync.conf.5manualpage
compatibility:
whitetank
totem{
version:
2
secauth:
off
threads:
0
interface{
ringnumber:
0
bindnetaddr:
10.10.10.1
mcastaddr:
226.94.10.1
mcastport:
5405
ttl:
1
}
}
logging{
fileline:
off
to_stderr:
no
to_logfile:
yes
to_syslog:
yes
logfile:
/var/log/cluster/corosync.log
debug:
off
timestamp:
on
logger_subsys{
subsys:
AMF
debug:
off
}
}
amf{
mode:
disabled
}
service{
ver:
0
name:
pacemaker
}
aisexec{
user:
root
group:
root
}
●生成密匙文件
[root@node1~]#cd/etc/corosync/
[root@node1corosync]#mv/dev/{random,random.bak}
[root@node1corosync]#ln-s/dev/urandom/dev/random
[root@node1corosync]#corosync-keygen
●将corosync配置文件及密匙文件拷贝至node2
[root@node1corosync]#scp-pauthkeycorosync.confnode2:
/etc/corosync/
四、Pacemaker安装配置
1.pacemaker安装
node1:
[root@node1~]#yuminstallpacemaker
node2:
[root@node2~]#yuminstallpacemaker
五、crmsh安装配置
1.crmsh安装
node1:
[root@node1~]#yuminstallcrmsh
node2:
[root@node2~]#yuminstallcrmsh
六、检查集群是否安装成功
1.启动corosync
node1:
[root@node1~]#servicecorosyncstart
node2:
[root@node2~]#servicecorosyncstart
2.查看启动信息
●查看corosync引擎是否正常启动
[root@node1~]#grep-e"CorosyncClusterEngine"-e"configurationfile"/var/log/cluster/corosync.log
Mar2100:
46:
49corosync[MAIN]CorosyncClusterEngine（'1.4.1'）:
startedandreadytoprovideservice.
Mar2100:
46:
49corosync[MAIN]Successfullyreadmainconfigurationfile'/etc/corosync/corosync.conf'.
Mar2100:
47:
39corosync[MAIN]CorosyncClusterEngineexitingwithstatus0atmain.c:
1947.
●查看初始化成员节点是否正常发出
[root@node1~]#grepTOTEM/var/log/cluster/corosync.log
Mar2021:
47:
22corosync[TOTEM]Initializingtransport（UDP/IPMulticast）.
Mar2021:
47:
22corosync[TOTEM]Initializingtransmit/receivesecurity:
libtomcryptSOBER128/SHA1HMAC（mode0）.
Mar2021:
47:
22corosync[TOTEM]Thenetworkinterface[10.10.10.20]isnowup.
Mar2021:
47:
22corosync[TOTEM]Aprocessorjoinedorleftthemembershipandanewmembershipwasformed.
●检查启动过程是否有错误产生
[root@node2~]#grepERROR/var/log/cluster/corosync.log
Mar2104:
40:
44corosync[pcmk]ERROR:
process_ais_conf:
YouhaveconfiguredaclusterusingthePacemakerpluginforCorosync.Thepluginisnotsupportedinthisenvironmentandwillberemovedverysoon.
Mar2104:
40:
44corosync[pcmk]ERROR:
process_ais_conf:
PleaseseeChapter8of'ClustersfromScratch'（http:
//www.clusterlabs.org/doc）fordetailsonusingPacemakerwithCMAN
七、drbd安装
1.drbd安装包下载（node1node2同做）
2.drbd编译安装（node1node2同做）
[root@node1home]#tar-xzfdrbd-8.4.3.tar.gz
[root@node1home]#cddrbd-8.4.3
[root@node1drbd-8.4.3]#yuminstallkernel-devel
[root@node1drbd-8.4.3]#./configure--prefix=/--with-km
[root@node1drbd-8.4.3]#makeKDIR=/usr/src/kernels/2.6.32-431.el6.i686/
[root@node1drbd-8.4.3]#makeinstall
[root@node1drbd-8.4.3]#depmod
3.检查drbd模块是否编译正确（node1node2同做）
[root@node1drbd-8.4.3]#modprobedrbd
[root@node1drbd-8.4.3]#lsmod|grepdrbd
drbd2923393
libcrc32c8411drbd
4.drbd配置
[root@node1~]#vim/etc/drbd.d/global_common.conf
global{
usage-countno;
}
common{
handlers{
pri-on-incon-degr"/lib/drbd/notify-pri-on-incon-degr.sh;/lib/drbd/notify-emergency-reboot.sh;echob>/proc/sysrq-trigger;reboot-f";
pri-lost-after-sb"/lib/drbd/notify-pri-lost-after-sb.sh;/lib/drbd/notify-emergency-reboot.sh;echob>/proc/sysrq-trigger;reboot-f";
local-io-error"/lib/drbd/notify-io-error.sh;/lib/drbd/notify-emergency-shutdown.sh;echoo>/proc/sysrq-trigger;halt-f";
}
startup{
}
options{
}
disk{
on-io-errordetach;
}
net{
cram-hmac-alg"sha1";
shared-secret"mydrbdlab";
}
syncer{
rate100M;
}
}
[root@node1~]#vim/etc/drbd.d/web.res
resourceweb{
on{
device/dev/drbd0;
disk/dev/sdc1;#该值跟共享磁盘盘符一致
address10.10.10.20:
7789;
meta-diskinternal;
}
on{
device/dev/drbd0;
disk/dev/sdc1;
address10.10.10.21:
7789;
meta-diskinternal;
}
}
[root@node1~]#scp/etc/drbd.d/*node2:
/etc/drbd.d/
5.添加共享硬盘（node1node2同做）
●添加硬件
●分区
[root@node1~]#fdisk–l
Disk/dev/sdc:
16.1GB,16106127360bytes
255heads,63sectors/track,1958cylinders
Units=cylindersof16065*512=8225280bytes
Sectorsize（logical/physical）:
512bytes/512bytes
I/Osize（minimum/optimal）:
512bytes/512bytes
Diskidentifier:
0x5ece0c72
[root@node1~]#fdisk/dev/sdc
按键顺序为n->p->1->回车->回车->w
●格式化
[root@node1~]#mkfs.ext4/dev/sdc1
6.drbd初始化（node1node2同做）
[root@node1~]#drbdadmcreate-mdweb
如果有错则执行
[root@node1~]#ddif=/dev/zerobs=1Mcount=1of=/dev/sdc1
7.启动drbd
[root@node1~]#servicedrbdstart
[root@node2~]#servicedrbdstart
[root@node1~]#drbd-overview
0:
web/0ConnectedSecondary/SecondaryUpToDate/UpToDateCr-----
[root@node2~]#drbd-overview
0:
web/0ConnectedSecondary/SecondaryUpToDate/UpToDateCr-----
8.设置node1为主节点
[root@node1~]#drbdadm----overwrite-data-of-peerprimaryweb
[root@node1~]#drbd-overview
0:
web/0ConnectedPrimary/SecondaryUpToDate/UpToDateCr-----
9.格式化并挂载
[root@node1~]#mkfs.ext4/dev/drbd0
[root@node1~]#mkdir/mydata
[root@node1~]#mount/dev/drbd0/mydata/
10.设置node2为主节点
[root@node1~]#umount/mydata/
[root@node1~]#drbdadmsecondaryweb
[root@node2~]#drbdadmprimaryweb
[root@node2~]#mkdir/mydata
[root@node2~]#mount/dev/drbd0/mydata
八、oracle数据库安装
1.源码包下载
2.安装必要依赖软件（node1node2同做）
[root@node1~]#yuminstalllibaiolibaio-develpdkshsysstatunixODBCunixODBC-de
升级会员 