在vmwarevsphereesxi上安装oracleRACWord文件下载.docx

1、2Cisco UCS B4404x 10-core CPUs, 256GB RAM, and 4 NICsStorage1NetApp F3240 双路控制器Ethernet SwitchesCisco FI6248FC Switches1 Cisco Nexus 7000Host Based Adapters4每个刀片两个，与网卡共享流量2.2软件环境版本作用vSphere5.1Hypervisor hosting all virtual machinesVMware vCenter管理 vSphereOracle Enterprise Linux x86_646.3Guest operat

2、ing system for virtual machines running Oracle Database serverOracle Database 11g （with Oracle RAC and Oracle Grid Infrastructure） Enterprise Edition11.2.0.3Microsoft Windows Server2008 R2用于 vCenter Server2.3虚拟机配置虚拟机用途Oracle RAC nodes20 vCPU, 120GB RAM,Oracle Enterprise Linux x86_64 6.3vCenter2 vCPU

3、s, 8GB RAM, Windows Server 2008 R22.4共享存储配置Datastore NameVirtual Disk on ESXLinux路径虚拟路径驱动类型VMDK Size （GB）用途VMDATASTOREVMDK Hard disk 1/dev/sdaSCSI 0:LSI Logic150Oracle Enterprise Linux 5.5 OS and Oracle binariesCRS1VMDK Hard disk 2Shared disk/dev/sdb1SCSI 1:Paravirtual20CRS and voting diskREDO1VMDK

4、Hard disk 3/dev/sdc1900REDO and ArchieveDATA01VMDK Hard disk 4/dev/sdd1SCSI 2:1000RAC database DATADATA02VMDK Hard disk 5/dev/sde1DATA03VMDK Hard disk 6/dev/sdf1SCSI 3:DATA04VMDK Hard disk 7/dev/sdg12.5Oracle RAC 数据库环境Node NameASM InstanceRAC InstanceDatabaseASM StorageRAC1+ASM1RACASM file systemRAC

5、2+ASM22.6网络配置按照Oracle RAC的实施惯例，每个RAC节点都提供一个Public网口用于承载业务，并在其上捆绑虚拟IP地址 （VIP） 用于HA切换. 各RAC节点之间还需要一个私有网络进行节点之间的通信。在物理环境中，通常需要考虑链路的冗余以消除单点鼓掌。而在虚拟化环境中，冗余问题由底层虚拟化软件处理，所以对于每个RAC节点，只是简单地需要两个网口就可以工作，大大简化了配置和安装工作.我们这次测试的网络配置如下三:UCS底层软件配置出三个物理网口（均为10Gb） vmnic0 和 vmnic1用于Oracle Public and Oracle Private网络, vmn

6、ic2用于vSphere vMotion工作.两个分布式虚拟交换机 Oracle Public （VM Net） and Oracle Private （Oracle HB）.每个RAC节点配置3个IP地址 以节点1 （RAC1） 为例:oOne public static IP address （eth0）: 162.16.3.101oOne private static IP address （eth1）: 192.168.2.30oOne virtual static IP address（VIP）: 162.16.3.111（由CRS软件配置和管理）还有三个虚拟IP用于节点间负载均衡（

7、SCAN）: 162.16.3.200,162.16.3.201,162.16.3.202（由CRS配置和管理）物理网口 vmnic0 连接到分布式交换机 VM Net,vmnic1连接到分布式交换机Oracle HB， vMotion 使用标准交换机vSwitch3. 这样区分概念上比较清晰，也可以只建一个分布式网络，用不同的端口组区分数据网络和心跳网。Figure 1. Network Configuration2.7 2.8逻辑结构图 Figure 3. Logical Architecture of Two-Node Oracle RAC on vSphere3.部署流程概览部署流程大

8、体按照下面的流程图进行.Figure 4. Deployment Steps for Four-Node Oracle RAC on vSphere with VMFS4.为第一个RAC节点准备虚拟机环境本节安装步骤简介如下:使用vSphere Client创建第一个虚拟机。添加公网和心跳网卡，挑选适当的LUN创建仲裁盘CRS （VMDK模式）。安装Redhat Linux操作系统，安装VMware tools，按照Oracle RAC要求安装相应补丁.在Linux中配置NTP 客户端.4.1创建第一个虚拟机1.使用vSphere Client登录vCenter.2.选中一台主机,在Getti

9、ng Started 页面单击 Create a new virtual machine.3.In the Create New Virtual Machine wizard, select Typical for the Configuration, and click Next.4.On the Name and Location page, enter RAC1 for the Name, and click Next.5.On the Datastore page, select VMDATASTORE, and click Next.6.On the Guest Operating

10、System page, select Linux from the Guest Operating System list. For the Version, select Oracle Linux 6 （64-bit） from the drop-down menu. Click Next.7.On the Create a Disk page, set the Virtual Disk Size to 20GB, and click Next.8.On the Ready to Complete page, select Edit the virtual machine settings

11、 before completion. Click Continue.9.On the Virtual Machine Properties page for the RAC1 virtual machine, select 8 CPUs and 128GB Memory.10.Click Finish.4.2增加两个虚拟网卡现在需要增加两块网卡. 一块用于公共数据网络, 另一块用于心跳网络. 添加这两块网卡的过程基本相同,差别仅在于添加公网网卡时选择标签: VM Net 而添加心跳网卡时选择 Oracle HB.添加公网网卡的步骤：1.Select a virtual machine.2.C

12、lick Edit settings to display the Virtual Machine Properties pane.3.Click Add.4.Select Ethernet Adaptor and click Next to display the Add Hardware wizard.5.On the Network connection page, select VMXNET 3 from the Adapter Type drop-down menu.6.In the Network Connection section of the Network connecti

13、on page, select Named network with specified label.7.In the Named network with specified label drop-down menu, select VM Net.8.In the Device Status section of the Network connection page, select Connect at power on.9.On the Ready to Complete page, click Finish, and then click OK.添加心跳网卡的步骤：1.Repeat s

14、teps 1 through 6 from the preceding procedure.2.In the Named network with specified label drop-down menu, select Oracle HB.3.Continue with steps 8 and 9 from the preceding procedure.4.3添加仲裁盘Oracle RAC需要至少一个共享的仲裁盘存放clusterware信息和节点投票信息。存储管理员需要事先为仲裁盘分配好单独的LUN，然后我们需要创建单独的SCSI控制器并设为Paravirtual驱动. SCSI 总

15、线 sharing policy 设为 none.下面描述创建共享存储的步骤. 为虚拟机创建 20GB datastore：1.In vSphere Client, select a virtual machine.2.Right-click the name of the virtual machine and select Edit Settings to display the Virtual Machine Properties pane.3.Click Add to display the Add Hardware wizard.4.In the Add Hardware wizar

16、d select Hard Disk for the Device Type, and click Next.5.In the Disk section of the Select a Disk page, select Create a new virtual disk. Set the disk size to 20GB, select the Support clustering features such as Fault Tolerance check box, and select CRS1 to specify a datastore. Also, for vSphere 5,

17、in the Disk Provisioning section select Thick Provision Eager Zeroed. Click Next.6.On the Compatibility Mode page, click Next.7.On the Advanced Options page, in the Virtual Device Node section, select SCSI （1:0）. In the Mode section, select Independent. Click Next.8.On the Ready to Complete page, cl

18、ick Finish.9.Click OK.Add configuration parameters for each Oracle RAC virtual machine as described in Disabling simultaneous write protection provided by VMFS using the multi-writer flag （手工修改虚拟机参数3.Click the Options tab, click Advanced, and click General.4.Click Configuration Parameters.5.On the C

19、onfiguration Parameters page, add rows and entries for the shared disks in the virtual machines configuration parameters as shown in the following screenshot.6.Repeat steps 1 through 5 for each of the remaining virtual machines.You can view the virtual machine properties for the RAC1 virtual machine

20、 in vCenter as in the following screenshot.web client 显示如下图：4.4 安装操作系统将OEL6.4安装介质ISO文件上传到datastore，然后进行安装。Note: This document is specific to Linux guest operating system. Oracle RAC 11.2.0.2 and above versions can be deployed and supported on the list of guest operation systems using VMware multi-wr

21、iter flag （在虚拟机上安装Linux操作系统2.Click Edit settings.3.In the Hardware tab of the Virtual Machine Properties pane, select CD/DVD Drive 1.4.In the Device Status section of this pane, select the Connect at power on check box.5.In the Device Type section of this pane, select Datastore ISO File and enter th

22、e path to your Linux ISO image file.6.In the Virtual Device Node section of this pane, select CD/DVD Drive 1 from the drop-down menu.7.Click OK.8.Power on the virtual machine.9.Install Linux with the following settings.Custom partitioning scheme:/dev/sda1 ext3 150GB mounted on /Installed packages us

23、e the default package selection, plus the following:kernel-uek.x86_64kmod-oracleasmoracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64 （download from oracleasm-support-2.1.3-1.el5.x86_64systat-7.0.2-3.el5.x86_6410.Use below script to install remaining packages:yum install binutils compat-libcap1 compat-libs

24、tdc+-33 compat-libstdc+-33.i686 gcc.x86_64 gcc-c+.x86_64 glibc.x86_64 glibc.i686 glibc-devel.x86_64 glibc-devel.i686 unixODBC.i686 unixODBC.x86_64 unixODBC-devel.x86_64 unixODBC-devel.i686 libgcc.x86_64 libgcc.i686 libstdc+.x86_64 libstdc+.i686 libstdc+-devel.x86_64 libstdc+-devel.i686 compat-libstd

25、c+-33.x86_64 libaio.x86_64 libaio.i686 libaio-devel.x86_64 libaio-devel.i686 sysstat.x86_64 ksh libXtst-devel.x86_64 libXtst.i686 compat-db.x86_64 xorg-x11-utils.x86_64 xorg-x11-xinit.x86_64 make11.View the installed packages with this command:run command “rpm q 12.Confirm that the following package

26、s have been installed:binutils-2.20.51.0.2-5.11.el6 （x86_64）compat-libcap1-1.10-1 （x86_64）compat-libstdc+-33-3.2.3-69.el6 （x86_64）compat-libstdc+-33-3.2.3-69.el6.i686gcc-4.4.4-13.el6 （x86_64）gcc-c+-4.4.4-13.el6 （x86_64）glibc-2.12-1.7.el6 （i686）glibc-2.12-1.7.el6 （x86_64）glibc-devel-2.12-1.7.el6 （x86_64）glibc-devel-2