HPIA64RACINSTALL.docx

HPIA64RACINSTALL.docx

《HPIA64RACINSTALL.docx》由会员分享，可在线阅读，更多相关《HPIA64RACINSTALL.docx（28页珍藏版）》请在冰豆网上搜索。

HPIA64RACINSTALL

10GRACINSTALL

RHAS/HPRX1620/MSA1000

Version1.0

DocumentInformation

Author

DarrenMoore,JohnPHansen

Version

1.0

Status

Location

Contents

1INTRODUCTION3

1.1References3

1.2RevisionHistory3

2INTRODUCTION4

3HARDWAREOVERVIEW5

4HARDWAREINVENTORY6

5SOFTWAREINVENTORY6

6CONSOLEACCESS6

7REDHATINSTALL7

8NETWORKCONFIGURATION9

9HBASETUP10

10SANSwitchSetup12

11MSAFLASHUPGRADE13

12OCFSINSTALL13

13ASMINSTALL15

14ORACLEPREINSTALLSETUPTASKS16

14.1OracleUser16

14.2SystemParameters16

14.3Hangcheck-timer17

14.4Remoteaccesssetup18

15CRSSTORAGEDISKSETUP19

16DATABASEDISKSETUP22

16.1LUNSetup22

16.2OCFSDatabaseDiskSetup23

16.3ASMDatabaseDiskSetup24

17CRSINSTALL25

17.1ToDe-InstallCRS27

18RACSOFTWAREINSTALL27

19RACDATABASECREATION28

19.1StorageOptions29

19.1.1ClusterFileSystem29

19.1.2AutomaticStorageManagerASM29

INTRODUCTION

References

Reference

Document

1.

OracleDocs

2.

HunterRacInstall10g

3.

ASMlib/OCFSforIA64

4.

RX1620HOMEPAGE

5.

MSA1000HOMEPAGE

6.

2/8VSANSwitch

RevisionHistory

Revision

Author

Date

Description

1.0

DarrenMoore,JohnPHansen

02/08/2005

INTRODUCTION

Thepurposeofthisdocumentistodetail10GRACsetup（10.1.0.3）onHPItaniumrx1620serverswithRedHatAdvancedServerandanMSA1000assharedstorage.OracletechnologiessuchasCRS,OCFSandASMareusedinconjunctionwiththeOracleRACinstall.Thisdocumentistobeusedasareferenceanddetailsthestepsandexperienceencounteredduringthesetupandisnotanactualinstallguide.

Includedinthedocareanumberofreferencesusedduringthesetup,hardwareoverviewincludingatopology,OSandassociatedS/Winstallinstructions.

FortheClusterSoftwareinstallClusterReadyServices（CRS）wasusedinconjunctionwithOCFS（OracleClusterFileSystem）tomanagetheshareddevicesneededforCRS.

ForthepurposesofcustomerdemoswecreatedtwoRACdatabasesonthesharedstorage.ThefirstdatabasetakingadvantageofOCFSandRAID5andtheseconddatabasetakingadvantageofASMtomanagetheshareddatabasedatafiles.BothdatabasesweresetuponaprivateLAN.Thismayseemconfusinghoweverweseparatedoutbothapproachesintheprocedureandyoumayignorewhicheverapproachdoesnotsuityoursetup.

HARDWAREOVERVIEW

WefirstcreatedaPrimaryDNSonanx86PCtoprovideuswithaprivatenetwork.Allsystemswereconnectedtoasimple100MB8wayhub,includingtheDNSmaster.

Thepurposeofthesetupwastoallowustorundemosforcustomersonaprivatenetwork.YoucancreateasimpleDNSserverusingthefollowinghowto,westayedtruethedocsandcalledournetworklinux.bogus.

Thetopologyisasfollows.

HARDWAREINVENTORY

2*ex1620IntegrityHPServers

1*MSA1000StorageArray

1*8/4wayfibrechannelswitch

2netgear8wayhubs

1forprivateinterconnect

1forprivateLAN

Onex86PC,whichactedastheprimaryDNSforaprivateLAN.

HPProliantDL580

2/8VFibreChannelSANswitch

SOFTWAREINVENTORY

RHAS3.0U5ia64forbothrx1620’s

RHAS3.0U5x86forthePCwithactingastheDNSmater

10.1.0.3fortheRACinstall

OracleClusterFileSystem

-ocfs-2.4.21forIA64RHAS3.0Linux

ASMLibisalibraryaddonfortheAutomaticStorageManager

-oracleasm-2.4.21-32.ELforIA64RHAS3.0Linux

MSA1000firmwarev4.48

A7538Ahpqla2x00_2005_05_11HBAdriverwithfibreutils_1.11-3

CONSOLEACCESS

UsingaPCwithLinuxinstalled（RHAS3.0x86）,weattachedaserialcableconnectedtocomport1onthepctothecomportonthebackoftherx1620,（aconsolecableshouldbesuppliedwiththerx1620）

Usingminicomweconnectedtotheconsoleontherx1620asfollows

>minicom-8-o-con-L–w

Youcanhoweverconnecttotheconsoleusingwhatevermethodsuits.

REDHATINSTALL

WeinstalledRedhatAdvancedServerUpdate5forIA64,Kernel2.4.21-32.ThecorrectversionofRHASisimportanttosatisfythesupportmatrixforASMlibandOCFS.

AtboottimeselecttheBootMaintenanceMenuasshowbelow:

EFIBootManagerver1.10[14.62]Firmwarever2.11[4445]

Pleaseselectabootoption

RedHatEnterpriseLinuxAS

EFIShell[Built-in]

BootOptionMaintenanceMenu

SystemConfiguration

Use^andvtochangeoption（s）.UseEntertoselectanoption

EFIBootMaintenanceManagerver1.10[14.62]

SelectRemovableMediaBoot[InternalBootableDVD]

BootFromaFile.SelectaVolume

NOVOLUMELABEL[Acpi（HWP0002,0）/Pci（2|0）/Ata（Primary,Master）/CD

NOVOLUMELABEL[Acpi（HWP0002,100）/Pci（1|0）/Scsi（Pun0,Lun0）/HD（P

NOVOLUMELABEL[Acpi（HWP0002,100）/Pci（1|0）/Scsi（Pun0,Lun0）/HD（P

RemovableMediaBoot[InternalBootableDVD]

LoadFile[EFIShell[Built-in]]

LoadFile[CoreLANGbA]

LoadFile[CoreLANGbB]

Exit

AttheELILObootprompttypelinuxconsole=ttyS0,rememberyouhaveapprox8secondstotypethis

ELILOboot:

linuxconsole=ttyS0

UncompressingLinux...done

Loadinginitrdinitrd.img...done

Yoursystemwillnowbootintothedefaultanacondainstallerinconsolemode.

Nextweinstalledredhatasfollows:

SelectSkip,whenpromptedtotestCD

SelectOK

SelectEnglish

SelectDiskDruid

Wecreatedadisklayoutasfollows,themostimportantstephereisthecreationofa/boot/efibootpartitionwhichmustbeaFATpartition,

sda2132050Mvfat/boot/efi

sda320256920000Mext3/u02

sda42569511920000Mext3/u01

sda55119639410000Mext3/usr

sda66394766910000Mext3/

sda7766981784000Mswap

sda8817888165000Mext3/opt

SelectOK

SelectYestoverifyyourselection

NextweassignedanIPAddressandNetworkMasktoActivateonboot.

Wedidnotconfigureanyadditionalnetworkdevicesatthisstagei.e.interconnect.

NextweassignedthePrimaryDNShost.

InHostnameConfigurationwemanuallyassignedthefullyqualifiedhostnamee.g.rac1.linux.bogus.

WedidnotenableanyfirewallandselectedNofirewall.

WethenselectedtheappropriateLanguage,TimeZoneandRootPassword

Theinstallerfirstformatsthedisks,thenasksfortheCD’sinthefollowingOrder

Disk1,Disk2,Disk3,Disk4,Disk1

NETWORKCONFIGURATION

AtthisstageallnodesinclustershouldbeonthenetworkwithastaticIPaddress.

The/etc/hostsfileoneachnodeshouldcontain

∙Allhostswithinthecluster,inourcaserac1andrac2

∙AllVIP‘swithinthecluster

∙Allinterconnectdeviceswithinthecluster

Ensureeachentryinthe/etc/hostsfilehasthefollowingformat

e.g.

192.168.196.100rac1.linux.bogusrac1

192.168.196.101rac1-vip.linux.bogusrac1-vip

10.0.0.2rac1-priv.linux.bogusrac1-priv

TheinstallerwillpromptfortheVIPAddressesduringtheRACS/Winstallation.

Inoursetupweconfigured2interconnects（howeveryouonlyneed1,additionalinterconnectscanbeconfiguredforhighavailability）,onaprivatesubnetusingaseparatehub.Youcanconfigureeachnetworkdeviceusing

/usr/bin/redhat-config-network

thereforeintotaleachnodeinourtwonodeclusterhadtwonetworkdevicesassignedfor2privateinterconnects

e.g.onthesystemrac1.linux.bogusweconfiguredeth1withtheIPaddress10.0.0.2

Note:

ensureyouselect“Activatedevicewhencomputerstarts”beforeyouactivatethedevice.

Wealsoconfigured“/etc/nsswitch.conf”toalloweachnodetointerrogatethednsserverforhostnamelookupsbeforeusingthe“/etc/hosts/”file:

#hosts:

dbfilesnisplusnisdns

hosts:

dnsfiles

HBASETUP

WeinstalledinternalqlogicHBA2GfibrechanneladaptorstoconnecttheafibrechannelswitchwhichwasalsoconnectedtoanMAS1000（moreinthislater）.

AlldetailsabouttheHBAFibrechanneladaptorscanbefoundonlineat:

A7538A-2GbPCI-XFibreChannelHBAforLinux

ClickonSoftware&driverstodownloadtheappropriateHBAdriver.

WedownloadedthedriverkitforA7538AandusetheINSTALLscriptcontainedwithin

hp_qla2x00-2005-05-11.tar.gzwhichinstalledtheA7538Adriverandfibreutils.

Wealsoinstalledhp_sansurferwhichisausefulguitoolusedtoconnectandconfigureyourqlogiccardifneeded.Boththedriverandsansurfer（optional）wereinstalledonbothnodes.

[root@rac2hp_qla2x00]#./INSTALL

Installinghp_qla2x00srcRPM...

Preparing...###########################################[100%]

Logfileis/var/log/hp_qla2x00_install.log

GettinglistofQLAFCHBAs

GettinglistofSCSIadaptersandVendorIDs

ProducinglistofSCSIadaptersandVendorIDsthatareFCPadapters

CheckingVendorIDs

AllStorageisHPStorage.Proceedingwithinstallation

1:

hp_qla2x00src###########################################[100%]

Loadeddriverisinnonfailovermode

Writingnew/etc/hp_qla2x00.conf...done

Copying/opt/hp/src/hp_qla2x00src/libqlsdm-ia64.soto/usr/lib/libqlsdm.so

Modifying/etc/hba.conf

Configuringkernelsources...

Using/usr/src/linux-2.4/configs/kernel-2.4.21-ia64.configas.config

Executingmakemrproper

Executingmakeoldconfig

Executingmakedep

CompilingQLAdriver...

makeclean

makeHSG80=nOSVER=linux-2.4SMP=1all

rm-fqla2200.oqla2300.oqla2300_conf.oqla2200_conf.oqla_opts.oqla_opts

cc-D__KERNEL__-DMODULE-Wall-O-g-DUDEBUG-DLINUX-Dlinux-DINTAPI

…………

Copyingqla2300.oto/lib/modules/2.4.21-32.EL/kernel/drivers/addon/qla2200

Copyingqla2300_conf.oto/lib/modules/2.4.21-32.EL/kernel/drivers/scsi

Runningdepmod-a

addinglineto/etc/modules.conf:

aliasscsi_hostadapter2qla2300_conf

addinglineto/etc/modules.conf:

aliasscsi_hostadapter3qla2300

addinglinet