Restoring OCRVote disk due to ASM disk failures3.docx
《Restoring OCRVote disk due to ASM disk failures3.docx》由会员分享，可在线阅读，更多相关《Restoring OCRVote disk due to ASM disk failures3.docx（13页珍藏版）》请在冰豆网上搜索。
RestoringOCRVotediskduetoASMdiskfailures3
RestoringOCR&VotediskduetoASMdiskfailures-3
TherearefewchangestothesetupthatwasusedtotestvariousASMdiskfailurescenariosandrestoringOCRandVotedisks.Themainchangeis,setupusedisnolongertheRACsetup upgradedfrom10gR2to11gR1 andthento11gR2
It'sanewinstallationof11gR2gridinfrastructure（onlyGIwasinstallednoRACdatabasewascreated.InstallingGIwassufficienttotestthisscenario）andthereforetheASMspfileisalsoinsidethesamediskgroupasclusterwarefiles. Metalinknote1082943.1 explainshowtomoveittoanotherdiskgroup.Ifnotapfilefromthespfileshouldbecreatedtore-createthespfileaftertheocrandvotediskrestore.
Scenario3.
1.BothOCRandVotedisksareinASMdiskgroup
2.ASMdiskgrouphasnormalredundancywithonlythreefailuregroups
3.Allfailuregroupsareaffected
4.ASMSpfileisalsolocatedinthesamediskgroupwhereclusterwarefilesarelocated.
1.CurrentOCR,votediskandASMSpfileconfiguration
#ocrcheck
StatusofOracleClusterRegistryisasfollows:
Version:
3
Totalspace（kbytes）:
262120
Usedspace（kbytes）:
2272
Availablespace（kbytes）:
259848
ID:
1242190491
Device/FileName:
+clusterdg
Device/Fileintegritychecksucceeded
Device/Filenotconfigured
Clusterregistryintegritychecksucceeded
Logicalcorruptionchecksucceeded
$crsctlquerycssvotedisk
##STATEFileUniversalIdFileNameDiskgroup
------------------------------------------
1.ONLINE7d49533611734f3bbf404d32f1759ed5（ORCL:
CLUS1）[CLUSTERDG]
2.ONLINE4a8c288d1ade4f8cbf6588c145b27489（ORCL:
CLUS2）[CLUSTERDG]
3.ONLINEad241f9823cd4fb9bf3412ca67e591df（ORCL:
CLUS3）[CLUSTERDG]
Located3votingdisk（s）.
SQL>showparameterspfile
NAMETYPEVALUE
--------------------------
spfilestring+CLUSTERDG/hpc-cluster/asmparameterfile/registry.253.730565167
srvctlconfigasm-a
ASMhome:
/opt/app/11.2.0/grid
ASMlistener:
LISTENER
ASMisenabled.
2.IdentifythedisksbelogingtotheASMdiskgroupusingoracleasmquery-pandcorruptthemtosimulatediskfailure
#ddif=/dev/zeroof=/dev/sdc10count=204800bs=8192
204800+0recordsin
204800+0recordsout
1677721600bytes（1.7GB）copied,1.61087seconds,1.0GB/s
#ddif=/dev/zeroof=/dev/sdc3count=204800bs=8192
204800+0recordsin
204800+0recordsout
1677721600bytes（1.7GB）copied,1.6883seconds,994MB/s
#ddif=/dev/zeroof=/dev/sdc2count=204800bs=8192
204800+0recordsin
204800+0recordsout
1677721600bytes（1.7GB）copied,1.74684seconds,960MB/s
3.ocssd.logwillshowthedetectionofvotediskcorruption
2010-09-2415:
46:
02.893:
[CSSD][1136630080]clssgmDestroyProc:
cleaningupproc（0x2aaab02131b0）con（0x8db0）skgpidospid12671with0clients,refcount0
2010-09-2415:
46:
02.893:
[CSSD][1136630080]clssgmDiscEndpcl:
gipcDestroy0x8db0
2010-09-2415:
46:
03.009:
[CSSD][1231038784]clssnmvDiskKillCheck:
votingdiskcorrupted（0x00000000,0x00000000）（ORCL:
CLUS1）
2010-09-2415:
46:
03.009:
[CSSD][1231038784]clssnmvDiskAvailabilityChange:
votingfileORCL:
CLUS1nowoffline
2010-09-2415:
46:
03.584:
[CLSF][1241528640]Closinghandle:
0x2aaab008cbe0
...
2010-09-2415:
46:
03.584:
[SKGFD][1241528640]Lib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
closinghandle0x2aaab0197570fordisk:
ORCL:
CLUS1:
2010-09-2415:
46:
13.269:
[CSSD][1168099648]clssnmvDiskKillCheck:
votingdiskcorrupted（0x00000000,0x00000000）（ORCL:
CLUS3）
2010-09-2415:
46:
13.269:
[CSSD][1168099648]clssnmvDiskAvailabilityChange:
votingfileORCL:
CLUS3nowoffline
2010-09-2415:
46:
13.431:
[CLSF][1157609792]Closinghandle:
0x2aaab006ac20
2010-09-2415:
46:
13.431:
[SKGFD][1157609792]Lib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
closinghandle0x2aaab0062830fordisk:
ORCL:
CLUS3:
Queryingvotedisksfrequentlywillenabletospotthestatechange
$crsctlquerycssvotedisk
##STATEFileUniversalIdFileNameDiskgroup
------------------------------------------
1.PENDOFFL7d49533611734f3bbf404d32f1759ed5（ORCL:
CLUS1）[CLUSTERDG]
2.ONLINE4a8c288d1ade4f8cbf6588c145b27489（ORCL:
CLUS2）[CLUSTERDG]
3.ONLINEad241f9823cd4fb9bf3412ca67e591df（ORCL:
CLUS3）[CLUSTERDG]
Located3votingdisk（s）.
$crsctlquerycssvotedisk
##STATEFileUniversalIdFileNameDiskgroup
------------------------------------------
1.ONLINE7d49533611734f3bbf404d32f1759ed5（ORCL:
CLUS1）[CLUSTERDG]
2.ONLINE4a8c288d1ade4f8cbf6588c145b27489（ORCL:
CLUS2）[CLUSTERDG]
3.ONLINEad241f9823cd4fb9bf3412ca67e591df（ORCL:
CLUS3）[CLUSTERDG]
Located3votingdisk（s）.
crs_stat（deprecatedin11gR2）showsclusterapplicationsarerunningbutocrcheckfails
crs_stat-t
NameTypeTargetStateHost
------------------------------------------------------------
ora....ERDG.dgora....up.typeONLINEONLINEhpc1
ora....ER.lsnrora....er.typeONLINEONLINEhpc1
ora....N1.lsnrora....er.typeOFFLINEOFFLINE
ora.asmora.asm.typeONLINEONLINEhpc1
ora.eonsora.eons.typeONLINEONLINEhpc1
ora.gsdora.gsd.typeOFFLINEOFFLINE
ora....SM1.asmapplicationONLINEONLINEhpc1
ora....C1.lsnrapplicationONLINEONLINEhpc1
ora.hpc1.gsdapplicationOFFLINEOFFLINE
ora.hpc1.onsapplicationONLINEOFFLINE
ora.hpc1.vipora....t1.typeONLINEONLINEhpc1
workora....rk.typeONLINEONLINEhpc1
ora.oc4jora.oc4j.typeOFFLINEOFFLINE
ora.onsora.ons.typeONLINEOFFLINE
ora....ry.acfsora....fs.typeONLINEONLINEhpc1
ora.scan1.vipora....ip.typeOFFLINEOFFLINE
ocrcheck
PROT-602:
Failedtoretrievedatafromtheclusterregistry
PROC-26:
Errorwhileaccessingthephysicalstorage
4.Stopthecrsonallnodesandstartcrsinexclusivemodeinonenode.ManualshutdownofASMinstanceanddatabaseinstancemightberequiredifthestopcommandisunablecompletetheseoperations.
crsctlstopcrs
CRS-2791:
StartingshutdownofOracleHighAvailabilityServices-managedresourceson'hpc1'
CRS-2673:
Attemptingtostop'ora.crsd'on'hpc1'
CRS-2790:
StartingshutdownofClusterReadyServices-managedresourceson'hpc1'
CRS-2673:
Attemptingtostop'ora.CLUSTERDG.dg'on'hpc1'
CRS-2673:
Attemptingtostop'ora.registry.acfs'on'hpc1'
CRS-2673:
Attemptingtostop'ora.LISTENER.lsnr'on'hpc1'
CRS-2677:
Stopof'ora.registry.acfs'on'hpc1'succeeded
CRS-4549:
Unexpecteddisconnectwhileexecutingshutdownrequest.
CRS-2677:
Stopof'ora.crsd'on'hpc1'succeeded
CRS-2673:
Attemptingtostop'ora.gpnpd'on'hpc1'
CRS-2673:
Attemptingtostop'ora.cssdmonitor'on'hpc1'
CRS-2673:
Attemptingtostop'ora.ctssd'on'hpc1'
CRS-2673:
Attemptingtostop'ora.evmd'on'hpc1'
CRS-2673:
Attemptingtostop'ora.asm'on'hpc1'
CRS-2673:
Attemptingtostop'ora.mdnsd'on'hpc1'
CRS-2673:
Attemptingtostop'ora.drivers.acfs'on'hpc1'
CRS-2677:
Stopof'ora.cssdmonitor'on'hpc1'succeeded
CRS-2677:
Stopof'ora.gpnpd'on'hpc1'succeeded
CRS-2677:
Stopof'ora.evmd'on'hpc1'succeeded
CRS-2677:
Stopof'ora.mdnsd'on'hpc1'succeeded
CRS-2677:
Stopof'ora.ctssd'on'hpc1'succeeded
CRS-2677:
Stopof'ora.asm'on'hpc1'succeeded
CRS-2673:
Attemptingtostop'ora.cssd'on'hpc1'
CRS-2677:
Stopof'ora.cssd'on'hpc1'succeeded
CRS-2673:
Attemptingtostop'ora.diskmon'on'hpc1'
CRS-2673:
Attemptingtostop'ora.gipcd'on'hpc1'
CRS-2677:
Stopof'ora.gipcd'on'hpc1'succeeded
CRS-2677:
Stopof'ora.drivers.acfs'on'hpc1'succeeded
CRS-2677:
Stopof'ora.diskmon'on'hpc1'succeeded
CRS-2793:
ShutdownofOracleHighAvailabilityServices-managedresourceson'hpc1'hascompleted
CRS-4133:
OracleHighAvailabilityServiceshasbeenstopped.
crsctlstartcrs-excl
CRS-4123:
OracleHighAvailabilityServiceshasbeenstarted.
CRS-2672:
Attemptingtostart'ora.gipcd'on'hpc1'
CRS-2672:
Attemptingtostart'ora.mdnsd'on'hpc1'
CRS-2676:
Startof'ora.gipcd'on'hpc1'succeeded
CRS-2676:
Startof'ora.mdnsd'on'hpc1'succeeded
CRS-2672:
Attemptingtostart'ora.gpnpd'on'hpc1'
CRS-2676:
Startof'ora.gpnpd'on'hpc1'succeeded
CRS-2672:
Attemptingtostart'ora.cssdmonitor'on'hpc1'
CRS-2676:
Startof'ora.cssdmonitor'on'hpc1'succeeded
CRS-2672:
Attemptingtostart'ora.cssd'on'hpc1'
CRS-2679:
Attemptingtoclean'ora.diskmon'on'hpc1'
CRS-2681:
Cleanof'ora.diskmon'on'hpc1'succeeded
CRS-2672:
Attemptingtostart'ora.diskmon'on'hpc1'
CRS-2676:
Startof'ora.diskmon'on'hpc1'succeeded
CRS-2676:
Startof'ora.cssd'on'hpc1'succeeded
CRS-2672:
Attemptingtostart'ora.ctssd'on'hpc1'
CRS-2672:
Attemptingtostart'ora.drivers.acfs'on'hpc1'
CRS-2676:
Startof'ora.drivers.acfs'on'hpc1'succeeded
CRS-2676:
Startof'ora.ctssd'on'hpc1'succeeded
CRS-2672:
Attemptingtostart'ora.asm'on'hpc1'
CRS-2676:
Startof'ora.asm'on'hpc1'succeeded
CRS-2672:
Attemptingtostart'ora.crsd'on'hpc1'
CRS-2676:
Startof'ora.crsd'on'hpc1'succeeded
Variouslogfileswillshowthestatusofvotedisksandocrdisks.ocssd.log
2010-09-2415:
53:
43.643:
[CSSD][1147734336]clssnmvDiskVerify:
Successfuldiscoveryof0disks
2010-09-2415:
53:
43.643:
[CSSD][1147734336]clssnmCompleteInitVFDiscovery:
Completinginitialvotingfilediscovery
2010-09-2415:
53:
43.643:
[CSSD][1147734336]clssnmvFindInitialConfigs:
Novotingfilesfound
2010-09-2415:
53:
43.644:
[CSSD][1147734336]clssnmCompleteVFDiscovery:
Completingvotingfilediscovery
2010-09-2415:
53:
43.644:
[CSSD][1147734336]clssnmvVerifyCommittedConfigVFs:
Insufficientvotingfilesfound,found0of0configured,needed1votingfiles
crsd.log
2010-09-2415:
54:
30.723:
[OCRASM][21660240]proprasmo:
kgfoCheckMountreturned[6]
2010-09-2415:
54:
30.723:
[OCRASM][21660240]proprasmo:
TheASMdiskgroupclusterdgisnotfoundornotmounted
2010-09-2415:
54:
30.724:
[OCRRAW][21660240]proprioo:
Failedtoopen[+clusterdg].Returnedproprasmo（）with
升级会员 