Restoring Vote disk due to ASM disk failures3.docx
《Restoring Vote disk due to ASM disk failures3.docx》由会员分享，可在线阅读，更多相关《Restoring Vote disk due to ASM disk failures3.docx（13页珍藏版）》请在冰豆网上搜索。
RestoringVotediskduetoASMdiskfailures3
RestoringVotediskduetoASMdiskfailures-3
Previousblogsshowedtherestoringofvotediskdueto one and two ASMdiskfailuresinthediskgroupcontainingvotedisks.ThisscenarioiswhenallthedisksintheASMdiskgroupcontaingvotedisksareaffected.
Scenario3.
1.OnlyVotedisksareinASMdiskgroup
2.ASMdiskgrouphasnormalredundancywithonlythreefailuregroups
3.Allfailuregroupsareaffected
4.OCRislocatedinaseparatelocation（inanotherdiskgrouporblockdevicelocation-notsupportedbyOracleonlyvalidduringmigrationcouldbemovedtoafterinstallationfortestingpurposes）
1. MovethevotediskstoASMdiskgroup ifnotdonealready.Belowisthecurrentconfiguration
crsctlquerycssvotedisk
##STATEFileUniversalIdFileNameDiskgroup
------------------------------------------
1.ONLINE9da0c9d64b9a4fcabf3d143627e7f3e8（ORCL:
CLUS1）[CLUSTERDG]
2.ONLINE380dba2e5b654f80bfe69d64c5d0c12c（ORCL:
CLUS2）[CLUSTERDG]
3.ONLINE95968700d82b4ff8bf88167a28b080a4（ORCL:
CLUS3）[CLUSTERDG]
2.Identifythedisksbelongingtothediskgroupandcorruptthemtosimulatediskfailure.Onediskbeingcorruptedshownhere
#/etc/init.d/oracleasmquerydisk-pclus3
Disk"CLUS3"isavalidASMdisk
/dev/sdc10:
LABEL="CLUS3"TYPE="oracleasm"
#ddif=/dev/zeroof=/dev/sdc10count=204800bs=8192
204800+0recordsin
204800+0recordsout
3.ocssd.logwillshowthedetectionofvotediskcorruption
2010-08-2510:
33:
33.572:
[CSSD][1235470656]clssnmvDiskKillCheck:
votingdiskcorrupted（0x00000000,0x00000000）（ORCL:
CLUS1）
2010-08-2510:
33:
33.572:
[CSSD][1235470656]clssnmvDiskAvailabilityChange:
votingfileORCL:
CLUS1nowoffline
2010-08-2510:
33:
34.263:
[CLSF][1193511232]Closinghandle:
0x68d6110
2010-08-2510:
33:
34.263:
[SKGFD][1193511232]Lib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
closinghandle0x68ae880for
disk:
ORCL:
CLUS1:
2010-08-2510:
33:
34.263:
[CSSD][1193511232]clssnmvScanCompletions:
completed4items
2010-08-2510:
33:
34.270:
[CSSD][1141061952]clssnmvSchedDiskThreads:
DiskPingThreadforvotingfileORCL:
CLUS3scheddelay1680>margin1500cur_ms1026610624lastalive1026608944
2010-08-2510:
33:
34.270:
[CSSD][1141061952]clssnmvSchedDiskThreads:
DiskPingThreadforvotingfileORCL:
CLUS2scheddelay1560>margin1500cur_ms1026610624lastalive1026609064
2010-08-2510:
33:
34.270:
[CSSD][1141061952]clssnmvSchedDiskThreads:
DiskPingThreadforvotingfileORCL:
CLUS1scheddelay1720>margin1500cur_ms1026610624lastalive1026608904
2010-08-2510:
33:
34.572:
[CLSF][1235470656]Closinghandle:
0x2aaab4246560
2010-08-2510:
33:
34.572:
[SKGFD][1235470656]Lib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
closinghandle0x2aaab423b080
fordisk:
ORCL:
CLUS1:
2010-08-2510:
33:
35.042:
[CLSF][1214490944]Closinghandle:
0x2aaab43557f0
2010-08-2510:
33:
35.042:
[SKGFD][1214490944]Lib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
closinghandle0x2aaab43fd730
fordisk:
ORCL:
CLUS1:
2010-08-2510:
33:
36.268:
[CSSD][1298409792]clssnmSendingThread:
sendingstatusmsgtoallnodes
2010-08-2510:
33:
36.268:
[CSSD][1298409792]clssnmSendingThread:
sent5statusmsgstoallnodes
2010-08-2510:
33:
36.272:
[CSSD][1141061952]clssnmvSchedDiskThreads:
DiskPingThreadforvotingfileORCL:
CLUS1scheddelay3720>margin1500cur_ms1026612624lastalive1026608904
2010-08-2510:
33:
37.044:
[CSSD][1214490944]clssnmvDiskOpen:
OpeningORCL:
CLUS1
2010-08-2510:
33:
37.044:
[SKGFD][1214490944]Handle0x2aaab423b080fromlib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
fordisk:
ORCL:
CLUS1:
2010-08-2510:
33:
37.044:
[CLSF][1214490944]Openedhdl:
0x2aaab41e9170fordev:
ORCL:
CLUS1:
2010-08-2510:
33:
37.054:
[CSSD][1214490944]clssnmvStatusBlkInit:
myinfonodenamehpc1,uniqueness1282657936
2010-08-2510:
33:
37.054:
[CSSD][1214490944]clssnmvDiskAvailabilityChange:
votingfileORCL:
CLUS1nowonline
2010-08-2510:
33:
37.054:
[SKGFD][1193511232]Handle0x682fcc0fromlib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
fordisk:
ORCL:
CLUS1:
2010-08-2510:
33:
37.054:
[CLSF][1193511232]Openedhdl:
0x6906de0fordev:
ORCL:
CLUS1:
2010-08-2510:
33:
37.575:
[SKGFD][1235470656]Handle0x2aaab43fd730fromlib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
fordisk:
ORCL:
CLUS1:
2010-08-2510:
33:
37.575:
[CLSF][1235470656]Openedhdl:
0x2aaab41ee180fordev:
ORCL:
CLUS1:
2010-08-2510:
33:
37.598:
[CSSD][1235470656]clssnmvDiskKillCheck:
votingdiskcorrupted（0x00000000,0x00000000）（ORCL:
CLUS1）
2010-08-2510:
33:
37.598:
[CSSD][1235470656]clssnmvDiskAvailabilityChange:
votingfileORCL:
CLUS1nowoffline
2010-08-2510:
33:
38.055:
[CLSF][1193511232]Closinghandle:
0x6906de0
2010-08-2510:
33:
38.055:
[SKGFD][1193511232]Lib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
closinghandle0x682fcc0for
disk:
ORCL:
CLUS1:
2010-08-2510:
33:
38.279:
[CSSD][1141061952]clssnmvSchedDiskThreads:
DiskPingThreadforvotingfileORCL:
CLUS1scheddelay5730>margin1500cur_ms1026614634lastalive1026608904
2010-08-2510:
33:
38.601:
[CLSF][1235470656]Closinghandle:
0x2aaab41ee180
2010-08-2510:
33:
38.601:
[SKGFD][1235470656]Lib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
closinghandle0x2aaab43fd730
fordisk:
ORCL:
CLUS1:
2010-08-2510:
33:
38.658:
[CSSD][1214490944]clssnmvDiskAvailabilityChange:
votingfileORCL:
CLUS1nowonline
2010-08-2510:
33:
38.659:
[SKGFD][1193511232]Handle0x682fcc0fromlib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
fordisk:
ORCL:
CLUS1:
2010-08-2510:
33:
38.659:
[CLSF][1193511232]Openedhdl:
0x68b98f0fordev:
ORCL:
CLUS1:
2010-08-2510:
33:
39.600:
[SKGFD][1235470656]Handle0x2aaab43fd730fromlib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
fordisk:
ORCL:
CLUS1:
2010-08-2510:
33:
39.600:
[CLSF][1235470656]Openedhdl:
0x2aaab4276240fordev:
ORCL:
CLUS1:
2010-08-2510:
33:
39.689:
[CSSD][1172531520]clssnmvDiskKillCheck:
votingdiskcorrupted（0x00000000,0x00000000）（ORCL:
CLUS2）
2010-08-2510:
33:
39.689:
[CSSD][1172531520]clssnmvDiskAvailabilityChange:
votingfileORCL:
CLUS2nowoffline
2010-08-2510:
33:
39.830:
[CLSF][1162041664]Closinghandle:
0x68a4730
2010-08-2510:
33:
39.830:
[SKGFD][1162041664]Lib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
closinghandle0x68a4790for
disk:
ORCL:
CLUS2:
2010-08-2510:
33:
40.271:
[CLSF][1183021376]Closinghandle:
0x2aaab43fdd20
2010-08-2510:
33:
40.271:
[SKGFD][1183021376]Lib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
closinghandle0x2aaab43fce20
fordisk:
ORCL:
CLUS2:
2010-08-2510:
33:
40.690:
[CLSF][1172531520]Closinghandle:
0x689e5d0
2010-08-2510:
33:
40.690:
[SKGFD][1172531520]Lib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
closinghandle0x6c43870for
disk:
ORCL:
CLUS2:
2010-08-2510:
33:
41.278:
[CSSD][1298409792]clssnmSendingThread:
sendingstatusmsgtoallnodes
2010-08-2510:
33:
41.278:
[CSSD][1298409792]clssnmSendingThread:
sent5statusmsgstoallnodes
2010-08-2510:
33:
41.281:
[CSSD][1141061952]clssnmvSchedDiskThreads:
DiskPingThreadforvotingfileORCL:
CLUS2scheddelay2450>margin1500cur_ms1026617634lastalive1026615184
2010-08-2510:
33:
43.289:
[CSSD][1141061952]clssnmvSchedDiskThreads:
DiskPingThreadforvotingfileORCL:
CLUS2scheddelay4460>margin1500cur_ms1026619644lastalive1026615184
2010-08-2510:
33:
43.832:
[CSSD][1162041664]clssnmvDiskOpen:
OpeningORCL:
CLUS2
2010-08-2510:
33:
43.832:
[SKGFD][1162041664]Handle0x6c43870fromlib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
fordisk:
ORCL:
CLUS2:
2010-08-2510:
33:
43.832:
[CLSF][1162041664]Openedhdl:
0x68f9bc0fordev:
ORCL:
CLUS2:
2010-08-2510:
33:
43.876:
[CSSD][1162041664]clssnmvStatusBlkInit:
myinfonodenamehpc1,uniqueness1282657936
2010-08-2510:
33:
43.876:
[CSSD][1162041664]clssnmvDiskAvailabilityChange:
votingfileORCL:
CLUS2nowonline
2010-08-2510:
33:
43.876:
[SKGFD][1183021376]Handle0x2aaab43fce20fromlib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
fordisk:
ORCL:
CLUS2:
2010-08-2510:
33:
43.876:
[CLSF][1183021376]Openedhdl:
0x2aaab41c1fc0fordev:
ORCL:
CLUS2:
2010-08-2510:
33:
44.698:
[SKGFD][1172531520]Handle0x68a4790fromlib:
ASM:
/opt/oracle/extapi/64/asm/orcl/1/libasm.so:
fordisk:
ORCL:
CLUS2:
2010-08-2510:
33:
44.698:
[CLSF][1172531520]Openedhdl:
0x6c57440fordev:
ORCL:
CLUS2:
2010-08-2510:
33:
44.707:
[CSSD][1172531520]clssnmvDiskKillCheck:
votingdiskcorrupted（0x00000000,0x00000000）（ORCL:
CLUS2）
2010-08-2510:
33:
44.707:
[CSSD][1172531520]clssnmvDiskAvailabilityChange:
votingfileORCL:
CLUS2nowoffline
2010-08-2510:
33:
44.820:
[CSSD][1162041664]clssnmvDiskAvailabilityChange:
votingfileORCL:
CLUS2nowonline
2010-08-2510:
33:
45.289:
[CSSD][1141061952]clssnmvSchedDiskThreads:
DiskPingThreadforvotingfileORCL:
CLUS1scheddelay1750>margin1500cur_ms1026621644lastalive1026619894
2010-08-2510:
33:
50.296:
[CSSD][1298409792]clssnmSendingThread:
sent4statusmsgstoallnodes
2010-08-2510:
33:
53.311:
[CSSD][1141061952]clssnmvSchedDiskThreads:
DiskPingThreadforvotingfileORCL:
CLUS1scheddelay1660>margin1500cur_ms1026629664lastalive1026628004
2010-08-2510:
34:
13.342:
[CSSD][1298409792]clssnmSendingThread:
sent5statusmsgstoallnodes
2010-08-2510:
34:
14.984:
[CSSD][1141061952]clssnmvSchedDiskThreads:
DiskPingThreadforvotingfileORCL:
CLUS2scheddelay1560>margin1500cur_ms1026651334lastalive1026649774
2010-08-2510:
34:
14.984:
[CSSD][1141061952]clssnmvSchedDiskThreads:
DiskPingThreadforvotingfileORCL:
CLUS1scheddelay1580>margin1500cur_ms1026651334lastalive1026649754
2010-08-2510:
34:
16.398:
[CSSD][1224980800]clssnmvDiskKillCheck:
votingdiskcorrupted（0x00000000,0x00000000）（ORCL:
CLUS3）
2010-08-2510:
34:
16.398:
[CSSD][1224980800]clssnmvDiskAvailabilityChange:
votingfileORCL:
CLUS3nowoffline
2010-08-2510:
34:
16.830:
[CLSF][1204001088]Closinghandle:
0x68a5220
2010-08-2510:
34:
16.830:
[SKGFD][1204001
升级会员 