ASM Grid Infrastructure voting files not found any more

  • From: Martin Klier <usn@xxxxxxxxx>
  • To: Oracle L <oracle-l@xxxxxxxxxxxxx>
  • Date: Tue, 12 Jul 2011 13:45:09 +0200

Dear list,

I messed up my ASM diskstring, after this and a reboot my cssd's do not
start, because they can't find the voting files any more. Now one node
is fencing, the other one just attempts to restart the CSSD frequently.

How can I reconfigure the device name mask for the cssd (or the ASM disk
string - if it helps), to allow it to find its voting files in the right
way?


Thank you very much, any help is greatly appreciated!

Martin Klier



Here the corresponding part of the ocssd log file. I think the crucial
part is:

2011-07-11 09:36:45.976: [    CSSD][3997759248]clssnmvDiskCreate: Found
a duplicate voting file
/dev/disk/by-id/scsi-360080e50001c169e000002334dfebb44
in the discovery queue which appears to be the same physical device as
the newly discovered disk /dev/disk/by-id/ASMOCW2. Rejecting both these
files

It does repeat that for all three disks bearing the voting file copies.
=> bad

=======================================================

2011-07-11 09:36:45.975: [    CSSD][3997759248]clssnmvDiskVerify:
discovered a potential voting file
2011-07-11 09:36:45.975: [   SKGFD][3997759248]Handle 0x88e450 from lib
:UFS:: for disk :/dev/disk/by-id/ASMOCW2:

2011-07-11 09:36:45.976: [    CSSD][3997759248]clssnmFindVF: found VF by
vdin in the discovered queue
2011-07-11 09:36:45.976: [    CSSD][3997759248]clssnmFindVF: Duplicate
voting file found in the queue of previously discovered disks
queued(/dev/disk/by-id/scsi-360080e5000
1c169e000002334dfebb44|[7903ab4c-10b84f92-bfec4e33-5fb310fb]),
found(/dev/disk/by-id/ASMOCW2|[7903ab4c-10b84f92-bfec4e33-5fb310fb])
2011-07-11 09:36:45.976: [    CSSD][3997759248]clssnmvDiskCreate: Found
a duplicate voting file
/dev/disk/by-id/scsi-360080e50001c169e000002334dfebb44 in the discovery queu
e which appears to be the same physical device as the newly discovered
disk /dev/disk/by-id/ASMOCW2. Rejecting both these files
2011-07-11 09:36:45.976: [    CSSD][3997759248]clssnmvDiskDestroy:
removing the voting disk /dev/disk/by-id/ASMOCW2
2011-07-11 09:36:45.976: [   SKGFD][3997759248]Lib :UFS:: closing handle
0x88e450 for disk :/dev/disk/by-id/ASMOCW2:

2011-07-11 09:36:45.976: [    CSSD][3997759248]clssnmvDiskVerify:
discovered a potential voting file
2011-07-11 09:36:45.976: [   SKGFD][3997759248]Handle 0x88dab0 from lib
:UFS:: for disk :/dev/disk/by-id/ASMOCW3:

2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmFindVF: found VF by
vdin in the discovered queue
2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmFindVF: Duplicate
voting file found in the queue of previously discovered disks
queued(/dev/disk/by-id/scsi-360080e5000
1c1726000003374e01867c|[70ccc4d5-e1d94f7d-bface149-7b3d8e5f]),
found(/dev/disk/by-id/ASMOCW3|[70ccc4d5-e1d94f7d-bface149-7b3d8e5f])
2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmvDiskCreate: Found
a duplicate voting file
/dev/disk/by-id/scsi-360080e50001c1726000003374e01867c in the discovery queu
e which appears to be the same physical device as the newly discovered
disk /dev/disk/by-id/ASMOCW3. Rejecting both these files
2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmvDiskDestroy:
removing the voting disk /dev/disk/by-id/ASMOCW3
2011-07-11 09:36:45.977: [   SKGFD][3997759248]Lib :UFS:: closing handle
0x88dab0 for disk :/dev/disk/by-id/ASMOCW3:

2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmvDiskVerify:
discovered a potential voting file
2011-07-11 09:36:45.977: [   SKGFD][3997759248]Handle 0x88dab0 from lib
:UFS:: for disk :/dev/disk/by-id/ASMOCW1:

2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmFindVF: found VF by
vdin in the discovered queue
2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmFindVF: Duplicate
voting file found in the queue of previously discovered disks
queued(/dev/disk/by-id/scsi-360080e5000
1c1726000002a54dfebb58|[416b1bc2-1f764f0f-bfc1430b-8e447d30]),
found(/dev/disk/by-id/ASMOCW1|[416b1bc2-1f764f0f-bfc1430b-8e447d30])
2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmvDiskCreate: Found
a duplicate voting file
/dev/disk/by-id/scsi-360080e50001c1726000002a54dfebb58 in the discovery queu
e which appears to be the same physical device as the newly discovered
disk /dev/disk/by-id/ASMOCW1. Rejecting both these files
2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmvDiskDestroy:
removing the voting disk /dev/disk/by-id/ASMOCW1
2011-07-11 09:36:45.977: [   SKGFD][3997759248]Lib :UFS:: closing handle
0x88dab0 for disk :/dev/disk/by-id/ASMOCW1:

2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmvDiskVerify:
Successful discovery of 3 disks
2011-07-11 09:36:45.977: [
CSSD][3997759248]clssnmCompleteInitVFDiscovery: Completing initial
voting file discovery
2011-07-11 09:36:45.977: [
CSSD][3997759248]clssnmCompleteVFDiscovery: Completing voting file discovery
2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmvDiskStateChange:
state from discovered to deconfigured disk
/dev/disk/by-id/scsi-360080e50001c1726000002a54dfebb58
2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmvDiskStateChange:
state from discovered to deconfigured disk
/dev/disk/by-id/scsi-360080e50001c1726000003374e01867c
2011-07-11 09:36:45.977: [    CSSD][3997759248]clssnmvDiskStateChange:
state from discovered to deconfigured disk
/dev/disk/by-id/scsi-360080e50001c169e000002334dfebb44
2011-07-11 09:36:45.977: [
CSSD][3997759248]clssnmvVerifyCommittedConfigVFs: Insufficient voting
files found, found 0 of 3 configured, needed 2 voting files
2011-07-11 09:36:45.977: [
CSSD][3997759248](:CSSNM00020:)clssnmvVerifyCommittedConfigVFs: voting
file 0, id 416b1bc2-1f764f0f-bfc1430b-8e447d30 not found
2011-07-11 09:36:45.977: [
CSSD][3997759248](:CSSNM00020:)clssnmvVerifyCommittedConfigVFs: voting
file 1, id 7903ab4c-10b84f92-bfec4e33-5fb310fb not found
2011-07-11 09:36:45.977: [
CSSD][3997759248](:CSSNM00020:)clssnmvVerifyCommittedConfigVFs: voting
file 2, id 70ccc4d5-e1d94f7d-bface149-7b3d8e5f not found
2011-07-11 09:36:45.977: [    CSSD][3997759248]ASSERT clssnm1.c 3141
2011-07-11 09:36:45.977: [
CSSD][3997759248](:CSSNM00021:)clssnmCompleteVFDiscovery: Found 0 voting
files, but 2 are required.  Terminating due to insufficient configure
d voting files


--
Usn's IT Blog for Linux, Oracle, Asterisk
http://www.usn-it.de

--
//www.freelists.org/webpage/oracle-l


Other related posts: