11gR2 RAC on VMWare ESXi V4.0

From: Tony Adolph <tony.adolph.dba@xxxxxxxxx>
To: Oracle Discussion List <oracle-l@xxxxxxxxxxxxx>
Date: Tue, 12 Jan 2010 09:06:28 +1300
Hi Folks,

I've been trying to build myself an RHEL 5.3 32-bit 11gR2 2 node RAC on ESXi
V4.0

Its only to play with to learn the new features.

It all goes well until the root.sh script on node 2 is run,
/u01/app/oraInventory/orainstRoot.sh runs fine on both.

/u01/app/11.2.0/grid/root.sh runs without error on node1, then fails at
octssd:

.
.
CRS-2672: Attempting to start 'ora.diskmon' on 'vmnode2'
CRS-2676: Start of 'ora.diskmon' on 'vmnode2' succeeded
CRS-2676: Start of 'ora.cssd' on 'vmnode2' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'vmnode2'
Start action for octssd aborted
CRS-2676: Start of 'ora.ctssd' on 'vmnode2' succeeded
CRS-2672: Attempting to start 'ora.drivers.acfs' on 'vmnode2'
CRS-2672: Attempting to start 'ora.asm' on 'vmnode2'
CRS-2676: Start of 'ora.drivers.acfs' on 'vmnode2' succeeded
CRS-2676: Start of 'ora.asm' on 'vmnode2' succeeded
CRS-2664: Resource 'ora.ctssd' is already running on 'vmnode2'
CRS-4000: Command Start failed, or completed with errors.
Command return code of 1 (256) from command: /u01/app/11.2.0/grid/bin/crsctl
start resource ora.asm -init
Start of resource "ora.asm -init" failed
Failed to start ASM
Failed to start Oracle Clusterware stack

I have tried with NTP configured and working correctly, putting octssd into
observer mode, and also with /etc/ntpd.conf moved putting octssd into active
mode.  Both ways fails on node2.

With octssd in Active mode (not using NTP) this is what I get in node 2's
octssd.log

2010-01-12 08:31:28.735: [    CTSS][3009731472]sclsctss_gvss8: Return [0]
and NTP status [1].
2010-01-12 08:31:28.735: [    CTSS][3009731472]ctss_check_vendor_sw: Vendor
time sync software is not detected. status [1].
2010-01-12 08:31:57.659: [    CTSS][2978261904]ctss_checkcb: clsdm requested
check alive. Returns [40]
2010-01-12 08:31:58.735: [    CTSS][3009731472]sclsctss_gvss2: NTP default
pid file not found
2010-01-12 08:31:58.735: [    CTSS][3009731472]sclsctss_gvss8: Return [0]
and NTP status [1].
2010-01-12 08:31:58.735: [    CTSS][3009731472]ctss_check_vendor_sw: Vendor
time sync software is not detected. status [1].
2010-01-12 08:32:27.657: [    CTSS][2978261904]ctss_checkcb: clsdm requested
check alive. Returns [40]
2010-01-12 08:32:28.737: [    CTSS][3009731472]sclsctss_gvss2: NTP default
pid file not found
2010-01-12 08:32:28.737: [    CTSS][3009731472]sclsctss_gvss8: Return [0]
and NTP status [1].
2010-01-12 08:32:28.737: [    CTSS][3009731472]ctss_check_vendor_sw: Vendor
time sync software is not detected. status [1].

On node1 all looks good (I think):

[oracle@vmnode1 bin]$ ./cluvfy comp clocksync -verbose

Verifying Clock Synchronization across the cluster nodes

Checking if Clusterware is installed on all nodes...
Check of Clusterware install passed

Checking if CTSS Resource is running on all nodes...
Check: CTSS Resource running on all nodes
  Node Name                             Status
  ------------------------------------  ------------------------
  vmnode1                               passed
Result: CTSS resource check passed


Querying CTSS for time offset on all nodes...
Result: Query of CTSS for time offset passed

Check CTSS state started...
Check: CTSS state
  Node Name                             State
  ------------------------------------  ------------------------
  vmnode1                               Active
CTSS is in Active state. Proceeding with check of clock time offsets on all
nodes...
Reference Time Offset Limit: 1000.0 msecs
Check: Reference Time Offset
  Node Name     Time Offset               Status
  ------------  ------------------------  ------------------------
  vmnode1       0.0                       passed

Time offset is within the specified limits on the following set of nodes:
"[vmnode1]"
Result: Check of clock time offsets passed


Oracle Cluster Time Synchronization Services check passed

Verification of Clock Synchronization across the cluster nodes was
successful.

I can't find anything out there about this.... one link that looked
promising about ctssd was
http://www.rachelp.nl/index_kb.php?menu=articles&actie=show&id=60  but I'm
still stuck :-(

Any help would be much appreciated.

Regards
Tony
11gR2 RAC on VMWare ESXi V4.0

Other related posts:
