Raj <sanstorage@xxxxxxxxx> wrote: > Just curious. What version of PowerPath were you using? PowerPath > 4.3.2 with RHEL 3.0 U4 and OCFS 1.0.14 or ASM has been fairly stable. Powerpath Version 4.3.2 (build 11) on 2.4.21-27.ELsmp kernels. EMC stated to us that they do not certify ASMlib with Powerpath. We were not the 1st customer to run into this brick wall. Pity they did not tell us that up-front when I installed and configured the cluster. Anyway, symptoms are actual I/O errors and the RAC instances reading corrupted data blocks. No actual corruption on the SAN side. Non destructive solution was to disable ASMlib and reconfigure the ASMlib devices as raw devices and change the ASM instances' discovery string. No changes were required on the RAC instances side and database was still intact after the change. Note that Oracle also says that this config works (note:309815.1). But I can confirm (with 2 TARs filed) it does not with the specific versions of Linux, Powerpath and ASMlib we have. In case you're wondering, reason for the older kernel version is the Interconnect hardware we're using. Configured as a 10Gbit ethernet backbone (can go up to 30Gbit). Very nice, very fast, and pretty cheap. Also allows memory and other resources to be shared among cluster nodes. However, Infiniband was bought out by Cisco and now we're waiting for Cisco to provide the TopSwitch/Infiniband kernel drivers for the latest Linux kernels. -- Billy ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ This e-mail and its contents are subject to the Telkom SA Limited e-mail legal notice available at http://www.telkom.co.za/TelkomEMailLegalNotice.PDF ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -- //www.freelists.org/webpage/oracle-l