Re: storage and filesystems on linux (ocfs2, ASM...)

  • From: Jonathan Smith <smithj@xxxxxxxxxx>
  • To: D'Hooge Freek <Freek.DHooge@xxxxxxxxx>
  • Date: Mon, 13 Jun 2011 14:40:09 -0800

Thanks for the reply.

We have Oracle, HP (hardware, SAN switches, HP EVA), and Red Hat (OS) tickets 
open. So far all are pointing fingers at each other.

Our other systems also use qlogic, but ocfs2 is the only one which panics due 
to a rescan. Other filesystems notice the event, write out a warning in the 
log, and continue to function. The rescans are happening because of a routine 
fabric event: adding a path, losing a path, new device zoned in, etc.

When doing the individual node-local installs, how do you make sure everything 
is in-sync?

        Jonathan Smith

On 06/13/2011 01:32 PM, D'Hooge Freek wrote:
> Normally we use ASM for the database and install the Oracle binaries on local 
> disks (no shared homes). NFS volumes are used for filesystems that need to be 
> shared between the nodes. In 11g you could also use ACFS for that (no real 
> experience with that).
> 
> The other option we use is NFS for the database as well.
> In 11g with dNFS we get some very good performance by combining multiple 
> network interfaces.
> 
> But OCFS2 should work.
> It is very strange that your qlogic driver rescans the fabric, and ASM will 
> not protect you against this. So the first thing I would do is to investigate 
> what is causing this rescanning.
> 
> 
> Regards,
> 
> 
> Freek D'Hooge
> Uptime
> Oracle Database Administrator
> email: freek.dhooge@xxxxxxxxx
> tel +32(0)3 451 23 82
> http://www.uptime.be
> disclaimer: www.uptime.be/disclaimer
> 
> -----Original Message-----
> From: oracle-l-bounce@xxxxxxxxxxxxx [mailto:oracle-l-bounce@xxxxxxxxxxxxx] On 
> Behalf Of Jonathan Smith
> Sent: maandag 13 juni 2011 22:34
> To: oracle-l@xxxxxxxxxxxxx
> Subject: storage and filesystems on linux (ocfs2, ASM...)
> 
> We currently run ocfs2 1.4.x on RHEL 5, and we've been having huge problems. 
> Our four-node cluster is simultaneously rebooting roughly once a week 
> (sometimes more, sometimes less). The qlogic driver periodically rescans the 
> fabric, and blocks IO while that happens. Sometimes it exceeds the ocfs2 
> tiemout, and cluster goes kaboom. We've increased the timeout values to 
> absurd levels (more than a minute), and somehow it still happens.
> 
> So, my question is what other folks are doing for cluster storage on RHEL. We 
> need the ability to share the database files as well as oracle software 
> installs.
> 
> I know ASM is an option, but we haven't investigated it yet. I think is 
> instance-specific, and thus can't be used for the oracle installed files? 
> Other options might be GFS2 (Red Hat's cluster filesystem), Veritas, or 
> something else entirely.
> 
> What are you folks using, and how do you like it?
> 
>       Jonathan Smith
> 
> --
> //www.freelists.org/webpage/oracle-l
> 
> 

--
//www.freelists.org/webpage/oracle-l

Other related posts:

  1. Home
  2. oracle-l
  3. Archive
  4. 06-2011