RE: Storage array advice anyone?

  • From: "Loughmiller, Greg" <greg.loughmiller@xxxxxxxxxxxx>
  • To: "'bdbafh@xxxxxxxxx'" <bdbafh@xxxxxxxxx>, Stephen.Barr@xxxxxxxxx
  • Date: Thu, 16 Dec 2004 08:08:40 -0600

In our experience, getting EMC to perform an analysis of the frame has
usually provided some benefit. Is the Frame shared with other hosts/ports? 
But getting EMC to do a deep down dive on the Frame may shed some light for
you..
greg

-----Original Message-----
From: Paul Drake [mailto:bdbafh@xxxxxxxxx] 
Sent: Wednesday, December 15, 2004 3:52 PM
To: Stephen.Barr@xxxxxxxxx
Cc: Amir.Hameed@xxxxxxxxx; oracle-l@xxxxxxxxxxxxx
Subject: Re: Storage array advice anyone?

Amir,

Obviously, you need more cache :).

(ducking and running)

It might be that you're saturated at the controller (FCHBAs - host bus
adapter(s)) or in internal bandwidth - depends upon the number of
paths allocated to your mount points.

Paul


On Wed, 15 Dec 2004 20:34:40 -0000, Barr, Stephen
<Stephen.Barr@xxxxxxxxx> wrote:
> Hi Amir,
>         We also have a DMX 3000 box and have it striped 8 ways.
> 
>         We have 83 meta devices, each meta device is ~67Gb is size and is
> made of eight 8.43Gb volumes. Each volume is RAID 1, however, each meta
> volume is striped across it's eight individual volumes with a stripe size
of
> 0.94Mb.
> 
>         The issue we have at present is that we are a datawarehouse doing
> lots of 1Mb direct path reads. Each read will hit 8 physical devices (with
> 1Mb stripe unit size at OS). I assuming this is a bad thing - surely each
of
> our reads should be hitting only a single device? i.e. we're waiting on 8
> devices instead of only one.
> 
>         I've performed a number of tests with PQ on the current setup, and
> it looks like the IO subsystem is saturated with a single PQ query (degree
> 4) to such an extent that two PQ queries running together BOTH take twice
as
> long to complete....surely this isn't the pattern we should be seeing? It
> essentially means that the system is 100% non-scalable.
> 
> 1 query PARALLEL 4 (FTS)
> 
> 1Mb Stripe unit         5 mins 18 secs
> 512k Stripe unit                5 mins 18 secs
> 128k Stripe unit                5 mins 52 secs
> CONCAT                  5 mins 10 secs
> 
> 2 queries hitting same table PARALLEL 4 (FTS)
> 
> 1Mb Stripe unit         8 mins 43 secs (each)
> 512k Stripe unit                10 mins 12 secs (each)
> 128k Stripe unit                8 mins 35 secs (each)
> CONCAT                  8 mins 10 secs (each)
> 
> Does anyone have any experience of setting up this type of storage
solution
> for a data warehouse?
> 
> Thanks,
> 
> Steve.
--
//www.freelists.org/webpage/oracle-l


--
//www.freelists.org/webpage/oracle-l

Other related posts: