Re: who's got the biggest and the fastest?

  • From: Robyn <robyn.sands@xxxxxxxxx>
  • To: "Greg Rahn" <greg@xxxxxxxxxxxxxxxxxx>
  • Date: Mon, 5 Nov 2007 16:01:32 -0500

Thanks Greg ...

Yes, I've gotten the marketing pitch from a few different vendors and I can
see through some of it, but I can also see the potential for the right kind
of data and a specific kind of business need.  And according the marketeers,
some of the big players in data warehousing are making the switch (big names
were dropped) and Larry Ellison has even acknowledged that Oracle needs to
come up with something to beat the newest upstarts.  Of course, some of the
information being presented is clearly misleading; the challengers imply
that Oracle maintenance is much more labor intensive than it really is these
days and they neglect to mention that Oracle has many of the same features
that they are bragging about.

So now I'm reading through Winter Corps white papers and looking over their
top 10, but 2005 was a while ago and I'm curious .... who's biggest and
fastest now and what do they run? Have any of them really made the switch to
shared nothing and mpp?  If they're using Oracle, how do they do it? (for
once, I probably do need RAC.)

And the crux of my question - Is there a point where Oracle becomes the less
optimal solution?

I'm in a very preliminary evaluation stage at this point, but estimates for
data loads are in the neighborhood of over a TB of raw data per day and it
will need to be accessed fast and adhoc to some extent.  What are the
options to consider?

Robyn


On Nov 5, 2007 11:37 AM, Greg Rahn <greg@xxxxxxxxxxxxxxxxxx> wrote:

> Sounds like you've been getting the marketing pitch...be careful and
> don't get caught up in it.  Stick to the technicals.
>
> Just to clarify, Oracle isn't OLAP based, unless you are using the
> OLAP feature and functionality.
>
> Just curious, what "very big" and "very fast" to you?  These words are
> a bit subjective and mean different things to different people.
>
> Oracle is a significant player in the DW/DSS space and has been for a
> number of years.  Check out the Winter Corp VLDB reports.  In 2005,
> Yahoo had a 100 TB db on Oracle.  I'm sure its grown since then.
>
> An Oracle system can be architected to do whatever you want.  You just
> have to define what *it* is.  Start with good db design and smartly
> apply features where it can help.  Probably the most important thing
> in choosing hardware for an Oacle DW/DSS system is to have a balanced
> system.  This means that the CPU and I/O bandwidth are in a optimal
> ratio to each other.  Optimal meaning that for your workload, both
> resources are exhausted at approximately the same time.
>
> Don't be fooled that brute force table scans are the way either.
> There are certainly times when they are required, but remember the
> phrase "work smarter, not harder"?  It applies here too.  The fastest
> I/O is the one that never happens.  Partitioning is your friend.
>
> Hope that helps...
>
> On 11/5/07, Robyn <robyn.sands@xxxxxxxxx> wrote:
> > morning everyone,
> >
> > Anyone out there familiar with setting up very big and very fast Oracle?
>  If
> > you could start from scratch, how would you architect your system?  What
> are
> > some of the options that should be considered?
> >
> > Can a well designed Oracle system beat the proprietary data warehouse
> type
> > specialists who claim that Oracle is OLAP based and therefore unable to
> > match their speed with big data?
> >
> > Thoughts, comments and war stories appreciated ...
> >
> > Robyn
>
>
> --
> Regards,
>
> Greg Rahn
> http://structureddata.org
>

Other related posts: