RE: How to store 50 Terabytes per day?

  • From: "MacGregor, Ian A." <ian@xxxxxxxxxxxxxxxxx>
  • To: <Jared.Still@xxxxxxxxxxx>, <oracle-l@xxxxxxxxxxxxx>
  • Date: Wed, 8 Sep 2004 09:43:09 -0700

Before replying please see:

http://www-search.slac.stanford.edu:8765/query.html?col=3Dslacweb&col=3Dt=
odays&col=3Dssrlweb&col=3Dslacpubs&col=3Dbabarweb&qt=3Dlsst&charset=3Diso=
-8859-1&qc=3Dslacweb+todays+ssrlweb+slacpubs+babarweb

Then choose "LSST for SDSC".  This is a powerpoint presentation about =
the project that contains some information on the computing =
requirements.

Problems with Oracle:  What is the maximum number of partitions for a =
database?  Will hierarchical file management systems does it work with?  =
What if that system needs to be extende?.  Is Oracle's one-cluster hence =
one-architecture technology right for the project?  Does Oracle RAC tie =
you to a single vendor?  Can RAC's communicate with other RAC's?  Does =
anyone think this will be done using RAID10.

I'm not sure how much of the data will be online annd how much will be =
nearline storage. =20

Ian Macgregor
Stanford Linear Accelerator Center
ian@xxxxxxxxxxxxxxxxx  =20

 =20

=20

-----Original Message-----
From: oracle-l-bounce@xxxxxxxxxxxxx =
[mailto:oracle-l-bounce@xxxxxxxxxxxxx] On Behalf Of =
Jared.Still@xxxxxxxxxxx
Sent: Wednesday, September 08, 2004 9:08 AM
To: oracle-l@xxxxxxxxxxxxx
Subject: How to store 50 Terabytes per day?

This quote appears in the following article:=20
http://www.computerworld.com/hardwaretopics/storage/story/0,10801,95694,0=
0.html?nas=3DDM-95694
" When it's in operation in 2011 at a site still to be determined, the =
telescope being built for the LSST project will collect data at a rate =
of about 6GB (equivalent to one DVD) per 10 seconds, generating many =
petabytes of data over time. One petabyte equals roughly 100 times the =
printed contents of the Library of Congress. The LSST project "pushes =
forward database technology dramatically," says Philip Pinto, a physics =
professor at Steward Observatory at the University of Arizona and a =
member of the LSST project's board of directors. "The LSST database will =
probably be the largest known nonproprietary database in the world."=20
So if you were faced with the task of storing 50 Terabytes per day, what =
kind of architecture would it require?
Do you think Oracle would hold up with a transaction rate of 600 =
Megabytes per second?
The architecture of such a beast could drive out some interesting =
developments for more general use.
Jared




--
To unsubscribe - =
mailto:oracle-l-request@xxxxxxxxxxxxx&subject=3Dunsubscribe
To search the archives - //www.freelists.org/archives/oracle-l/
--
To unsubscribe - mailto:oracle-l-request@xxxxxxxxxxxxx&subject=unsubscribe 
To search the archives - //www.freelists.org/archives/oracle-l/

Other related posts: