Re: predicting performance of sql loading a 400 GB file

  • From: "Niall Litchfield" <niall.litchfield@xxxxxxxxx>
  • To: nigel_cl_thomas@xxxxxxxxx
  • Date: Mon, 18 Feb 2008 12:38:49 +0000

I concur, in fact a relatively common question on various forums goes like
this

"I have a batch process that loads X million records into a table. At first
it goes really fast with the first Y thousand records loading in seconds. As
it progresses the load goes slower and slower, what's happening?"




On Feb 18, 2008 10:48 AM, Nigel Thomas <nigel_cl_thomas@xxxxxxxxx> wrote:

> Ryan
>
> I simply don't know what the scaling effects might be - therefore I would
> have to assume they might not be linear. That would suggest that you should
> try several values and plot them. 0.25% seems a very small sample to me -
> 10% might be more like it - so why not try at values like: 10, 20, 40, 80Gb
> and see what happens?
>
> Of course that's not to say there's no chance of some scaling effect
> coming into play at 100, 200 or 399Gb that you weren't expecting.
>
> Regards Nigel
>
> ----- Original Message ----
> From: "ryan_gaffuri@xxxxxxxxxxx" <ryan_gaffuri@xxxxxxxxxxx>
> To: oracle-l@xxxxxxxxxxxxx
> Sent: Monday, February 18, 2008 2:05:27 AM
> Subject: predicting performance of sql loading a 400 GB file
>
> I don't have a 400 GB file and I don't have storage space for it to leave
> a file on disk to run the test. If I do some test loads of a 1 GB data file,
> does anyone know if this will scale up linearly? what is the minimum size
> file I should use in order to get some idea of predicting performance of the
> load?
>
> --
> //www.freelists.org/webpage/oracle-l
> --
> //www.freelists.org/webpage/oracle-l
>
>
>


-- 
Niall Litchfield
Oracle DBA
http://www.orawin.info

Other related posts: