RE: File Processing Question

  • From: John Hallas <John.Hallas@xxxxxxxxxxxxxxxxxx>
  • To: "niall.litchfield@xxxxxxxxx" <niall.litchfield@xxxxxxxxx>, ORACLE-L <oracle-l@xxxxxxxxxxxxx>
  • Date: Thu, 30 Sep 2010 19:34:11 +0100

NFS mount  managed as a service by HP ServiceGuard  - part of our licensing 
package so no additional cost

John


www.jhdba.wordpress.com

________________________________
From: oracle-l-bounce@xxxxxxxxxxxxx [mailto:oracle-l-bounce@xxxxxxxxxxxxx] On 
Behalf Of Niall Litchfield
Sent: 29 September 2010 17:21
To: ORACLE-L
Subject: File Processing Question

After the wisdom of crowds here.

Consider a system that processes files uploaded by ftp to the DB server. 
Currently the upload directory is polled periodically for new files (since they 
don't all arrive on a predictable schedule with predictable names). Any new 
files are processed and then moved to an archive location so that they aren't 
reprocessed. The polling and processing is done by java stored procedures.   
This system is a RAC system with no shared filesystem storage. The jobs that 
poll run on a particular instance via the 10g Job Class trick. The question 
that I have is how would you implement resilience to node failure for this 
system. It seems to me that we could do

 *   add shared storage - at a cost probably.
 *   ftp the files directly to the db - implies code changes probably
Does anyone else do anything similar and if so how?

--
Niall Litchfield
Oracle DBA
http://www.orawin.info

______________________________________________________________________
Wm Morrison Supermarkets Plc is registered in England with number 358949. The 
registered office of the company is situated at Gain Lane, Bradford, West 
Yorkshire BD3 7DL. This email and any attachments are intended for the 
addressee(s) only and may be confidential. 

If you are not the intended recipient, please inform the sender by replying to 
the email that you have received in error and then destroy the email. 
If you are not the intended recipient, you must not use, disclose, copy or rely 
on the email or its attachments in any way. 

This email does not constitute a contract in writing for the purposes of the 
Law of Property (Miscellaneous Provisions) Act 1989.

Our Standard Terms and Conditions of Purchase, as may be amended from time to 
time, apply to any contract that we enter into. The current version of our 
Standard Terms and Conditions of Purchase is available at: 
http://www.morrisons.co.uk/gscop

Although we have taken steps to ensure the email and its attachments are 
virus-free, we cannot guarantee this or accept any responsibility, 
and it is the responsibility of recipients to carry out their own virus checks. 
______________________________________________________________________

Other related posts: