RE: Using functions in sqlldr cripples performance
- From: "Mercadante, Thomas F \(LABOR\)" <Thomas.Mercadante@xxxxxxxxxxxxxxxxx>
- To: <JDunn@xxxxxxxxx>, "oracle-l" <oracle-l@xxxxxxxxxxxxx>
- Date: Wed, 7 Mar 2007 10:54:02 -0500
John,
Along with what others have said, have you considered using a
post-process PL/SQL routine to clean the data once it is loaded into
your table? Either you pay the price up front of cleaning the data
while you load it, or pay the price by using an external table &
cleaning the data as you process it, or load it as you are and run a sql
script after the fact.
No matter what option you choose, there is a set amount of work that
needs to be done to load the data. And you get to pick and test all
three options and see which one works best for you.
Hope this helps.
Tom
--------------------------------------------------------
This transmission may contain confidential, proprietary, or privileged
information which is intended solely for use by the individual or entity to
whom it is addressed. If you are not the intended recipient, you are hereby
notified that any disclosure, dissemination, copying or distribution of this
transmission or its attachments is strictly prohibited. In addition,
unauthorized access to this transmission may violate federal or State law,
including the Electronic Communications Privacy Act of 1985. If you have
received this transmission in error, please notify the sender immediately by
return e-mail and delete the transmission and its attachments.
________________________________
From: oracle-l-bounce@xxxxxxxxxxxxx
[mailto:oracle-l-bounce@xxxxxxxxxxxxx] On Behalf Of John Dunn
Sent: Wednesday, March 07, 2007 9:09 AM
To: oracle-l
Subject: Using functions in sqlldr cripples performance
I have a Oracle 9 direct load sqlldr routine which provides adequate
performance but have now had a request to delete some characters from
the data during the load and set some fields to upper case.
However tests show that using UPPER or TRANSLATE in the sqlldr control
file has huge negative impact on performance of the load.
Anyone got a solution to this ?
John Dunn
Product Consultant
Sefas Innovation Limited
Direct Dial + 44 (0) 117 373 6122
www.sefas.com
<file:///C:\Documents%20and%20Settings\ransty\Application%20Data\Microso
ft\Signatures\www.sefas.com>
Sefas Innovation Ltd, CityPoint, Temple Gate, Bristol BS1 6PL, UK. Tel:
+44 (0) 117 373 6114 Fax: +44 (0) 117 373 6115
Sefas Innovation Limited. Registered No: 3769761 England. Registered
Office: One New Street, Wells, Somerset, BA5 2LA, United Kingdom. VAT
Registration No: GB 741 5377 32
Unless stated to be non-confidential, this email and any attachments are
private and confidential and are for the addressee only. Sefas monitors
e-mails to ensure its systems operate effectively and to minimize the
risk of viruses. Whilst Sefas has taken reasonable steps to scan this
email, it does not accept liability for any virus that may be contained
in it.
Internet communications are not 100% secure and as such Sefas is not
responsible for their abuse by 3rd parties, nor for any alteration or
corruption in transmission.
Other related posts:
