RE: sqlplus core dump for one database
- From: "Jeffrey Beckstrom" <jbeckstrom@xxxxxxxxx>
- To: "Andy Sayer" <andysayer@xxxxxxxxx>, "Noveljic Nenad" <nenad.noveljic@xxxxxxxxxxxx>
- Date: Fri, 22 Feb 2019 12:35:03 -0500
We did an strace and that reminded us of the banner so we eliminated and
it then worked. We then put the banner back with one less line and still
worked. So the question is what is the limititions on the banner.
Noveljic Nenad <nenad.noveljic@xxxxxxxxxxxx> 2/22/19 12:03 PM >>>
Thank you for the feedback.
I don’t know about the max banner size.
But how did you figure out that it was the banner?
Nenad
http://nenadnoveljic.com/blog/
(
https://urldefense.proofpoint.com/v2/url?u=http-3A__nenadnoveljic.com_blog_&d=DwMGaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=aX52EdIcM-g13JIccaUt3dvPc_g2X17qM3viz0cXt9w&m=xE1dmPGZFOPFzTrviY9GT7zWF6IWpfvDFWEADC7eGnQ&s=LY8DdlUr5w7031fBWpjejC34ftluEs_pF9d6NMnu6dI&e=)
From: Jeffrey Beckstrom <jbeckstrom@xxxxxxxxx>
Sent: Freitag, 22. Februar 2019 17:56
To: Andy Sayer <andysayer@xxxxxxxxx>; Noveljic Nenad
<nenad.noveljic@xxxxxxxxxxxx>
Cc: oracle-l-freelist <oracle-l@xxxxxxxxxxxxx>
Subject: RE: sqlplus core dump for one database
We were using sec_user_audit_action_banner in our sqlnet.ora. We
commented the line out, bounced the database and the error disappeared.
Is there a maximum number of characters that can be in the file
referenced by this entry?
Jeffrey Beckstrom
Lead Database Administrator
Information Technology Department
Greater Cleveland Regional Transit Authority
1240 W. 6th Street
Cleveland, Ohio 44113
Noveljic Nenad <nenad.noveljic@xxxxxxxxxxxx> 2/22/19 10:43 AM >>>
Lacking better options, I’d suggest “stracing” a good and a bad
execution and compare the failed system calls.
Using this methodology, I recently resolved a problem with sqlplus
where the sqlplus was reporting an NLS issue, whereas the problem was a
failed “mprotect” system call, which in turn failed because of the
filled swap on the client machine. But sqlplus, sadly, hasn’t captured
this exception on the right spot to provide a meaningful error message.
The procedure is somewhat tedious, but it might yield a good result.
Nenad
http://nenadnoveljic.com/blog/
(
https://urldefense.proofpoint.com/v2/url?u=http-3A__nenadnoveljic.com_blog_&d=DwMGaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=aX52EdIcM-g13JIccaUt3dvPc_g2X17qM3viz0cXt9w&m=xE1dmPGZFOPFzTrviY9GT7zWF6IWpfvDFWEADC7eGnQ&s=LY8DdlUr5w7031fBWpjejC34ftluEs_pF9d6NMnu6dI&e=)
From: Jeffrey Beckstrom <jbeckstrom@xxxxxxxxx>
Sent: Freitag, 22. Februar 2019 15:44
To: Andy Sayer <andysayer@xxxxxxxxx>; Noveljic Nenad
<nenad.noveljic@xxxxxxxxxxxx>
Cc: oracle-l-freelist <oracle-l@xxxxxxxxxxxxx>
Subject: RE: sqlplus core dump for one database
All of that makes sense but we have multiple 12.2 databases running out
of this home and only this one database is experiencing the problem.
Noveljic Nenad <nenad.noveljic@xxxxxxxxxxxx> 2/22/19 9:28 AM >>>
sqlplus version is missing from the output, as well as the information
whether the connection is bequeath or remote. In former case, some
environment variables needs to be set if sqlplus is in a different home
from the DB.
But if the sqlplus is the one delivered with the database and the
remote connection (@DB) isn’t working properly, the next step could be
to check whether sqlplus is dynamically linked with correct shared
libraries. For this reason, I suggested to check the environment
variables and possibly a utility like pldd.
Nenad
http://nenadnoveljic.com/blog/
(
https://urldefense.proofpoint.com/v2/url?u=http-3A__nenadnoveljic.com_blog_&d=DwMGaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=aX52EdIcM-g13JIccaUt3dvPc_g2X17qM3viz0cXt9w&m=xE1dmPGZFOPFzTrviY9GT7zWF6IWpfvDFWEADC7eGnQ&s=LY8DdlUr5w7031fBWpjejC34ftluEs_pF9d6NMnu6dI&e=)
From: Andy Sayer <andysayer@xxxxxxxxx>
Sent: Freitag, 22. Februar 2019 15:16
To: Noveljic Nenad <nenad.noveljic@xxxxxxxxxxxx>
Cc: jbeckstrom@xxxxxxxxx; oracle-l-freelist <oracle-l@xxxxxxxxxxxxx>
Subject: Re: sqlplus core dump for one database
“The functions further up on the steck begin afi* which, I think, are
not Oracle server, but rather client functions:”
afi is the advanced friendly interface, what sql*plus was supposedly
initially called (hense afiedt.buf)
I suspect an old version of sql*plus running against a more recent DB
server which no longer creates the table sql*plus uses to restrict usage
of certain features. Client side security is obviously not the best of
ideas.
Hope this helps,
Andy
On Fri, 22 Feb 2019 at 14:02, Noveljic Nenad
<nenad.noveljic@xxxxxxxxxxxx> wrote:
The error was thrown in kghfre which is "kernel generic heap manager
free a chunk of memory" according to
http://orafun.info/
(
https://urldefense.proofpoint.com/v2/url?u=http-3A__orafun.info_&d=DwMGaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=aX52EdIcM-g13JIccaUt3dvPc_g2X17qM3viz0cXt9w&m=xE1dmPGZFOPFzTrviY9GT7zWF6IWpfvDFWEADC7eGnQ&s=0WHcwboH6cIW2vFBmCRzKxLn9W3KHwZx6nA_F9sdw3o&e=)
"Segmentation fault (core dumped)" probably tells us that a
non-existent memory address was referenced during deallocation.
The functions further up on the steck begin afi* which, I think, are
not Oracle server, but rather client functions:
nm sqlplus | grep afi
[56] | 4197384| 0|FUNC
|GLOB |0 |UNDEF |afidrv
This leads me to conclusion that it's a client side issue. Therefore it
works from another client - you mentioned Windows, but it doesn't have
anything to do with the OS. You can try to connect from another Linux
machine to verify that.
Please apologize the trivial question, but have you checked the
environment variables of the sqlplus process, such as library path, nls
etc and compare them with a working connection?
You can also execute a utilitiy like pldd (available on Solaris) on the
sqlplus process to check whether correct library versions are linked.
Nenad
http://nenadnoveljic.com/blog/
(
https://urldefense.proofpoint.com/v2/url?u=http-3A__nenadnoveljic.com_blog_&d=DwMGaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=aX52EdIcM-g13JIccaUt3dvPc_g2X17qM3viz0cXt9w&m=xE1dmPGZFOPFzTrviY9GT7zWF6IWpfvDFWEADC7eGnQ&s=LY8DdlUr5w7031fBWpjejC34ftluEs_pF9d6NMnu6dI&e=)
From:oracle-l-bounce@xxxxxxxxxxxxx <oracle-l-bounce@xxxxxxxxxxxxx>On
Behalf Of Jeffrey Beckstrom
Sent: Freitag, 22. Februar 2019 14:33
To: oracle-l-freelist <oracle-l@xxxxxxxxxxxxx>
Subject: sqlplus core dump for one database
Cloned a 12.2 non-multitenant database. If log on to sqlplus and
immediately exit, sqlplus does the below. All other databases running
out of the SAME Oracle Home function normally. If connect to this
database from a Windows client, sqlplus operates normally. Problem only
occurs if connect with sqlplus on the Linux server to this ONE
database.
Any ideas?
++++++++++++++++++++++++++++++++++++++++++++++
Error accessing PRODUCT_USER_PROFILE
Warning: Product user profile information not loaded!
You may need to run PUPBLD.SQL as SYSTEM
Last Successful login time: Fri Feb 22 2019 07:52:42 -05:00
Connected to:
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit
Production
SQL> exit
Errors in file :
OCI-21500: internal error code, arguments: [17114], [0x001965860], [],
[], [], [], [], []
----- Call Stack Trace -----
calling call entry
argument values in hex
location type point (?
means dubious value)
-------------------- -------- --------------------
----------------------------
skgudmp()+188 call kgdsdst() 000000000 ? 000000000
?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
kgeriv_int()+199 call skgudmp() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
kgeric1()+142 call kgeriv_int() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
kgherror()+368 call kgeric1() 000000000 ? 000000000
?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
kghfrmrg()+2702 call kgherror() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
kghfre()+837 call kghfrmrg() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
kpuhhfre()+257 call kghfre() 000000000 ? 000000000
?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
kputac()+2453 call kpuhhfre() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
afisesend()+104 call kputac() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
aficntdis()+62 call afisesend() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
afilof()+78 call aficntdis() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
aficex()+340 call afilof()
000000000 ? 000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
afiexi()+1086 call aficex() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
aficmd()+2914 call afiexi() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
aficfd()+3053 call aficmd() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
aficdr()+151 call aficfd()
000000000 ? 000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
afidrv()+5950 call aficdr() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
main()+105 call afidrv() 000000000 ?
000000000 ?
000000000 ? 000000000 ?
000000000 ? 000000000 ?
__libc_start_main() call main() 000000000 ?
000000000 ?
+245
000000000 ? 000000000 ?
000000000 ? 000000000 ?
Call stack signature: 0x1246f539b36d881
call stack performance statistics:
total : 0.010000 sec
setup : 0.000000 sec
stack unwind : 0.000000 sec
symbol translation : 0.000000 sec
printing the call stack: 0.010000 sec
printing frame data : 0.000000 sec
printing argument data : 0.000000 sec
----- End of Call Stack Trace -----
Segmentation fault (core dumped)
[dbsorat08:~:tismask] $
____________________________________________________
Please consider the environment before printing this e-mail.
Bitte denken Sie an die Umwelt, bevor Sie dieses E-Mail drucken.
Important Notice
This message is intended only for the individual named. It may contain
confidential or privileged information. If you are not the named
addressee you should in particular not disseminate, distribute, modify
or copy this e-mail. Please notify the sender immediately by e-mail, if
you have received this message by mistake and delete it from your
system.
Without prejudice to any contractual agreements between you and us
which shall prevail in any case, we take it as your authorization to
correspond with you by e-mail if you send us messages by e-mail.
However, we reserve the right not to execute orders and instructions
transmitted by e-mail at any time and without further explanation.
E-mail transmission may not be secure or error-free as information
could be intercepted, corrupted, lost, destroyed, arrive late or
incomplete. Also processing of incoming e-mails cannot be guaranteed.
All liability of Vontobel Holding Ltd. and any of its affiliates
(hereinafter collectively referred to as "Vontobel Group") for any
damages resulting from e-mail use is excluded. You are advised that
urgent and time sensitive messages should not be sent by e-mail and if
verification is required please request a printed version. Please note
that all e-mail communications to and from the Vontobel Group are
subject to electronic storage and review by Vontobel Group. Unless
stated to the contrary and without prejudice to any contractual
agreements between you and Vontobel Group which shall prevail in any
case, e-mail-communication is for informational purposes only and is not
intended as an offer or solicitation for the purchase or sale of any
financial instrument or as an official confirmation of any transaction.
The legal basis for the processing of your personal data is the
legitimate interest to develop a commercial relationship with you, as
well as your consent to forward you commercial communications. You can
exercise, at any time and under the terms established under current
regulation, your rights. If you prefer not to receive any further
communications, please contact your client relationship manager if you
are a client of Vontobel Group or notify the sender. Please note for an
exact reference to the affected group entity the corporate e-mail
signature. For further information about data privacy at Vontobel Group
please consultwww.vontobel.com
(
https://urldefense.proofpoint.com/v2/url?u=https-3A__www.vontobel.com&d=DwMGaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=aX52EdIcM-g13JIccaUt3dvPc_g2X17qM3viz0cXt9w&m=xE1dmPGZFOPFzTrviY9GT7zWF6IWpfvDFWEADC7eGnQ&s=x6p0vtSzn6aR3Q2N7njt0eOUjYXYJVdBhuXfJiB18LQ&e=)
.
Important Notice
This message is intended only for the individual named. It may contain
confidential or privileged information. If you are not the named
addressee you should in particular not disseminate, distribute, modify
or copy this e-mail. Please notify the sender immediately by e-mail, if
you have received this message by mistake and delete it from your
system.
Without prejudice to any contractual agreements between you and us
which shall prevail in any case, we take it as your authorization to
correspond with you by e-mail if you send us messages by e-mail.
However, we reserve the right not to execute orders and instructions
transmitted by e-mail at any time and without further explanation.
E-mail transmission may not be secure or error-free as information
could be intercepted, corrupted, lost, destroyed, arrive late or
incomplete. Also processing of incoming e-mails cannot be guaranteed.
All liability of Vontobel Holding Ltd. and any of its affiliates
(hereinafter collectively referred to as "Vontobel Group") for any
damages resulting from e-mail use is excluded. You are advised that
urgent and time sensitive messages should not be sent by e-mail and if
verification is required please request a printed version.
Please note that all e-mail communications to and from the Vontobel
Group are subject to electronic storage and review by Vontobel Group.
Unless stated to the contrary and without prejudice to any contractual
agreements between you and Vontobel Group which shall prevail in any
case, e-mail-communication is for informational purposes only and is not
intended as an offer or solicitation for the purchase or sale of any
financial instrument or as an official confirmation of any transaction.
The legal basis for the processing of your personal data is the
legitimate interest to develop a commercial relationship with you, as
well as your consent to forward you commercial communications. You can
exercise, at any time and under the terms established under current
regulation, your rights. If you prefer not to receive any further
communications, please contact your client relationship manager if you
are a client of Vontobel Group or notify the sender. Please note for an
exact reference to the affected group entity the corporate e-mail
signature. For further information about data privacy at Vontobel Group
please consultwww.vontobel.com
(
https://urldefense.proofpoint.com/v2/url?u=https-3A__www.vontobel.com&d=DwMGaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=aX52EdIcM-g13JIccaUt3dvPc_g2X17qM3viz0cXt9w&m=xE1dmPGZFOPFzTrviY9GT7zWF6IWpfvDFWEADC7eGnQ&s=x6p0vtSzn6aR3Q2N7njt0eOUjYXYJVdBhuXfJiB18LQ&e=)
.
This email has been scanned for spam and viruses. Clickhere
(
https://attseg.proofpointessentials.com/index01.php?mod_id=11&mod_option=logitem&mail_id=1550845732-vqoo5mwD6LQD&r_address=jbeckstrom%40gcrta.org&report=1)
to report this email as spam.
Important Notice
This message is intended only for the individual named. It may contain
confidential or privileged information. If you are not the named
addressee you should in particular not disseminate, distribute, modify
or copy this e-mail. Please notify the sender immediately by e-mail, if
you have received this message by mistake and delete it from your
system.
Without prejudice to any contractual agreements between you and us
which shall prevail in any case, we take it as your authorization to
correspond with you by e-mail if you send us messages by e-mail.
However, we reserve the right not to execute orders and instructions
transmitted by e-mail at any time and without further explanation.
E-mail transmission may not be secure or error-free as information
could be intercepted, corrupted, lost, destroyed, arrive late or
incomplete. Also processing of incoming e-mails cannot be guaranteed.
All liability of Vontobel Holding Ltd. and any of its affiliates
(hereinafter collectively referred to as "Vontobel Group") for any
damages resulting from e-mail use is excluded. You are advised that
urgent and time sensitive messages should not be sent by e-mail and if
verification is required please request a printed version.
Please note that all e-mail communications to and from the Vontobel
Group are subject to electronic storage and review by Vontobel Group.
Unless stated to the contrary and without prejudice to any contractual
agreements between you and Vontobel Group which shall prevail in any
case, e-mail-communication is for informational purposes only and is not
intended as an offer or solicitation for the purchase or sale of any
financial instrument or as an official confirmation of any transaction.
The legal basis for the processing of your personal data is the
legitimate interest to develop a commercial relationship with you, as
well as your consent to forward you commercial communications. You can
exercise, at any time and under the terms established under current
regulation, your rights. If you prefer not to receive any further
communications, please contact your client relationship manager if you
are a client of Vontobel Group or notify the sender. Please note for an
exact reference to the affected group entity the corporate e-mail
signature. For further information about data privacy at Vontobel Group
please consultwww.vontobel.com
(
https://urldefense.proofpoint.com/v2/url?u=https-3A__www.vontobel.com&d=DwMGaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=aX52EdIcM-g13JIccaUt3dvPc_g2X17qM3viz0cXt9w&m=u1gHr0NditGj1yuysqRnm71umkA3pZSNwOKCezizdGw&s=lSnhTyS0D8pS0sHTCWe3DU03emVTr5ZbG1uR_t8NoCc&e=)
.
Important Notice
This message is intended only for the individual named. It may contain
confidential or privileged information. If you are not the named
addressee you should in particular not disseminate, distribute, modify
or copy this e-mail. Please notify the sender immediately by e-mail, if
you have received this message by mistake and delete it from your
system.
Without prejudice to any contractual agreements between you and us
which shall prevail in any case, we take it as your authorization to
correspond with you by e-mail if you send us messages by e-mail.
However, we reserve the right not to execute orders and instructions
transmitted by e-mail at any time and without further explanation.
E-mail transmission may not be secure or error-free as information
could be intercepted, corrupted, lost, destroyed, arrive late or
incomplete. Also processing of incoming e-mails cannot be guaranteed.
All liability of Vontobel Holding Ltd. and any of its affiliates
(hereinafter collectively referred to as "Vontobel Group") for any
damages resulting from e-mail use is excluded. You are advised that
urgent and time sensitive messages should not be sent by e-mail and if
verification is required please request a printed version.
Please note that all e-mail communications to and from the Vontobel
Group are subject to electronic storage and review by Vontobel Group.
Unless stated to the contrary and without prejudice to any contractual
agreements between you and Vontobel Group which shall prevail in any
case, e-mail-communication is for informational purposes only and is not
intended as an offer or solicitation for the purchase or sale of any
financial instrument or as an official confirmation of any transaction.
The legal basis for the processing of your personal data is the
legitimate interest to develop a commercial relationship with you, as
well as your consent to forward you commercial communications. You can
exercise, at any time and under the terms established under current
regulation, your rights. If you prefer not to receive any further
communications, please contact your client relationship manager if you
are a client of Vontobel Group or notify the sender. Please note for an
exact reference to the affected group entity the corporate e-mail
signature. For further information about data privacy at Vontobel Group
please consult www.vontobel.com
(
https://urldefense.proofpoint.com/v2/url?u=https-3A__www.vontobel.com&d=DwMGaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=aX52EdIcM-g13JIccaUt3dvPc_g2X17qM3viz0cXt9w&m=u1gHr0NditGj1yuysqRnm71umkA3pZSNwOKCezizdGw&s=lSnhTyS0D8pS0sHTCWe3DU03emVTr5ZbG1uR_t8NoCc&e=)
.
This email has been scanned for spam and viruses. Click here
(
https://attseg.proofpointessentials.com/index01.php?mod_id=11&mod_option=logitem&mail_id=1550855023-bVI_3pf6WpJB&r_address=jbeckstrom%40gcrta.org&report=1)
to report this email as spam.
Other related posts:
