RE: Oracle AIX problem

  • From: "Deas, Scott" <Scott.Deas@xxxxxxx>
  • To: "mufc01666@xxxxxxxxx" <mufc01666@xxxxxxxxx>, Oracle L <oracle-l@xxxxxxxxxxxxx>
  • Date: Tue, 24 Jun 2014 13:04:10 +0000

Tiran,

Maybe I’m misreading your lsps output, but it doesn’t look like your swap space 
is actually being utilized (unless that output is from a time when the database 
is not running).

Have you reviewed the documentation from Oracle for installing 11.2 on AIX, 
specifically, I’m wondering if your oracle user has access to the memory that’s 
been allocated on the system - 
http://docs.oracle.com/cd/E11882_01/install.112/e48740/pre_install.htm#AXDBI1184.
  We have had issues where the ulimit has not been set correctly, but we did 
not see the exact issue you’re describing.  Here’s a doc from IBM on checking 
the ulimit values: 
http://publib.boulder.ibm.com/tividd/td/ITAME/SC32-1351-00/en_US/HTML/am51_perftune35.htm.

Also, could you verify with nmon that the system is actually swapping, and that 
it’s not just the database that’s perceiving this issue?

Thanks,
Scott

From: oracle-l-bounce@xxxxxxxxxxxxx [mailto:oracle-l-bounce@xxxxxxxxxxxxx] On 
Behalf Of Outsider
Sent: Tuesday, June 24, 2014 6:23 AM
To: Oracle L
Subject: Oracle AIX problem

Hi Oracle - AIX experts,

I am in very difficult situation. We have AIX 7.1 TL3SP1 server in PureFlex 
hardware. On this AIX we have Oracle DB 11.2.0.4.0. DB works as expected after 
startup and suddenly it goes crazy. No one can connect to this DB from 
application and there is a lot of error in alert log and also in AIX. So this 
is heavy swapping problem which I had previously in Oracle Linux , in that case 
we added memory and swap[ file also we had problem with low disks (actually the 
problem was problematic disks). Here we have 8G memory and 16G page space and 
disks also OK. The only thing in which I am not sure the configuration of page 
spaces. But I am not AIX specialist....

Please who have same experience with this , please advise how can we solve this.

root@sgp-podb201a/ # lsps -a
Page Space      Physical Volume   Volume Group    Size %Used Active Auto  Type 
Chksum
paging01        hdisk6                        vg01                8192MB     1  
 yes   yes    lv     0
paging00        hdisk1                       vg01                8192MB      4  
 yes   yes    lv     0
hd6                 hdisk0                       rootvg             512MB       
 0    no    no    lv       0

Info
 MEMORY
 Real,MB    8192
 % Comp     64
 % Noncomp  16
 % Client   16

 PAGING SPACE
 Size,MB   16384
 % Used      2
 % Free     98

PAGING
Faults       25
Steals        0
PgspIn        0
PgspOut       0
PageIn        0
PageOut      15
Sios         15

Alert log

Tue Jun 24 08:20:32 2014
WARNING: Heavy swapping observed on system in last 5 mins.
pct of memory swapped in [359.98%] pct of memory swapped out [0.87%].
Please make sure there is no memory pressure and the SGA and PGA
are configured correctly. Look at DBRM trace file for more details.
Tue Jun 24 08:37:52 2014
Emon ping encountered error 4021
Errors in file 
/opt/oracle/diag/rdbms/shpsgpp1dg1/SHPSGPP1/trace/SHPSGPP1_q000_20185316.trc:
ORA-04021: timeout occurred while waiting to lock object
Tue Jun 24 09:00:53 2014
Emon ping encountered error 4021
*******
ORA-04021: timeout occurred while waiting to lock object
Tue Jun 24 12:35:16 2014
Emon timeout encountered error 4021
Tue Jun 24 12:35:16 2014
Emon timeout encountered error 4021
**********

Oracle trace file

*** 2014-06-24 13:13:31.648
*** SESSION ID:(478.11) 2014-06-24 13:13:31.648
*** CLIENT ID:() 2014-06-24 13:13:31.648
*** SERVICE NAME:(SYS$BACKGROUND) 2014-06-24 13:13:31.648
*** MODULE NAME:(Streams) 2014-06-24 13:13:31.648
*** ACTION NAME:(QMON Slave) 2014-06-24 13:13:31.648

KSV 4021 error in slave process

*** 2014-06-24 13:13:31.648
ORA-04021: timeout occurred while waiting to lock object
OPIRIP: Uncaught error 447. Error stack:
ORA-00447: fatal error in background process
ORA-04021: timeout occurred while waiting to lock object


Thanks in advance.


-----------------
Tiran
Best Regards
Stay in touch...
Notice of Confidentiality: **This E-mail and any of its attachments may contain
Lincoln National Corporation proprietary information, which is privileged, 
confidential,
or subject to copyright belonging to the Lincoln National Corporation family of
companies. This E-mail is intended solely for the use of the individual or 
entity to
which it is addressed. If you are not the intended recipient of this E-mail, 
you are
hereby notified that any dissemination, distribution, copying, or action taken 
in
relation to the contents of and attachments to this E-mail is strictly 
prohibited
and may be unlawful. If you have received this E-mail in error, please notify 
the
sender immediately and permanently delete the original and any copy of this 
E-mail
and any printout. Thank You.**

Other related posts: