hi,all ### Problem statement or Question: ### A datafile was automatically put into offline, and there was a lot ora-600 thereafter. From trace files, we noted there was some error: KCF: write/open error block=0x1b1d online=1 file=31 /opt/oracle/oradata/ocn/memberrs02.dbf error=27061 txt: 'Linux Error: 12: Cannot allocate memory' before the file was put into offline. After we met this error, we rebooted our oracle instance, and recovered this datafile. It then became ok. We want to know the exact cause to our problem. Is it because we are using aio? If you could help me, I would be very appreciated. ### Errors and Messages: ### ksedmp: internal or fatal error ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ----- Call Stack Trace ----- calling call entry argument values in hex location type point (? means dubious value) -------------------- -------- -------------------- ---------------------------- ksedmp()+269 call ksedst()+0 0 ? 0 ? 0 ? 0 ? 0 ? A4C1590 ? ksfdmp()+14 call ksedmp()+0 3 ? BFFEB1E0 ? 985B69D ? AD5CFA0 ? 3 ? AD510F4 ? kgerinv()+177 call ksfdmp()+0 AD5CFA0 ? 3 ? kgeasnmierr()+35 call kgerinv()+0 AD5CFA0 ? AD9E22C ? A549A20 ? 0 ? BFFEB218 ? kclassertlel()+52 call kgeasnmierr()+0 AD5CFA0 ? AD9E22C ? A549A20 ? /opt/oracle/admin/ocn/bdump/ocn2_dbw0_29343.trc Oracle9i Enterprise Edition Release 9.2.0.4.0 - Production With the Partitioning, Real Application Clusters, OLAP and Oracle Data Mining options JServer Release 9.2.0.4.0 - Production ORACLE_HOME = /opt/oracle/products/9.2.0 System name: Linux Node name: ocn2 Release: 2.4.9-e.37smp Version: #1 SMP Mon Jan 26 11:29:50 EST 2004 Machine: i686 Instance name: ocn2 Redo thread mounted by this instance: 2 Oracle process number: 7 Unix process pid: 29343, image: oracle@ocn2 (DBW0) *** 2004-04-23 17:43:08.828 *** SESSION ID:(8.1) 2004-04-23 17:43:08.814 KCF: write/open error block=0x1b1d online=1 file=31 /opt/oracle/oradata/ocn/memberrs02.dbf error=27061 txt: 'Linux Error: 12: Cannot allocate memory Additional information: -1 Additional information: 8192' Automatic datafile offline due to write error on file 31: /opt/oracle/oradata/ocn/memberrs02.dbf GLOBAL CACHE ELEMENT DUMP (address: 0x0x6efd6d00): id1: 0x7c061fd id2: 0x0 lock: XG rls: 0x025 acq: 0x00 open: 1 flags: 0x1 fair: 3 recovery: 0 latch: 10 bscn: 0.0 bctx: 0x(nil) write: 2 cscn: 0:0 xflg: 0 xid: 0x0000.000.00000000 lcp: 0x(nil) lnk: [NULL] lch: [NULL] LIST OF BUFFERS LINKED TO THIS GLOBAL CACHE LOCK: GCS CLIENT handle 0x0x6efd6d60,565 sq[0x(nil),0x(nil)] resp[0x(nil),0x7c061fd.0] grant 5 cvt 0 mdrole 0x6 st 0x20 GRANTQ rl LOCAL master 0 owner 1 remote[0x0x9184ba5c,561] hist 0xc5f124d7 history 0x17.0x13.0x12.0x3c.0x5.0x3. cflag 0x0 flags 0x0 disk: 0x0000.4b356ba6 write request: 0x0000.4b362a38 pi scn: 0x0000.00000000 msgseq 0x6 updseq 0x0 reqids[582,0,0] infop 0x0 *** 2004-04-23 17:43:08.984 ksedmp: internal or fatal error ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ----- Call Stack Trace ----- ksedmp ksfdmp kgerinv kgeasnmierr kclassertlel kcllrem kclulb kcbivbr kcbibr kcfbsy kcfbof kcfoff kcbbiop kcbbdrv ksbabs ksbrdp opirip opidrv sou2o main libc_start_main No hits on kgerinv kgeasnmierr kclassertlel From alert log: .. Fri Apr 23 17:26:52 2004 ARC1: Completed archiving log 13 thread 2 sequence 9583 Fri Apr 23 17:43:08 2004 KCF: write/open error block=0x1b1d online=1 file=31 /opt/oracle/oradata/ocn/memberrs02.dbf error=27061 txt: 'Linux Error: 12: Cannot allocate memory Additional information: -1 Additional information: 8192' Automatic datafile offline due to write error on file 31: /opt/oracle/oradata/ocn/memberrs02.dbf Fri Apr 23 17:43:08 2004 Errors in file /opt/oracle/admin/ocn/bdump/ocn2_dbw0_29343.trc: ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] Fri Apr 23 17:43:14 2004 Errors in file /opt/oracle/admin/ocn/bdump/ocn2_dbw0_29343.trc: ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] Fri Apr 23 17:43:16 2004 Errors in file /opt/oracle/admin/ocn/bdump/ocn2_dbw0_29343.trc: ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] .. Fri Apr 23 17:52:33 2004 Errors in file /opt/oracle/admin/ocn/bdump/ocn2_dbw0_29343.trc: ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kcllrem_2], [], [], [], [], [], [], [] ORA-00600: internal error Fri Apr 23 17:52:43 2004 Shutting down instance (abort) License high water mark = 476 Instance terminated by USER, pid = 19337 Fri Apr 23 17:52:54 2004 Starting ORACLE instance (normal) Fri Apr 23 17:52:54 2004 Global Enqueue Service Resources = 10946, pool = 4 Fri Apr 23 17:52:54 2004 Global Enqueue Service Enqueues = 16733 LICENSE_MAX_SESSION = 0 LICENSE_SESSIONS_WARNING = 0 GES IPC: Receivers 3 Senders 3 GES IPC: Buffers Receive 1000 Send 1230 Reserve 1000 GES IPC: Msg Size Regular 396 Batch 2048 SCN scheme 2 Using log_archive_dest parameter default value LICENSE_MAX_USERS = 0 SYS auditing is disabled Starting up ORACLE RDBMS Version: 9.2.0.4.0. System parameters with non-default values: processes = 500 timed_statistics = TRUE .. Best regards yahoo id: feng_chunpei A new dba from china ---------------------------------------------------------------- Please see the official ORACLE-L FAQ: http://www.orafaq.com ---------------------------------------------------------------- To unsubscribe send email to: oracle-l-request@xxxxxxxxxxxxx put 'unsubscribe' in the subject line. -- Archives are at //www.freelists.org/archives/oracle-l/ FAQ is at //www.freelists.org/help/fom-serve/cache/1.html -----------------------------------------------------------------