ORA-00600: [kebm_mmon_main_1], ORA-07445 [kgghtNumElements()+4]

Oracle 11.2.0.1.0  ， Linux AS 5.3  64 bit .    RAC ,   ASM  ,   2 節點


昨天開始，一直報錯，  在metalink 貌似還查詢不到 。 DBA做了一個動作， 將redo log group中的另一個memeber檔案
轉移了其他磁碟組 ， standby 使用lgwr同步， 後來也正常了 。 但是就一直報錯 。





Thu Jun 09 11:55:36 2011
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_lgwr_15519.trc:
ORA-16166: LGWR network server failed to send remote message
         No action is required since the log file transfer will be attempted via ARCH
LGWR: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (16166)
LGWR: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_lgwr_15519.trc:
ORA-16166: LGWR network server failed to send remote message
Error 16166 for archive log file 13 to 'ccptdbdg'
LGWR: Error 16164 disconnecting from destination LOG_ARCHIVE_DEST_2 standby host 'ccptdbdg'
Thu Jun 09 11:55:42 2011
Restarting dead background process LMHB
Thu Jun 09 11:55:42 2011
LMHB started with pid=18, OS id=17475
Thu Jun 09 11:55:55 2011
opidrv aborting process Q004 ospid (11645) as a result of ORA-28
Thu Jun 09 11:56:56 2011
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_mmon_15531.trc  (incident=256273):
ORA-00600: internal error code, arguments: [kebm_mmon_main_1], [28], [], [], [], [], [], [], [], [], [], []
ORA-00028: your session has been killed
Incident details in: /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/incident/incdir_256273/ccptdb1_mmon_15531_i256273.trc
Thu Jun 09 11:56:59 2011
Trace dumping is performing id=[cdmp_20110609115659]
Thu Jun 09 11:57:04 2011
Restarting dead background process MMON
Thu Jun 09 11:57:04 2011
MMON started with pid=34, OS id=17685
Restarting dead background process MMNL
Thu Jun 09 11:57:05 2011
MMNL started with pid=35, OS id=17687
Restarting dead background process MARK
Thu Jun 09 11:57:07 2011
MARK started with pid=38, OS id=17690
NOTE: MARK has subscribed
Thu Jun 09 11:57:07 2011
Sweep [inc][256273]: completed
Sweep [inc2][256273]: completed
Restarting dead background process RSMN
Thu Jun 09 11:57:10 2011
RSMN started with pid=40, OS id=17704
Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2, kgghtNumElements()+4] [flags: 0x0, count: 1]
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_rsmn_17704.trc  (incident=256321):
ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
Incident details in: /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/incident/incdir_256321/ccptdb1_rsmn_17704_i256321.trc
Thu Jun 09 11:57:15 2011
Trace dumping is performing id=[cdmp_20110609115715]
Thu Jun 09 11:57:16 2011
Restarting dead background process CJQ0
Thu Jun 09 11:57:16 2011
CJQ0 started with pid=40, OS id=17723
Thu Jun 09 11:58:08 2011

。。。。。。。


Fri Jun 10 15:13:59 2011
Restarting dead background process RSMN
Fri Jun 10 15:13:59 2011
RSMN started with pid=106, OS id=26173
Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2, kgghtNumElements()+4] [flags: 0x0, count: 1]
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_rsmn_26173.trc  (incident=256851):
ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
Fri Jun 10 15:14:05 2011
Sweep [inc][256851]: completed
Fri Jun 10 15:18:27 2011
Restarting dead background process RSMN
Fri Jun 10 15:18:27 2011
RSMN started with pid=105, OS id=26928
Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2, kgghtNumElements()+4] [flags: 0x0, count: 1]
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_rsmn_26928.trc  (incident=256841):
ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
Fri Jun 10 15:18:33 2011
Sweep [inc][256841]: completed
Fri Jun 10 15:23:15 2011
Restarting dead background process RSMN
Fri Jun 10 15:23:15 2011
RSMN started with pid=105, OS id=27731
Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2, kgghtNumElements()+4] [flags: 0x0, count: 1]
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_rsmn_27731.trc  (incident=256842):
ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
Fri Jun 10 15:23:20 2011
Sweep [inc][256842]: completed
Fri Jun 10 15:24:17 2011
LGWR: Standby redo logfile selected for thread 1 sequence 5956 for destination LOG_ARCHIVE_DEST_2
Thread 1 advanced to log sequence 5956 (LGWR switch)
  Current log# 13 seq# 5956 mem# 0: +DATA/ccptdb/onlinelog/redo13a.log
  Current log# 13 seq# 5956 mem# 1: +INDX/ccptdb/onlinelog/redo13b.log
Fri Jun 10 15:24:18 2011
Archived Log entry 15334 added for thread 1 sequence 5955 ID 0xbdc4bf83 dest 1:
Fri Jun 10 15:27:33 2011
Restarting dead background process RSMN
Fri Jun 10 15:27:33 2011
RSMN started with pid=108, OS id=28376
Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2, kgghtNumElements()+4] [flags: 0x0, count: 1]
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_rsmn_28376.trc  (incident=256865):
ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
Fri Jun 10 15:27:40 2011
Sweep [inc][256865]: completed