AIX6.1系統11203RAC節點down機
alert裡大量的
Wed Jan 08 16:42:14 2014
IPC Send timeout detected. Sender: ospid 23396530 [oracle@ptms3db1]
Receiver: inst 2 binc 315765730 ospid 29556890
然後ASM裡日誌
Wed Jan 08 16:42:49 2014
IPC Send timeout detected. Sender: ospid 10158142 [oracle@ptms3db1 (LMON)]
Receiver: inst 2 binc 116716205 ospid 9502824
Communications reconfiguration: instance_number 2
Wed Jan 08 16:43:46 2014
IPC Send timeout detected. Sender: ospid 9175278 [oracle@ptms3db1 (LMS0)]
Receiver: inst 2 binc 116716132 ospid 9895996
IPC Send timeout to 2.1 inc 4 for msg type 34 from opid 11
。。
Wed Jan 08 16:48:23 2014
LMON (ospid: 10158142) waits for event 'CSS operation: data update' for 216 secs.
Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_lmhb_6946928.trc (incident=35298):
ORA-29770: global enqueue process LMON (OSID 10158142) is hung for more than 150 seconds
Incident details in: /u01/app/grid/diag/asm/+asm/+ASM1/incident/incdir_35298/+ASM1_lmhb_6946928_i35298.trc
CRS下節點的告警
2014-01-08 16:44:11.893
[cssd(8454194)]CRS-1663:Member kill issued by PID 28967080 for 1 members, group DBOLTP_RAC. Details at (:CSSGM00044:) in /u01/app/11.2.0/grid/log/ptms3db1/cssd/ocssd.log.
2014-01-08 16:44:42.413
[cssd(8454194)]CRS-1607:Node ptms3db2 is being evicted in cluster incarnation 280992666; details at (:CSSNM00007:) in /u01/app/11.2.0/grid/log/ptms3db1/cssd/ocssd.log.
2014-01-08 16:49:29.676
[/u01/app/11.2.0/grid/bin/oraagent.bin(7143460)]CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/11.2.0/grid/log/ptms3db1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-01-08 16:49:30.987
[/u01/app/11.2.0/grid/bin/oraagent.bin(15728690)]CRS-5011:Check of resource "OLTP_RAC" failed: details at "(:CLSN00007:)" in "/u01/app/11.2.0/grid/log/ptms3db1/agent/crsd/oraagent_oracle/oraagent_oracle.log"
2014-01-08 16:49:59.592
[/u01/app/11.2.0/grid/bin/oraagent.bin(7143460)]CRS-5818:Aborted command 'check' for resource 'ora.asm'. Details at (:CRSAGF00113:) {0:0:810} in /u01/app/11.2.0/grid/log/ptms3db1/agent/ohasd/oraagent_grid/oraagent_grid.log.
已經幾天了,Oracle support還在查詢原因,也轉到了bug team
Wed Jan 08 16:42:14 2014
IPC Send timeout detected. Sender: ospid 23396530 [oracle@ptms3db1]
Receiver: inst 2 binc 315765730 ospid 29556890
然後ASM裡日誌
Wed Jan 08 16:42:49 2014
IPC Send timeout detected. Sender: ospid 10158142 [oracle@ptms3db1 (LMON)]
Receiver: inst 2 binc 116716205 ospid 9502824
Communications reconfiguration: instance_number 2
Wed Jan 08 16:43:46 2014
IPC Send timeout detected. Sender: ospid 9175278 [oracle@ptms3db1 (LMS0)]
Receiver: inst 2 binc 116716132 ospid 9895996
IPC Send timeout to 2.1 inc 4 for msg type 34 from opid 11
。。
Wed Jan 08 16:48:23 2014
LMON (ospid: 10158142) waits for event 'CSS operation: data update' for 216 secs.
Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_lmhb_6946928.trc (incident=35298):
ORA-29770: global enqueue process LMON (OSID 10158142) is hung for more than 150 seconds
Incident details in: /u01/app/grid/diag/asm/+asm/+ASM1/incident/incdir_35298/+ASM1_lmhb_6946928_i35298.trc
CRS下節點的告警
2014-01-08 16:44:11.893
[cssd(8454194)]CRS-1663:Member kill issued by PID 28967080 for 1 members, group DBOLTP_RAC. Details at (:CSSGM00044:) in /u01/app/11.2.0/grid/log/ptms3db1/cssd/ocssd.log.
2014-01-08 16:44:42.413
[cssd(8454194)]CRS-1607:Node ptms3db2 is being evicted in cluster incarnation 280992666; details at (:CSSNM00007:) in /u01/app/11.2.0/grid/log/ptms3db1/cssd/ocssd.log.
2014-01-08 16:49:29.676
[/u01/app/11.2.0/grid/bin/oraagent.bin(7143460)]CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/u01/app/11.2.0/grid/log/ptms3db1/agent/ohasd/oraagent_grid/oraagent_grid.log"
2014-01-08 16:49:30.987
[/u01/app/11.2.0/grid/bin/oraagent.bin(15728690)]CRS-5011:Check of resource "OLTP_RAC" failed: details at "(:CLSN00007:)" in "/u01/app/11.2.0/grid/log/ptms3db1/agent/crsd/oraagent_oracle/oraagent_oracle.log"
2014-01-08 16:49:59.592
[/u01/app/11.2.0/grid/bin/oraagent.bin(7143460)]CRS-5818:Aborted command 'check' for resource 'ora.asm'. Details at (:CRSAGF00113:) {0:0:810} in /u01/app/11.2.0/grid/log/ptms3db1/agent/ohasd/oraagent_grid/oraagent_grid.log.
已經幾天了,Oracle support還在查詢原因,也轉到了bug team
來自 “ ITPUB部落格 ” ,連結:http://blog.itpub.net/628922/viewspace-1069444/,如需轉載,請註明出處,否則將追究法律責任。
相關文章
- oracle 11gR2 rac 兩節點有一個節點down掉問題處理Oracle
- 記:僅配置單vip連線串,當vip對應的節點down機情況下程式無法連線上正常節點的故障
- AIX6.1 oracle10.2.0.5 單機檔案系統,實現開機自動啟動AIOracle
- Oracle9.2.0.4 RAC系統加入新節點Oracle
- ADAMoracle部署全球節點網路率先推出廣域節點報價系統Oracle
- DataNode工作機制 & 新增節點 &下線節點
- 淺議ERP系統的會計控制節點
- RAC系統當中,job在哪個節點執行?
- 父子節點資料統計
- ADAMoracle預言機節點需衡量節點伺服器安全性Oracle伺服器
- PAXG節點挖礦(智慧合約)系統開發專案
- 烏托邦節點系統開發邏輯詳情模式模式
- 商機管理系統擁有哪些特點
- iOS 調節系統音量iOS
- k8s克隆節點引起的系統崩潰問題K8S
- 容器編排系統K8s之節點汙點和pod容忍度K8S
- DRM特性引起的RAC節點當機
- iOS模仿系統相機拍照你不曾注意過的細節iOS
- JavaScript學習之DOM(節點、節點層級、節點操作)JavaScript
- Android 系統 overlay 機制重點小結Android
- 關於kangle虛擬主機系統與N點虛擬主機系統的比較
- Postgrsql 從節點當機,主節點執行DML語句出現等待情況SQL
- 抽獎系統細節玩法
- 第十三節 - 粒子系統
- 烏托邦UTO節點挖礦系統開發搭建(原始碼交付)原始碼
- 烏托邦UTO節點挖礦系統開發搭建(成熟技術)
- put it down?
- AIX6.1安裝ORACLE 11g(單機使用ASM)AIOracleASM
- 【freertos】007-系統節拍和系統延時管理實現細節
- RAC 雙節點 轉單節點流程
- 計算機面試重難點 之 作業系統計算機面試作業系統
- 機械行業使用WMS系統有哪些特點行業
- 機會管理在CRM系統中的難點解析
- Ext實現點選節點,父子節點反選
- 【RAC】作業系統重灌後RAC11g節點重置注意事項作業系統
- 線上直播系統原始碼,取CTreeCtrl控制元件選中節點的文字原始碼控制元件
- 使用tar安裝RAC系統中的節點問題 - tar ORACLE_HOMEOracle
- ElasticSearch 7.6.2 單機部署三個節點 報錯Elasticsearch