redat 5.8由於檔案系統100%，導致oracle資料庫例項掛起處理例項

環境描述：
 作業系統 redhatlinux 5.8
 資料庫版本 oracle 11.2.0.1 單例項

狀況資訊：
   由於本例項屬於外圍小系統並沒有對其 檔案系統，資料庫例項等狀態進行監控，故導致檔案系統滿了 導致例項掛起；

處理過程：
      1. 經過檢視alter 日誌：如下文標紅部分 檔案系統無空間了，導致redolog 無法進行切換，導致例項掛起；
     2. 由於出問題的時間為晚上10點左右，沒有告警機制，導致到第二天早上過來後，清理檔案系統，啟動資料庫例項後解決問題；
經驗總結：
     增加相關監控項
     增加檔案系統；

alter 告警日誌如下：

VKRM started with pid=133, OS id=12948 
Mon Jul 18 22:00:01 2015
Begin automatic SQL Tuning Advisor run for special tuning task  "SYS_AUTO_SQL_TUNING_TASK"
Mon Jul 18 22:00:03 2015
DM00 started with pid=156, OS id=12966, job WAPAPP.SYS_EXPORT_SCHEMA_09
Mon Jul 18 22:00:04 2015
DW00 started with pid=158, OS id=12970, wid=1, job WAPAPP.SYS_EXPORT_SCHEMA_09
Mon Jul 18 22:00:27 2015
End automatic SQL Tuning Advisor run for special tuning task  "SYS_AUTO_SQL_TUNING_TASK"
Mon Jul 18 22:01:05 2015
Thread 1 cannot allocate new log, sequence 3948
Private strand flush not complete
  Current log# 3 seq# 3947 mem# 0: /u08/app/oracle/oradata/*/redo03.log
Mon Jul 18 22:01:21 2015
Thread 1 advanced to log sequence 3948 (LGWR switch)
  Current log# 4 seq# 3948 mem# 0: /u08/app/oracle/oradata/*/redo04.log
Mon Jul 18 22:02:08 2015
Non critical error ORA-00001 caught while writing to trace file "/u08/app/oracle/diag/rdbms/*/*/trace/*_dw00_12970.trc"
Error message: 
Writing to the above trace file is disabled for now on...
Mon Jul 18 22:02:09 2015
opidcl aborting process unknown ospid (12861) as a result of ORA-9945
Mon Jul 18 22:02:09 2015
opidcl aborting process unknown ospid (12792) as a result of ORA-9945
Mon Jul 18 22:02:09 2015
Non critical error ORA-00001 caught while writing to trace file "/u08/app/oracle/diag/rdbms/*/*/trace/*_dm00_12966.trc"
Error message: 
Writing to the above trace file is disabled for now on...
Mon Jul 18 22:02:10 2015
opidcl aborting process unknown ospid (12604) as a result of ORA-9945
Mon Jul 18 22:02:12 2015
opidcl aborting process unknown ospid (12639) as a result of ORA-9945
Mon Jul 18 22:02:13 2015
opidcl aborting process unknown ospid (12663) as a result of ORA-9945
Mon Jul 18 22:02:13 2015
opidcl aborting process unknown ospid (12691) as a result of ORA-9945
Mon Jul 18 22:02:13 2015
opidcl aborting process unknown ospid (12881) as a result of ORA-9945
Mon Jul 18 22:02:13 2015
Errors in file /u08/app/oracle/diag/rdbms/*/*/trace/*_pmon_11072.trc:
ORA-09817: Write to audit file failed.
Linux-x86_64 Error: 28: No space left on device
Additional information: 12
Errors in file /u08/app/oracle/diag/rdbms/*/*/trace/*_pmon_11072.trc:
ORA-09817: Write to audit file failed.
Linux-x86_64 Error: 28: No space left on device
Additional information: 12
Errors in file /u08/app/oracle/diag/rdbms/*/*/trace/*_pmon_11072.trc:
ORA-09817: Write to audit file failed.
Linux-x86_64 Error: 28: No space left on device
Additional information: 12
Errors in file /u08/app/oracle/diag/rdbms/*/*/trace/*_pmon_11072.trc:
ORA-09817: Write to audit file failed.Tue Jul 19 08:52:38 2015