OGG OCI Error ORA-01089: immediate shutdown in progress

snowdba發表於2015-03-10
Error

OGG複製端的複製程式ABEND，ogg日誌部分內容如下，沒看出什麼思路。第一直覺是資料被重啟了？

2015-03-09 14:38:18 WARNING OGG-00869 Oracle GoldenGate Delivery for Oracle, repsym.prm: OCI Error ORA-01089: immediate shutdown in progress - no operations are permitted (status = 1089). UPDATE "DBP"."RB_ACCT" SET "OWNERSHIP_TYPE" = :a1,"INT_STMT" = :a2,"STMT_PBK" = :a3,"CLIENT_IND" = :a4,"WS_ID" = :a5,"USER_ID" = :a6,"OFFICER_ID" = :a7,"LAST_CHANGE_DATE" = :a8,"CB_CODE" = :a9,"DORMANT_DATE" = :a10,"ALT_ACCT_NAME" = :a11,"ACCT_NAME" = :a12,"BAL_TYPE" = :a13,"ACCT_NAME_REMARK" = :a14,"DEPARTMENT" = :a15,"REMARKS1" = :a16 WHERE "INTERNAL_KEY" = :b0.
2015-03-09 14:38:18 WARNING OGG-01004 Oracle GoldenGate Delivery for Oracle, repsym.prm: Aborted grouped transaction on 'DBP.RB_ACCT', Database error 1089 (OCI Error ORA-01089: immediate shutdown in progress - no operations are permitted (status = 1089). UPDATE "DBP"."RB_ACCT" SET "OWNERSHIP_TYPE" = :a1,"INT_STMT" = :a2,"STMT_PBK" = :a3,"CLIENT_IND" = :a4,"WS_ID" = :a5,"USER_ID" = :a6,"OFFICER_ID" = :a7,"LAST_CHANGE_DATE" = :a8,"CB_CODE" = :a9,"DORMANT_DATE" = :a10,"ALT_ACCT_NAME" = :a11,"ACCT_NAME" = :a12,"BAL_TYPE" = :a13,"ACCT_NAME_REMARK" = :a14,"DEPARTMENT" = :a15,"REMARKS1" = :a16 WHERE "INTERNAL_KEY" = :b0).
2015-03-09 14:38:18 WARNING OGG-01003 Oracle GoldenGate Delivery for Oracle, repsym.prm: Repositioning to rba 134538 in seqno 5.
2015-03-09 14:38:18 INFO OGG-01021 Oracle GoldenGate Delivery for Oracle, repsym.prm: Command received from GGSCI: GETLAG.
2015-03-09 14:38:18 WARNING OGG-01154 Oracle GoldenGate Delivery for Oracle, repsym.prm: SQL error 3114 mapping SYMBOLS.RB_ACCT to DBP.RB_ACCT OCI Error ORA-03114: not connected to ORACLE (status = 3114). UPDATE "DBP"."RB_ACCT" SET "OWNERSHIP_TYPE" = :a1,"INT_STMT" = :a2,"STMT_PBK" = :a3,"CLIENT_IND" = :a4,"WS_ID" = :a5,"USER_ID" = :a6,"OFFICER_ID" = :a7,"LAST_CHANGE_DATE" = :a8,"CB_CODE" = :a9,"DORMANT_DATE" = :a10,"ALT_ACCT_NAME" = :a11,"ACCT_NAME" = :a12,"BAL_TYPE" = :a13,"ACCT_NAME_REMARK" = :a14,"DEPARTMENT" = :a15,"REMARKS1" = :a16 WHERE "INTERNAL_KEY" = :b0.
2015-03-09 14:38:18 WARNING OGG-01003 Oracle GoldenGate Delivery for Oracle, repsym.prm: Repositioning to rba 134538 in seqno 5.
2015-03-09 14:38:18 ERROR OGG-01296 Oracle GoldenGate Delivery for Oracle, repsym.prm: Error mapping from SYMBOLS.RB_ACCT to DBP.RB_ACCT.
2015-03-09 14:38:18 ERROR OGG-01668 Oracle GoldenGate Delivery for Oracle, repsym.prm: PROCESS ABENDING.
2015-03-10 08:14:43 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (ora102): info all.

開始檢視oracle警告日誌，希望找到shutdown的痕跡。沒有發現資料庫被重啟的動作，卻發現了歸檔日誌出問題了
/u01/home/ora102/product/admin/data/bdump

ARCH: Archival stopped, error occurred. Will continue retrying
Tue Mar 10 08:37:04 2015
ORACLE Instance data - Archival Error

資料庫的歸檔路徑如下
log_archive_dest_1 string LOCATION=/u01/orcl/arch/data
log_archive_dest_2 string LOCATION=/u02/orcl/arch/data

檢視一下磁碟空間，果然存放歸檔的兩個磁碟路徑已經100%了！，趕緊刪除過期的歸檔日誌，重啟啟動複製端的複製程式問題解決！
[ora102@cdbsym3]%[/u01/orcl/arch/data]df
Filesystem 512-blocks Free %Used Iused %Iused Mounted on
/dev/hd4 16777216 15419960 9% 6224 1% /
/dev/hd2 33554432 19937000 41% 48549 3% /usr
/dev/hd9var 20971520 17623080 16% 6070 1% /var
/dev/hd3 16777216 13272928 21% 3312 1% /tmp
/dev/hd1 16777216 983712 95% 2529 3% /home
/proc - - - - - /proc
/dev/hd10opt 16777216 14180288 16% 27909 2% /opt
/dev/datalv1 4131389440 56016 100% 262836 90% /u01
/dev/datalv2 1237319680 61728 100% 29082 78% /u02


總結：這是一個測試資料庫中執行的OGG，沒有人運維。歸檔日誌空間滿了都沒有發現，所以導致OGG複製程式中斷。及時清理歸檔日誌空間，重啟程式就可以了。 如果是ASM方式儲存歸檔的話，會在OGG的錯誤日誌中提示歸檔路徑滿了，但是在檔案系統上卻不會提示。




來自 “ ITPUB部落格 ” ，連結：http://blog.itpub.net/29047826/viewspace-1454316/，如需轉載，請註明出處，否則將追究法律責任。

相關文章