GoldenGate投遞程式OGG-01416+OGG-01061錯誤處理一例
2015.5.14 記錄
最先發現的是投遞程式abend，
2015-05-14 07:56:06 ERROR OGG-01416 Oracle GoldenGate Capture for Oracle, dpecj01.prm: File ./dirdat/cj/ca073866, with format RELEASE 9.0/9.5, does not match current formatspecification of RELEASE 11.2. Modify the parameter file to specify format RELEASE 9.0/9.5 or issue ETROLLOVER prior to restart.
2015-05-14 07:56:06 ERROR OGG-01668 Oracle GoldenGate Capture for Oracle, dpecj01.prm: PROCESS ABENDING.
透過日誌發現運維人員使用了etrollover命令，但隨後啟動時還報同樣的錯誤。
2015-05-14 09:34:12 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter extract DPECJ01 etrollover.
2015-05-14 09:34:12 INFO OGG-01520 Oracle GoldenGate Command Interpreter for Oracle: Rollover performed. For each affected output trail of Version 10 or higher format, af
ter starting the source extract, issue ALTER EXTSEQNO for that trail's reader (either pump EXTRACT or REPLICAT) to move the reader's scan to the new trail file; it will not hap
pen automatically.
此時工程師登入遠端主機，發現災備端磁碟空間滿了，清理完畢之後，啟動投遞程式，還是報同樣的錯誤。
接下來運維工程師作出了一件非常可怕的事情，他修改了投遞的起點(在修改之前投遞程式的起點是seqno 72712 rba 0)，不過問題似乎還沒有解決，因為還是報相同的錯誤。
2015-05-14 09:35:57 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter extract DPECJ01 extseqno 72713 extrba 0.
2015-05-14 09:36:08 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start DPECJ01.
2015-05-14 09:36:14 INFO OGG-01478 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Output file ./dirdat/cj/ca is using format RELEASE 11.2.
2015-05-14 09:36:14 WARNING OGG-01438 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Checkpoint marked as from graceful shutdown, but records found after checkpoint in tr
ail ./dirdat/cj/ca. Expected EOF Seqno 73861, RBA 0. Found Seqno 73865, RBA 196418620.
2015-05-14 09:36:14 INFO OGG-01026 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Rolling over remote file ./dirdat/cj/ca073866.
2015-05-14 09:36:14 ERROR OGG-01416 Oracle GoldenGate Capture for Oracle, dpecj01.prm: File ./dirdat/cj/ca073866, with format RELEASE 9.0/9.5, does not match current format
specification of RELEASE 11.2. Modify the parameter file to specify format RELEASE 9.0/9.5 or issue ETROLLOVER prior to restart.
2015-05-14 09:36:14 ERROR OGG-01668 Oracle GoldenGate Capture for Oracle, dpecj01.prm: PROCESS ABENDING.
不知道處於什麼原因，工程師一直在嘗試著修改
2015-05-14 09:38:06 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter replicat DPECJ01 extseqno 73866 extrba 0.
2015-05-14 09:38:29 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter extract DPECJ01 extseqno 72714 extrba 0.
2015-05-14 09:38:36 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter replicat DPECJ01 extseqno 73867 extrba 0.
2015-05-14 09:38:38 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start DPECJ01.
2015-05-14 09:38:38 INFO OGG-00963 Oracle GoldenGate Manager for Oracle, mgr.prm: Command received from GGSCI on host ecmlndb1:63798 (START EXTRACT DPECJ01 ).
2015-05-14 09:38:38 INFO OGG-00975 Oracle GoldenGate Manager for Oracle, mgr.prm: EXTRACT DPECJ01 starting.
2015-05-14 09:38:38 INFO OGG-00992 Oracle GoldenGate Capture for Oracle, dpecj01.prm: EXTRACT DPECJ01 starting.
不好，本地的trail檔案72712和72713被mgr刪除了。
2015-05-14 09:43:03 INFO OGG-00957 Oracle GoldenGate Manager for Oracle, mgr.prm: Purged old extract file /oragolden/ogg/dirdat/cj072712, applying UseCheckPoints purge rul
e: Oldest Chkpt Seqno 72714 > 72712.
2015-05-14 09:43:03 INFO OGG-00957 Oracle GoldenGate Manager for Oracle, mgr.prm: Purged old extract file /oragolden/ogg/dirdat/cj072713, applying UseCheckPoints purge rul
e: Oldest Chkpt Seqno 72714 > 72713.
可能是運維工程師還沒意示到問題的嚴重性，他還在繼續接著改投遞的起點
2015-05-14 09:44:37 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter extract DPECJ01 extseqno 72715 extrba 0.
2015-05-14 09:44:47 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start DPECJ01.
後來廠商請求我們技術支援，經過我的提醒，他將災備端的./dirdat/cj/ca073866檔案進行了備份，目的是讓投遞程式重新生成一個trail檔案，結果發生了變化，這個OGG-01416錯誤消失了，但接下來又出現了新的錯誤OGG-01061。
2015-05-14 10:20:27 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start DPECJ01.
2015-05-14 10:20:27 INFO OGG-00963 Oracle GoldenGate Manager for Oracle, mgr.prm: Command received from GGSCI on host ecmlndb1:65244 (START EXTRACT DPECJ01 ).
2015-05-14 10:20:27 INFO OGG-00975 Oracle GoldenGate Manager for Oracle, mgr.prm: EXTRACT DPECJ01 starting.
2015-05-14 10:20:27 INFO OGG-00992 Oracle GoldenGate Capture for Oracle, dpecj01.prm: EXTRACT DPECJ01 starting.
...
2015-05-14 10:20:28 INFO OGG-00993 Oracle GoldenGate Capture for Oracle, dpecj01.prm: EXTRACT DPECJ01 started.
2015-05-14 10:20:33 INFO OGG-01226 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Socket buffer size set to 27985 (flush size 27985).
2015-05-14 10:20:35 INFO OGG-01056 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Recovery initialization completed for target file ./dirdat/cj/ca073865, at RBA 196418
620, CSN 13869616746495.
2015-05-14 10:20:35 INFO OGG-01478 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Output file ./dirdat/cj/ca is using format RELEASE 11.2.
2015-05-14 10:20:35 INFO OGG-01026 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Rolling over remote file ./dirdat/cj/ca073866.
2015-05-14 10:20:35 ERROR OGG-01061 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Invalid CSN value length(0) from data source during recovery.
2015-05-14 10:20:35 ERROR OGG-01668 Oracle GoldenGate Capture for Oracle, dpecj01.prm: PROCESS ABENDING.
出現這個錯誤的原因，我們暫時還不知道，但運維人員可能覺得需要把投遞程式的起點改回原來的設定比較好一點，但他不知道其實72710和72712 72713這3個trail檔案早已被刪掉，改回來還有什麼用?
2015-05-14 10:23:48 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter replicat DPECJ01 extseqno 72710 extrba 0.
2015-05-14 10:24:16 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start DPECJ01.
在沒有弄清楚這個的錯誤ogg-01061產生的原因之前，運維人員還在調整著投遞程式的起點，直到72717號trail檔案，結果72711-72716號trail檔案就這樣被無情的刪掉了。唉！
回過頭再來分析01061產生的原因，上網查了一下，只發現一篇檔案，metalink上啥也查不到，鬱悶。首先還是看一下report報告,透過報告顯示可以判斷出如下內容：
1.投遞程式是在投遞cj072717號檔案rba為1276時產生錯誤。
2.投遞程式的rba為1276的事務是在處理 "EDAS"."E_MP_POWER_CURVE"表
知道了以上兩點，那麼是不是我把這張表排除了再啟動投遞程式就應該沒問題了呢？或者我把當前的事務跳過去，讓投遞程式從下一個事務開始投。
EXTRACT dpecj01
RMTHOST 10.160.86.1, MGRPORT 8239, COMPRESS
PASSTHRU
numfiles 1000
RMTTRAIL ./dirdat/cj/ca
table EDAS.*;
table ECMS.*;
TABLE EDAST.*;
2015-05-14 15:33:12 INFO OGG-01815 Virtual Memory Facilities for: COM
anon alloc: mmap(MAP_ANON) anon free: munmap
file alloc: mmap(MAP_SHARED) file free: munmap
target directories:
/oragolden/ogg/dirtmp.
CACHEMGR virtual memory values (may have been adjusted)
CACHESIZE: 64G
CACHEPAGEOUTSIZE (normal): 8M
PROCESS VM AVAIL FROM OS (min): 128G
CACHESIZEMAX (strict force to disk): 96G
2015-05-14 15:33:17 INFO OGG-01226 Socket buffer size set to 27985 (flush size 27985).
2015-05-14 15:33:17 INFO OGG-01056 Recovery initialization completed for target file ./dirdat/cj/ca073910, at RBA 2863, CSN 13869616746495.
2015-05-14 15:33:17 INFO OGG-01478 Output file ./dirdat/cj/ca is using format RELEASE 11.2.
2015-05-14 15:33:18 INFO OGG-01026 Rolling over remote file ./dirdat/cj/ca073911.
***********************************************************************
** Run Time Messages **
***********************************************************************
Opened trail file ./dirdat/cj072717 at 2015-05-14 15:33:18
Wildcard TABLE resolved (entry EDAS.*):
table "EDAS"."E_MP_POWER_CURVE";
PASSTHRU mapping resolved for source table EDAS.E_MP_POWER_CURVE
Source Context :
SourceModule : [er.recovery]
SourceID : [/scratch/aime1/adestore/views/aime1_staoi05/oggcore/OpenSys/src/app/er/recovery.c]
SourceFunction : [RECOVERY_shouldWriteTran]
SourceLine : [633]
2015-05-14 15:33:18 ERROR OGG-01061 Invalid CSN value length(0) from data source during recovery.
***********************************************************************
* ** Run Time Statistics ** *
***********************************************************************
Report at 2015-05-14 15:33:18 (activity since 2015-05-14 15:33:18)
Output to ./dirdat/cj/ca:
No records extracted.
Last log location read:
FILE: ./dirdat/cj072717
SEQNO: 72717
RBA: 1276
TIMESTAMP: 2015-05-11 19:11:22.000000
EOF: NO
READERR: 0
2015-05-14 15:33:18 ERROR OGG-01668 PROCESS ABENDING.
CACHE OBJECT MANAGER statistics
CACHE MANAGER VM USAGE
vm current = 0 vm anon queues = 0
vm anon in use = 0 vm file = 0
vm used max = 0 ==> CACHE BALANCED
CACHE CONFIGURATION
cache size = 64G cache force paging = 96G
buffer min = 64K buffer highwater = 8M
pageout eligible size = 8M
透過logdump我終於有所發現.ogg-01061錯誤產生的原因很可能是由於當前的72717號檔案中所有的記錄都是處在一個事務的中間，而投遞程式沒辦法找到事務的開頭和結尾，當然也不可能從事務的中間就開始投遞啊()
logdump中的TransInd值定義了當前記錄的事務的狀態 (0x00代表是事務的開始,0x01代表是事務的中間,0x02代表是事務的結束,0x03代表單記錄事務),
透過觀察發現72717、72718、72719、72720號trail檔案，結果發現這個trail檔案中的記錄都是一個事務，所有記錄的TransInd值全為(0x01)，
這就是投遞程式啟不來的真正原因，要想讓投遞程式能夠正常執行，必須將其指定為72720號trail檔案的一個新事務開始的位置才行，總結一下命令：
alter extract DPECJ01 extseqno 72720 extrba 0;
alter extract DPECJ01 extseqno 72720 extrba 3584332;
$ pwd
/oragolden/ogg
$ logdump
Oracle GoldenGate Log File Dump Utility for Oracle
Version 11.2.1.0.3 14400833 OGGCORE_11.2.1.0.3_PLATFORMS_120823.1258
Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.
Logdump 712 >open ./dirdat/cj072717
Current LogTrail is /oragolden/ogg/dirdat/cj072717
Logdump 713 >ghdr on
Logdump 714 >detail on
Logdump 715 >usertoken on
Logdump 716 >ggstoken detail
Logdump 717 >n
2015/05/11 19:19:42.261.998 FileHeader Len 1268 RBA 0
Name: *FileHeader*
3000 0199 3000 0008 4747 0d0a 544c 0a0d 3100 0002 | 0...0...GG..TL..1...
0003 3200 0004 2000 0000 3300 0008 02f2 3c00 02aa | ..2... ...3.....<...>
feee 3400 001d 001b 7572 693a 6563 6d6c 6e64 6231 | ..4.....uri:ecmlndb1
3a3a 6f72 6167 6f6c 6465 6e3a 6f67 6736 0000 1300 | ::oragolden:ogg6....
112e 2f64 6972 6461 742f 636a 3037 3237 3137 3700 | ../dirdat/cj0727177.
0001 0138 0000 0400 011c 0d39 0000 0800 0000 000b | ...8.......9........
ebbe 083a 0000 810e 3133 3836 3936 3137 3930 3332 | ...:....138696179032
Logdump 718 >n
___________________________________________________________________
Hdr-Ind : E (x45) Partition : . (x04)
UndoFlag : . (x00) BeforeAfter: A (x41)
RecLength : 1530 (x05fa) IO Time : 2015/05/11 19:11:22.000.000
IOType : 5 (x05) OrigNode : 255 (xff)
TransInd : . (x01) FormatType : R (x52) --=======>>>>>>>(x01代表事務的中間)
SyskeyLen : 0 (x00) Incomplete : . (x00)
AuditRBA : 11903 AuditPos : 1509012904
Continued : N (x00) RecCount : 1 (x01)
2015/05/11 19:11:22.000.000 Insert Len 1530 RBA 1276
Name: EDAS.E_MP_POWER_CURVE
After Image: Partition 4 G m
0000 000b 0000 0007 3231 3430 3830 3300 0100 0a00 | ........2140803.....
0000 0000 0000 0198 9100 0200 1500 0032 3031 352d | ...............2015-
3035 2d31 313a 3030 3a30 303a 3030 0003 000a 0000 | 05-11:00:00:00......
0000 0000 0000 0006 0004 0064 0000 0060 3030 3030 | ...........d...`0000
3030 3030 3030 3030 3030 3030 3030 3030 3030 3030 | 00000000000000000000
3030 3030 3030 3030 3030 3030 3030 3030 3030 3030 | 00000000000000000000
3030 3030 3030 3030 3030 3030 3030 3030 3030 3030 | 00000000000000000000
Column 0 (x0000), Len 11 (x000b)
Column 1 (x0001), Len 10 (x000a)
Column 2 (x0002), Len 21 (x0015)
Column 3 (x0003), Len 10 (x000a)
Column 4 (x0004), Len 100 (x0064)
Column 5 (x0005), Len 10 (x000a)
Column 6 (x0006), Len 10 (x000a)
Column 7 (x0007), Len 10 (x000a)
Column 8 (x0008), Len 10 (x000a)
Column 9 (x0009), Len 10 (x000a)
Column 10 (x000a), Len 10 (x000a)
Column 11 (x000b), Len 10 (x000a)
Column 12 (x000c), Len 10 (x000a)
Column 13 (x000d), Len 10 (x000a)
Column 14 (x000e), Len 10 (x000a)
Column 15 (x000f), Len 10 (x000a)
Column 16 (x0010), Len 10 (x000a)
Column 17 (x0011), Len 10 (x000a)
Column 18 (x0012), Len 10 (x000a)
Column 19 (x0013), Len 10 (x000a)
Column 20 (x0014), Len 10 (x000a)
Column 21 (x0015), Len 10 (x000a)
Column 22 (x0016), Len 10 (x000a)
Column 23 (x0017), Len 10 (x000a)
Column 24 (x0018), Len 10 (x000a)
Column 25 (x0019), Len 10 (x000a)
Column 26 (x001a), Len 10 (x000a)
Column 27 (x001b), Len 10 (x000a)
Column 28 (x001c), Len 10 (x000a)
Column 29 (x001d), Len 10 (x000a)
Column 30 (x001e), Len 10 (x000a)
Column 31 (x001f), Len 10 (x000a)
Column 32 (x0020), Len 10 (x000a)
Column 33 (x0021), Len 10 (x000a)
Column 34 (x0022), Len 10 (x000a)
Column 35 (x0023), Len 10 (x000a)
Column 36 (x0024), Len 10 (x000a)
Column 37 (x0025), Len 10 (x000a)
Column 38 (x0026), Len 10 (x000a)
Column 39 (x0027), Len 10 (x000a)
Column 40 (x0028), Len 10 (x000a)
Column 41 (x0029), Len 10 (x000a)
Column 42 (x002a), Len 10 (x000a)
Column 43 (x002b), Len 10 (x000a)
Column 44 (x002c), Len 10 (x000a)
Column 45 (x002d), Len 10 (x000a)
Column 46 (x002e), Len 10 (x000a)
Column 47 (x002f), Len 10 (x000a)
Column 48 (x0030), Len 10 (x000a)
Column 49 (x0031), Len 10 (x000a)
Column 50 (x0032), Len 10 (x000a)
Column 51 (x0033), Len 10 (x000a)
Column 52 (x0034), Len 10 (x000a)
Column 53 (x0035), Len 10 (x000a)
Column 54 (x0036), Len 10 (x000a)
Column 55 (x0037), Len 10 (x000a)
Column 56 (x0038), Len 10 (x000a)
Column 57 (x0039), Len 10 (x000a)
Column 58 (x003a), Len 10 (x000a)
Column 59 (x003b), Len 10 (x000a)
Column 60 (x003c), Len 10 (x000a)
Column 61 (x003d), Len 10 (x000a)
Column 62 (x003e), Len 10 (x000a)
Column 63 (x003f), Len 10 (x000a)
Column 64 (x0040), Len 10 (x000a)
Column 65 (x0041), Len 10 (x000a)
Column 66 (x0042), Len 10 (x000a)
Column 67 (x0043), Len 10 (x000a)
Column 68 (x0044), Len 10 (x000a)
Column 69 (x0045), Len 10 (x000a)
Column 70 (x0046), Len 10 (x000a)
Column 71 (x0047), Len 10 (x000a)
Column 72 (x0048), Len 10 (x000a)
Column 73 (x0049), Len 10 (x000a)
Column 74 (x004a), Len 10 (x000a)
Column 75 (x004b), Len 10 (x000a)
Column 76 (x004c), Len 10 (x000a)
Column 77 (x004d), Len 10 (x000a)
Column 78 (x004e), Len 10 (x000a)
Column 79 (x004f), Len 10 (x000a)
Column 80 (x0050), Len 10 (x000a)
Column 81 (x0051), Len 10 (x000a)
Column 82 (x0052), Len 10 (x000a)
Column 83 (x0053), Len 10 (x000a)
Column 84 (x0054), Len 10 (x000a)
Column 85 (x0055), Len 10 (x000a)
Column 86 (x0056), Len 10 (x000a)
Column 87 (x0057), Len 10 (x000a)
Column 88 (x0058), Len 10 (x000a)
Column 89 (x0059), Len 10 (x000a)
Column 90 (x005a), Len 10 (x000a)
Column 91 (x005b), Len 10 (x000a)
Column 92 (x005c), Len 10 (x000a)
Column 93 (x005d), Len 10 (x000a)
Column 94 (x005e), Len 10 (x000a)
Column 95 (x005f), Len 10 (x000a)
Column 96 (x0060), Len 10 (x000a)
Column 97 (x0061), Len 10 (x000a)
Column 98 (x0062), Len 10 (x000a)
Column 99 (x0063), Len 10 (x000a)
Column 100 (x0064), Len 10 (x000a)
Column 101 (x0065), Len 10 (x000a)
GGS tokens:
TokenID x52 'R' ORAROWID Info x00 Length 20
4141 4464 4965 4146 4d41 4148 6936 6941 4150 0001 | AADdIeAFMAAHi6iAAP.. ---=====>>>>正因為是事務的中間，這部分才沒有顯示logcsn的資訊
** Count begins at RBA 1276 --====>>>>使用count命令進行統計
LogTrail /oragolden/ogg/dirdat/cj072717 has 122685 records
Total Data Bytes 187729208
Avg Bytes/Record 1530
Insert 122685
After Images 122685
Average of 1 Transactions --===>>>>發現整個trail檔案上只有一個事務
Bytes/Trans ..... 5888880
Records/Trans ... 122685
Files/Trans ..... 1
EDAS.E_MP_POWER_CURVE Partition 4 --====>>>>就是隻對EDAS.E_MP_POWER_CURVE表進行了insert操作
Total Data Bytes 187729208
Avg Bytes/Record 1530
Insert 122685
After Images 122685 --====>>>>insert的記錄數與count出來的記錄數一致
Wildcard TABLE resolved (entry EDAS.*):
table "EDAS"."E_MP_POWER_CURVE";
PASSTHRU mapping resolved for source table EDAS.E_MP_POWER_CURVE
Last log location read:
FILE: ./dirdat/cj072717
SEQNO: 72717
RBA: 1276
TIMESTAMP: 2015-05-11 19:11:22.000000
EOF: NO
READERR: 0 --====>>>這種情況從72717號檔案一致到72720號檔案才有所改變
Logdump 666 >filter exclude filename EDAS.E_MP_POWER_CURVE
Logdump 667 >n
___________________________________________________________________
Hdr-Ind : E (x45) Partition : . (x04)
UndoFlag : . (x00) BeforeAfter: A (x41)
RecLength : 96 (x0060) IO Time : 2015/05/11 19:11:22.000.000
IOType : 15 (x0f) OrigNode : 255 (xff)
TransInd : . (x03) FormatType : R (x52)
SyskeyLen : 0 (x00) Incomplete : . (x00)
AuditRBA : 11347 AuditPos : 817410984
Continued : N (x00) RecCount : 1 (x01)
2015/05/11 19:11:22.000.000 FieldComp Len 96 RBA 3584332 --======>>>>>72720號檔案的rba為3584332，這是一個新的事務，因為TransInd值為x03
Name: EDAS.E_MP_DAY_PFTIME
After Image: Partition 4 G s
0000 000b 0000 0007 3231 3430 3731 3100 0100 0a00 | ........2140711.....
0000 0000 0000 03cf e700 0200 1500 0032 3031 352d | ...............2015-
3035 2d31 303a 3030 3a30 303a 3030 0003 000a 0000 | 05-10:00:00:00......
0000 0000 0000 0000 0004 000a 0000 0000 0000 0000 | ....................
0000 0005 000a 0000 0000 0000 0000 05a0 | ................
Column 0 (x0000), Len 11 (x000b)
0000 0007 3231 3430 3731 31 | ....2140711
Column 1 (x0001), Len 10 (x000a)
0000 0000 0000 0003 cfe7 | ..........
Column 2 (x0002), Len 21 (x0015)
0000 3230 3135 2d30 352d 3130 3a30 303a 3030 3a30 | ..2015-05-10:00:00:0
30 | 0
Column 3 (x0003), Len 10 (x000a)
0000 0000 0000 0000 0000 | ..........
Column 4 (x0004), Len 10 (x000a)
0000 0000 0000 0000 0000 | ..........
Column 5 (x0005), Len 10 (x000a)
0000 0000 0000 0000 05a0 | ..........
GGS tokens:
TokenID x52 'R' ORAROWID Info x00 Length 20
4141 4374 7552 4144 5041 4148 7872 6141 4277 0001 | AACtuRADPAAHxraABw..
TokenID x4c 'L' LOGCSN Info x00 Length 14
3133 3836 3936 3137 3930 3332 3039 | 13869617903209 --=======>>>>>>正因為是新事務，所以logcsn也正常顯示了
TokenID x36 '6' TRANID Info x00 Length 15
3135 322e 3338 2e31 3735 3437 3435 31 | 152.38.17547451
Logdump 670 >nexttrail
LogTrail /oragolden/ogg/dirdat/cj072720 closed
Current LogTrail is /oragolden/ogg/dirdat/cj072721
最先發現的是投遞程式abend，
2015-05-14 07:56:06 ERROR OGG-01416 Oracle GoldenGate Capture for Oracle, dpecj01.prm: File ./dirdat/cj/ca073866, with format RELEASE 9.0/9.5, does not match current formatspecification of RELEASE 11.2. Modify the parameter file to specify format RELEASE 9.0/9.5 or issue ETROLLOVER prior to restart.
2015-05-14 07:56:06 ERROR OGG-01668 Oracle GoldenGate Capture for Oracle, dpecj01.prm: PROCESS ABENDING.
透過日誌發現運維人員使用了etrollover命令，但隨後啟動時還報同樣的錯誤。
2015-05-14 09:34:12 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter extract DPECJ01 etrollover.
2015-05-14 09:34:12 INFO OGG-01520 Oracle GoldenGate Command Interpreter for Oracle: Rollover performed. For each affected output trail of Version 10 or higher format, af
ter starting the source extract, issue ALTER EXTSEQNO for that trail's reader (either pump EXTRACT or REPLICAT) to move the reader's scan to the new trail file; it will not hap
pen automatically.
此時工程師登入遠端主機，發現災備端磁碟空間滿了，清理完畢之後，啟動投遞程式，還是報同樣的錯誤。
接下來運維工程師作出了一件非常可怕的事情，他修改了投遞的起點(在修改之前投遞程式的起點是seqno 72712 rba 0)，不過問題似乎還沒有解決，因為還是報相同的錯誤。
2015-05-14 09:35:57 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter extract DPECJ01 extseqno 72713 extrba 0.
2015-05-14 09:36:08 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start DPECJ01.
2015-05-14 09:36:14 INFO OGG-01478 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Output file ./dirdat/cj/ca is using format RELEASE 11.2.
2015-05-14 09:36:14 WARNING OGG-01438 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Checkpoint marked as from graceful shutdown, but records found after checkpoint in tr
ail ./dirdat/cj/ca. Expected EOF Seqno 73861, RBA 0. Found Seqno 73865, RBA 196418620.
2015-05-14 09:36:14 INFO OGG-01026 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Rolling over remote file ./dirdat/cj/ca073866.
2015-05-14 09:36:14 ERROR OGG-01416 Oracle GoldenGate Capture for Oracle, dpecj01.prm: File ./dirdat/cj/ca073866, with format RELEASE 9.0/9.5, does not match current format
specification of RELEASE 11.2. Modify the parameter file to specify format RELEASE 9.0/9.5 or issue ETROLLOVER prior to restart.
2015-05-14 09:36:14 ERROR OGG-01668 Oracle GoldenGate Capture for Oracle, dpecj01.prm: PROCESS ABENDING.
不知道處於什麼原因，工程師一直在嘗試著修改
2015-05-14 09:38:06 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter replicat DPECJ01 extseqno 73866 extrba 0.
2015-05-14 09:38:29 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter extract DPECJ01 extseqno 72714 extrba 0.
2015-05-14 09:38:36 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter replicat DPECJ01 extseqno 73867 extrba 0.
2015-05-14 09:38:38 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start DPECJ01.
2015-05-14 09:38:38 INFO OGG-00963 Oracle GoldenGate Manager for Oracle, mgr.prm: Command received from GGSCI on host ecmlndb1:63798 (START EXTRACT DPECJ01 ).
2015-05-14 09:38:38 INFO OGG-00975 Oracle GoldenGate Manager for Oracle, mgr.prm: EXTRACT DPECJ01 starting.
2015-05-14 09:38:38 INFO OGG-00992 Oracle GoldenGate Capture for Oracle, dpecj01.prm: EXTRACT DPECJ01 starting.
不好，本地的trail檔案72712和72713被mgr刪除了。
2015-05-14 09:43:03 INFO OGG-00957 Oracle GoldenGate Manager for Oracle, mgr.prm: Purged old extract file /oragolden/ogg/dirdat/cj072712, applying UseCheckPoints purge rul
e: Oldest Chkpt Seqno 72714 > 72712.
2015-05-14 09:43:03 INFO OGG-00957 Oracle GoldenGate Manager for Oracle, mgr.prm: Purged old extract file /oragolden/ogg/dirdat/cj072713, applying UseCheckPoints purge rul
e: Oldest Chkpt Seqno 72714 > 72713.
可能是運維工程師還沒意示到問題的嚴重性，他還在繼續接著改投遞的起點
2015-05-14 09:44:37 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter extract DPECJ01 extseqno 72715 extrba 0.
2015-05-14 09:44:47 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start DPECJ01.
後來廠商請求我們技術支援，經過我的提醒，他將災備端的./dirdat/cj/ca073866檔案進行了備份，目的是讓投遞程式重新生成一個trail檔案，結果發生了變化，這個OGG-01416錯誤消失了，但接下來又出現了新的錯誤OGG-01061。
2015-05-14 10:20:27 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start DPECJ01.
2015-05-14 10:20:27 INFO OGG-00963 Oracle GoldenGate Manager for Oracle, mgr.prm: Command received from GGSCI on host ecmlndb1:65244 (START EXTRACT DPECJ01 ).
2015-05-14 10:20:27 INFO OGG-00975 Oracle GoldenGate Manager for Oracle, mgr.prm: EXTRACT DPECJ01 starting.
2015-05-14 10:20:27 INFO OGG-00992 Oracle GoldenGate Capture for Oracle, dpecj01.prm: EXTRACT DPECJ01 starting.
...
2015-05-14 10:20:28 INFO OGG-00993 Oracle GoldenGate Capture for Oracle, dpecj01.prm: EXTRACT DPECJ01 started.
2015-05-14 10:20:33 INFO OGG-01226 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Socket buffer size set to 27985 (flush size 27985).
2015-05-14 10:20:35 INFO OGG-01056 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Recovery initialization completed for target file ./dirdat/cj/ca073865, at RBA 196418
620, CSN 13869616746495.
2015-05-14 10:20:35 INFO OGG-01478 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Output file ./dirdat/cj/ca is using format RELEASE 11.2.
2015-05-14 10:20:35 INFO OGG-01026 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Rolling over remote file ./dirdat/cj/ca073866.
2015-05-14 10:20:35 ERROR OGG-01061 Oracle GoldenGate Capture for Oracle, dpecj01.prm: Invalid CSN value length(0) from data source during recovery.
2015-05-14 10:20:35 ERROR OGG-01668 Oracle GoldenGate Capture for Oracle, dpecj01.prm: PROCESS ABENDING.
出現這個錯誤的原因，我們暫時還不知道，但運維人員可能覺得需要把投遞程式的起點改回原來的設定比較好一點，但他不知道其實72710和72712 72713這3個trail檔案早已被刪掉，改回來還有什麼用?
2015-05-14 10:23:48 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): alter replicat DPECJ01 extseqno 72710 extrba 0.
2015-05-14 10:24:16 INFO OGG-00987 Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle): start DPECJ01.
在沒有弄清楚這個的錯誤ogg-01061產生的原因之前，運維人員還在調整著投遞程式的起點，直到72717號trail檔案，結果72711-72716號trail檔案就這樣被無情的刪掉了。唉！
回過頭再來分析01061產生的原因，上網查了一下，只發現一篇檔案，metalink上啥也查不到，鬱悶。首先還是看一下report報告,透過報告顯示可以判斷出如下內容：
1.投遞程式是在投遞cj072717號檔案rba為1276時產生錯誤。
2.投遞程式的rba為1276的事務是在處理 "EDAS"."E_MP_POWER_CURVE"表
知道了以上兩點，那麼是不是我把這張表排除了再啟動投遞程式就應該沒問題了呢？或者我把當前的事務跳過去，讓投遞程式從下一個事務開始投。
EXTRACT dpecj01
RMTHOST 10.160.86.1, MGRPORT 8239, COMPRESS
PASSTHRU
numfiles 1000
RMTTRAIL ./dirdat/cj/ca
table EDAS.*;
table ECMS.*;
TABLE EDAST.*;
2015-05-14 15:33:12 INFO OGG-01815 Virtual Memory Facilities for: COM
anon alloc: mmap(MAP_ANON) anon free: munmap
file alloc: mmap(MAP_SHARED) file free: munmap
target directories:
/oragolden/ogg/dirtmp.
CACHEMGR virtual memory values (may have been adjusted)
CACHESIZE: 64G
CACHEPAGEOUTSIZE (normal): 8M
PROCESS VM AVAIL FROM OS (min): 128G
CACHESIZEMAX (strict force to disk): 96G
2015-05-14 15:33:17 INFO OGG-01226 Socket buffer size set to 27985 (flush size 27985).
2015-05-14 15:33:17 INFO OGG-01056 Recovery initialization completed for target file ./dirdat/cj/ca073910, at RBA 2863, CSN 13869616746495.
2015-05-14 15:33:17 INFO OGG-01478 Output file ./dirdat/cj/ca is using format RELEASE 11.2.
2015-05-14 15:33:18 INFO OGG-01026 Rolling over remote file ./dirdat/cj/ca073911.
***********************************************************************
** Run Time Messages **
***********************************************************************
Opened trail file ./dirdat/cj072717 at 2015-05-14 15:33:18
Wildcard TABLE resolved (entry EDAS.*):
table "EDAS"."E_MP_POWER_CURVE";
PASSTHRU mapping resolved for source table EDAS.E_MP_POWER_CURVE
Source Context :
SourceModule : [er.recovery]
SourceID : [/scratch/aime1/adestore/views/aime1_staoi05/oggcore/OpenSys/src/app/er/recovery.c]
SourceFunction : [RECOVERY_shouldWriteTran]
SourceLine : [633]
2015-05-14 15:33:18 ERROR OGG-01061 Invalid CSN value length(0) from data source during recovery.
***********************************************************************
* ** Run Time Statistics ** *
***********************************************************************
Report at 2015-05-14 15:33:18 (activity since 2015-05-14 15:33:18)
Output to ./dirdat/cj/ca:
No records extracted.
Last log location read:
FILE: ./dirdat/cj072717
SEQNO: 72717
RBA: 1276
TIMESTAMP: 2015-05-11 19:11:22.000000
EOF: NO
READERR: 0
2015-05-14 15:33:18 ERROR OGG-01668 PROCESS ABENDING.
CACHE OBJECT MANAGER statistics
CACHE MANAGER VM USAGE
vm current = 0 vm anon queues = 0
vm anon in use = 0 vm file = 0
vm used max = 0 ==> CACHE BALANCED
CACHE CONFIGURATION
cache size = 64G cache force paging = 96G
buffer min = 64K buffer highwater = 8M
pageout eligible size = 8M
透過logdump我終於有所發現.ogg-01061錯誤產生的原因很可能是由於當前的72717號檔案中所有的記錄都是處在一個事務的中間，而投遞程式沒辦法找到事務的開頭和結尾，當然也不可能從事務的中間就開始投遞啊()
logdump中的TransInd值定義了當前記錄的事務的狀態 (0x00代表是事務的開始,0x01代表是事務的中間,0x02代表是事務的結束,0x03代表單記錄事務),
透過觀察發現72717、72718、72719、72720號trail檔案，結果發現這個trail檔案中的記錄都是一個事務，所有記錄的TransInd值全為(0x01)，
這就是投遞程式啟不來的真正原因，要想讓投遞程式能夠正常執行，必須將其指定為72720號trail檔案的一個新事務開始的位置才行，總結一下命令：
alter extract DPECJ01 extseqno 72720 extrba 0;
alter extract DPECJ01 extseqno 72720 extrba 3584332;
$ pwd
/oragolden/ogg
$ logdump
Oracle GoldenGate Log File Dump Utility for Oracle
Version 11.2.1.0.3 14400833 OGGCORE_11.2.1.0.3_PLATFORMS_120823.1258
Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.
Logdump 712 >open ./dirdat/cj072717
Current LogTrail is /oragolden/ogg/dirdat/cj072717
Logdump 713 >ghdr on
Logdump 714 >detail on
Logdump 715 >usertoken on
Logdump 716 >ggstoken detail
Logdump 717 >n
2015/05/11 19:19:42.261.998 FileHeader Len 1268 RBA 0
Name: *FileHeader*
3000 0199 3000 0008 4747 0d0a 544c 0a0d 3100 0002 | 0...0...GG..TL..1...
0003 3200 0004 2000 0000 3300 0008 02f2 3c00 02aa | ..2... ...3.....<...>
feee 3400 001d 001b 7572 693a 6563 6d6c 6e64 6231 | ..4.....uri:ecmlndb1
3a3a 6f72 6167 6f6c 6465 6e3a 6f67 6736 0000 1300 | ::oragolden:ogg6....
112e 2f64 6972 6461 742f 636a 3037 3237 3137 3700 | ../dirdat/cj0727177.
0001 0138 0000 0400 011c 0d39 0000 0800 0000 000b | ...8.......9........
ebbe 083a 0000 810e 3133 3836 3936 3137 3930 3332 | ...:....138696179032
Logdump 718 >n
___________________________________________________________________
Hdr-Ind : E (x45) Partition : . (x04)
UndoFlag : . (x00) BeforeAfter: A (x41)
RecLength : 1530 (x05fa) IO Time : 2015/05/11 19:11:22.000.000
IOType : 5 (x05) OrigNode : 255 (xff)
TransInd : . (x01) FormatType : R (x52) --=======>>>>>>>(x01代表事務的中間)
SyskeyLen : 0 (x00) Incomplete : . (x00)
AuditRBA : 11903 AuditPos : 1509012904
Continued : N (x00) RecCount : 1 (x01)
2015/05/11 19:11:22.000.000 Insert Len 1530 RBA 1276
Name: EDAS.E_MP_POWER_CURVE
After Image: Partition 4 G m
0000 000b 0000 0007 3231 3430 3830 3300 0100 0a00 | ........2140803.....
0000 0000 0000 0198 9100 0200 1500 0032 3031 352d | ...............2015-
3035 2d31 313a 3030 3a30 303a 3030 0003 000a 0000 | 05-11:00:00:00......
0000 0000 0000 0006 0004 0064 0000 0060 3030 3030 | ...........d...`0000
3030 3030 3030 3030 3030 3030 3030 3030 3030 3030 | 00000000000000000000
3030 3030 3030 3030 3030 3030 3030 3030 3030 3030 | 00000000000000000000
3030 3030 3030 3030 3030 3030 3030 3030 3030 3030 | 00000000000000000000
Column 0 (x0000), Len 11 (x000b)
Column 1 (x0001), Len 10 (x000a)
Column 2 (x0002), Len 21 (x0015)
Column 3 (x0003), Len 10 (x000a)
Column 4 (x0004), Len 100 (x0064)
Column 5 (x0005), Len 10 (x000a)
Column 6 (x0006), Len 10 (x000a)
Column 7 (x0007), Len 10 (x000a)
Column 8 (x0008), Len 10 (x000a)
Column 9 (x0009), Len 10 (x000a)
Column 10 (x000a), Len 10 (x000a)
Column 11 (x000b), Len 10 (x000a)
Column 12 (x000c), Len 10 (x000a)
Column 13 (x000d), Len 10 (x000a)
Column 14 (x000e), Len 10 (x000a)
Column 15 (x000f), Len 10 (x000a)
Column 16 (x0010), Len 10 (x000a)
Column 17 (x0011), Len 10 (x000a)
Column 18 (x0012), Len 10 (x000a)
Column 19 (x0013), Len 10 (x000a)
Column 20 (x0014), Len 10 (x000a)
Column 21 (x0015), Len 10 (x000a)
Column 22 (x0016), Len 10 (x000a)
Column 23 (x0017), Len 10 (x000a)
Column 24 (x0018), Len 10 (x000a)
Column 25 (x0019), Len 10 (x000a)
Column 26 (x001a), Len 10 (x000a)
Column 27 (x001b), Len 10 (x000a)
Column 28 (x001c), Len 10 (x000a)
Column 29 (x001d), Len 10 (x000a)
Column 30 (x001e), Len 10 (x000a)
Column 31 (x001f), Len 10 (x000a)
Column 32 (x0020), Len 10 (x000a)
Column 33 (x0021), Len 10 (x000a)
Column 34 (x0022), Len 10 (x000a)
Column 35 (x0023), Len 10 (x000a)
Column 36 (x0024), Len 10 (x000a)
Column 37 (x0025), Len 10 (x000a)
Column 38 (x0026), Len 10 (x000a)
Column 39 (x0027), Len 10 (x000a)
Column 40 (x0028), Len 10 (x000a)
Column 41 (x0029), Len 10 (x000a)
Column 42 (x002a), Len 10 (x000a)
Column 43 (x002b), Len 10 (x000a)
Column 44 (x002c), Len 10 (x000a)
Column 45 (x002d), Len 10 (x000a)
Column 46 (x002e), Len 10 (x000a)
Column 47 (x002f), Len 10 (x000a)
Column 48 (x0030), Len 10 (x000a)
Column 49 (x0031), Len 10 (x000a)
Column 50 (x0032), Len 10 (x000a)
Column 51 (x0033), Len 10 (x000a)
Column 52 (x0034), Len 10 (x000a)
Column 53 (x0035), Len 10 (x000a)
Column 54 (x0036), Len 10 (x000a)
Column 55 (x0037), Len 10 (x000a)
Column 56 (x0038), Len 10 (x000a)
Column 57 (x0039), Len 10 (x000a)
Column 58 (x003a), Len 10 (x000a)
Column 59 (x003b), Len 10 (x000a)
Column 60 (x003c), Len 10 (x000a)
Column 61 (x003d), Len 10 (x000a)
Column 62 (x003e), Len 10 (x000a)
Column 63 (x003f), Len 10 (x000a)
Column 64 (x0040), Len 10 (x000a)
Column 65 (x0041), Len 10 (x000a)
Column 66 (x0042), Len 10 (x000a)
Column 67 (x0043), Len 10 (x000a)
Column 68 (x0044), Len 10 (x000a)
Column 69 (x0045), Len 10 (x000a)
Column 70 (x0046), Len 10 (x000a)
Column 71 (x0047), Len 10 (x000a)
Column 72 (x0048), Len 10 (x000a)
Column 73 (x0049), Len 10 (x000a)
Column 74 (x004a), Len 10 (x000a)
Column 75 (x004b), Len 10 (x000a)
Column 76 (x004c), Len 10 (x000a)
Column 77 (x004d), Len 10 (x000a)
Column 78 (x004e), Len 10 (x000a)
Column 79 (x004f), Len 10 (x000a)
Column 80 (x0050), Len 10 (x000a)
Column 81 (x0051), Len 10 (x000a)
Column 82 (x0052), Len 10 (x000a)
Column 83 (x0053), Len 10 (x000a)
Column 84 (x0054), Len 10 (x000a)
Column 85 (x0055), Len 10 (x000a)
Column 86 (x0056), Len 10 (x000a)
Column 87 (x0057), Len 10 (x000a)
Column 88 (x0058), Len 10 (x000a)
Column 89 (x0059), Len 10 (x000a)
Column 90 (x005a), Len 10 (x000a)
Column 91 (x005b), Len 10 (x000a)
Column 92 (x005c), Len 10 (x000a)
Column 93 (x005d), Len 10 (x000a)
Column 94 (x005e), Len 10 (x000a)
Column 95 (x005f), Len 10 (x000a)
Column 96 (x0060), Len 10 (x000a)
Column 97 (x0061), Len 10 (x000a)
Column 98 (x0062), Len 10 (x000a)
Column 99 (x0063), Len 10 (x000a)
Column 100 (x0064), Len 10 (x000a)
Column 101 (x0065), Len 10 (x000a)
GGS tokens:
TokenID x52 'R' ORAROWID Info x00 Length 20
4141 4464 4965 4146 4d41 4148 6936 6941 4150 0001 | AADdIeAFMAAHi6iAAP.. ---=====>>>>正因為是事務的中間，這部分才沒有顯示logcsn的資訊
** Count begins at RBA 1276 --====>>>>使用count命令進行統計
LogTrail /oragolden/ogg/dirdat/cj072717 has 122685 records
Total Data Bytes 187729208
Avg Bytes/Record 1530
Insert 122685
After Images 122685
Average of 1 Transactions --===>>>>發現整個trail檔案上只有一個事務
Bytes/Trans ..... 5888880
Records/Trans ... 122685
Files/Trans ..... 1
EDAS.E_MP_POWER_CURVE Partition 4 --====>>>>就是隻對EDAS.E_MP_POWER_CURVE表進行了insert操作
Total Data Bytes 187729208
Avg Bytes/Record 1530
Insert 122685
After Images 122685 --====>>>>insert的記錄數與count出來的記錄數一致
Wildcard TABLE resolved (entry EDAS.*):
table "EDAS"."E_MP_POWER_CURVE";
PASSTHRU mapping resolved for source table EDAS.E_MP_POWER_CURVE
Last log location read:
FILE: ./dirdat/cj072717
SEQNO: 72717
RBA: 1276
TIMESTAMP: 2015-05-11 19:11:22.000000
EOF: NO
READERR: 0 --====>>>這種情況從72717號檔案一致到72720號檔案才有所改變
Logdump 666 >filter exclude filename EDAS.E_MP_POWER_CURVE
Logdump 667 >n
___________________________________________________________________
Hdr-Ind : E (x45) Partition : . (x04)
UndoFlag : . (x00) BeforeAfter: A (x41)
RecLength : 96 (x0060) IO Time : 2015/05/11 19:11:22.000.000
IOType : 15 (x0f) OrigNode : 255 (xff)
TransInd : . (x03) FormatType : R (x52)
SyskeyLen : 0 (x00) Incomplete : . (x00)
AuditRBA : 11347 AuditPos : 817410984
Continued : N (x00) RecCount : 1 (x01)
2015/05/11 19:11:22.000.000 FieldComp Len 96 RBA 3584332 --======>>>>>72720號檔案的rba為3584332，這是一個新的事務，因為TransInd值為x03
Name: EDAS.E_MP_DAY_PFTIME
After Image: Partition 4 G s
0000 000b 0000 0007 3231 3430 3731 3100 0100 0a00 | ........2140711.....
0000 0000 0000 03cf e700 0200 1500 0032 3031 352d | ...............2015-
3035 2d31 303a 3030 3a30 303a 3030 0003 000a 0000 | 05-10:00:00:00......
0000 0000 0000 0000 0004 000a 0000 0000 0000 0000 | ....................
0000 0005 000a 0000 0000 0000 0000 05a0 | ................
Column 0 (x0000), Len 11 (x000b)
0000 0007 3231 3430 3731 31 | ....2140711
Column 1 (x0001), Len 10 (x000a)
0000 0000 0000 0003 cfe7 | ..........
Column 2 (x0002), Len 21 (x0015)
0000 3230 3135 2d30 352d 3130 3a30 303a 3030 3a30 | ..2015-05-10:00:00:0
30 | 0
Column 3 (x0003), Len 10 (x000a)
0000 0000 0000 0000 0000 | ..........
Column 4 (x0004), Len 10 (x000a)
0000 0000 0000 0000 0000 | ..........
Column 5 (x0005), Len 10 (x000a)
0000 0000 0000 0000 05a0 | ..........
GGS tokens:
TokenID x52 'R' ORAROWID Info x00 Length 20
4141 4374 7552 4144 5041 4148 7872 6141 4277 0001 | AACtuRADPAAHxraABw..
TokenID x4c 'L' LOGCSN Info x00 Length 14
3133 3836 3936 3137 3930 3332 3039 | 13869617903209 --=======>>>>>>正因為是新事務，所以logcsn也正常顯示了
TokenID x36 '6' TRANID Info x00 Length 15
3135 322e 3338 2e31 3735 3437 3435 31 | 152.38.17547451
Logdump 670 >nexttrail
LogTrail /oragolden/ogg/dirdat/cj072720 closed
Current LogTrail is /oragolden/ogg/dirdat/cj072721
來自 “ ITPUB部落格 ” ，連結：http://blog.itpub.net/26753337/viewspace-1677913/，如需轉載，請註明出處，否則將追究法律責任。
相關文章
- goldengate故障處理一例Go
- goldengate故障處理一例（續）Go
- OGG-00751錯誤處理一例
- OGG-01031錯誤處理一例
- 錯誤處理
- 程式錯誤型別及其處理型別
- 【問題處理】Error accessing PRODUCT_USER_PROFILE錯誤一例Error
- PHP 錯誤處理PHP
- php錯誤處理PHP
- Go 錯誤處理Go
- Swift錯誤處理Swift
- Zabbix錯誤處理
- mysqldump錯誤處理MySql
- goldengate複製過程字符集處理一例Go
- oracle goldengate 遠端捕獲和投遞OracleGo
- 錯誤處理：如何通過 error、deferred、panic 等處理錯誤？Error
- 二、GO 程式設計模式：錯誤處理Go程式設計設計模式
- CUDA程式優化心得之錯誤處理優化
- PHP錯誤處理和異常處理PHP
- go的錯誤處理Go
- Python錯誤處理Python
- ORACLE GoldenGate 使用技巧-容錯處理等OracleGo
- 【問題處理】Windows環境下exp備份資料ORA-00904錯誤處理一例Windows
- 遠端連線錯誤程式碼及處理
- 異常錯誤資訊處理
- PHP 核心特性 - 錯誤處理PHP
- 常用模組 PHP 錯誤處理PHP
- laravel9 錯誤處理Laravel
- 淺談前端錯誤處理前端
- Oracle異常錯誤處理Oracle
- ORACLE 異常錯誤處理Oracle
- 15-錯誤處理（Error）Error
- 學習Rust 錯誤處理Rust
- axios 的錯誤處理iOS
- Go語言之錯誤處理Go
- GOLANG錯誤處理最佳方案Golang
- Objective-C:錯誤處理Object
- javascript之處理Ajax錯誤JavaScript