使用GoldenGate 實現Oracle for Oracle 單向資料同步(實現表的DML操作同步)
實驗環境
資料來源端: host1 ip 192.168.199.163
資料目標端: host2 ip 192.168.199.104
兩臺機器都安裝 文中描述安裝配置好了GoldenGate 。
要實現資料的同步,源端必須滿足如下設定
Oracle需要執行在歸檔模式下
SQL> startup mount
ORACLE instance started.
Total System Global Area 835104768 bytes
Fixed Size 2217952 bytes
Variable Size 574621728 bytes
Database Buffers 255852544 bytes
Redo Buffers 2412544 bytes
Database mounted.
SQL> alter database archivelog;
Database altered.
SQL> alter database open;
Database altered.
2. 開啟日誌附加屬性
SQL> ALTER DATABASE ADD SUPPLEMENTAL LOG DATA;
Database altered.
SQL> ALTER SYSTEM SWITCH LOGFILE;
System altered.
ogg安裝目錄下提供了一些demo的sql
[oracle@localhost ogg]$ ls demo_ora_*
demo_ora_create.sql
demo_ora_insert.sql demo_ora_lob_create.sql demo_ora_misc.sql
demo_ora_pk_befores_create.sql demo_ora_pk_befores_insert.sql
demo_ora_pk_befores_updates.sql
我們使用demo_ora_create.sql在源和目的端都建立兩張表,在源端使用demo_ora_insert.sql插入資料。
host1
SQL> alter user scott identified by tiger account unlock;
User altered.
SQL> grant resource to scott; #ggsci 登入資料庫時需要該許可權
Grant succeeded.
SQL> grant select any dictionary to scott; # add trandata時需要該許可權
Grant succeeded.
SQL> conn scott/tiger
Connected.
SQL> @demo_ora_create.sql
SQL> @demo_ora_insert.sql
host2
SQL> alter user scott identified by tiger account unlock;
User altered.
SQL> grant resource to scott; #ggsci 登入資料庫時需要該許可權
Grant succeeded.
SQL> grant select any dictionary to scott; # add trandata時需要該許可權
SQL> conn scott/tiger
Connected.
SQL> @demo_ora_create.sql
為需要同步的表,新增附加日誌
GGSCI (localhost.localdomain) 1> dblogin userid scott, password tiger
Successfully logged into database.
GGSCI (localhost.localdomain) 2> add trandata scott.tcustmer
Logging of supplemental redo data enabled for table SCOTT.TCUSTMER.
GGSCI (localhost.localdomain) 3> add trandata scott.tcustord
Logging of supplemental redo data enabled for table SCOTT.TCUSTORD.
一、初始化載入資料
在源端配置一個初始化Extract,用來同步表中現有資料
1
2 GGSCI (localhost.localdomain) 7> ADD EXTRACT EINILOAD, SOURCEISTABLE
EXTRACT added.
ADD EXTRACT命令用來新增一個EXTRACT, EINILOAD為Extract的group name 。SOURCEISTABLE表示資料來源為表。
檢視Extract的資訊
GGSCI (localhost.localdomain) 9> INFO EXTRACT *, TASKS
EXTRACT EINILOAD Initialized 2015-09-11 15:25 Status STOPPED
Checkpoint Lag Not Available
Log Read Checkpoint Not Available
First Record Record 0
Task SOURCEISTABLE
配置初始化載入的捕獲引數
GGSCI (localhost.localdomain) 10> edit params EINILOAD
--
-- GoldenGate Initial Data Capture
-- for TCUSTMER and TCUSTORD
--
EXTRACT EINILOAD
USERID system, PASSWORD "oracle"
RMTHOST 192.168.199.104, MGRPORT 7809
RMTTASK REPLICAT, GROUP RINILOAD
TABLE SCOTT.TCUSTMER;
TABLE SCOTT.TCUSTORD;
在目標端,配置一個REPLICAT
1
2 GGSCI (localhost.localdomain) 2> ADD REPLICAT RINILOAD, SPECIALRUN
REPLICAT added.
檢視REPLICAT資訊
GGSCI (localhost.localdomain) 4> info replicat *, tasks
REPLICAT RINILOAD Initialized 2015-08-22 14:18 Status STOPPED
Checkpoint Lag 00:00:00 (updated 00:02:50 ago)
Log Read Checkpoint Not Available
Task SPECIALRUN
配置Replicat引數
GGSCI (localhost.localdomain) 5> edit params riniload
--
-- GoldenGate Initial Load Delivery
--
REPLICAT RINILOAD
ASSUMETARGETDEFS
USERID system, PASSWORD "oracle"
DISCARDFILE ./dirrpt/RINILOAD.dsc, PURGE
MAP scott.*, TARGET scott.*;
啟動Extract
GGSCI (localhost.localdomain) 11> start extract einiload
Sending START request to MANAGER ...
EXTRACT EINILOAD starting
檢視日誌
GGSCI (localhost.localdomain) 21> view report einiload
如果有報錯,查詢原因並解決
Processing table SCOTT.TCUSTMER
Processing table SCOTT.TCUSTORD
***********************************************************************
* ** Run Time Statistics ** *
***********************************************************************
Report at 2015-09-11 16:23:40 (activity since 2015-09-11 16:23:33)
Output to RINILOAD:
From Table SCOTT.TCUSTMER:
# inserts: 2
# updates: 0
# deletes: 0
# discards: 0
From Table SCOTT.TCUSTORD:
# inserts: 2
# updates: 0
# deletes: 0
# discards: 0
REDO Log Statistics
Bytes parsed 0
Bytes output 574
日誌顯示,已成功同步資料。
到目的庫上驗證
SQL> select count(*) from tcustmer;
COUNT(*)
----------
2
SQL> select count(*) from tcustord;
COUNT(*)
----------
2
二、配置資料實時同步
源端,配置一個實時Extract
GGSCI (localhost.localdomain) 22> ADD EXTRACT EORAKK, TRANLOG, BEGIN NOW, THREADS 1
EXTRACT added.
編輯Extract的引數檔案
GGSCI (localhost.localdomain) 23> EDIT PARAMS EORAKK
--
-- Change Capture parameter file to capture
-- TCUSTMER and TCUSTORD Changes
--
EXTRACT EORAKK
USERID system, PASSWORD oracle
RMTHOST 192.168.199.104, MGRPORT 7809
RMTTRAIL ./dirdat/KK
TABLE SCOTT.TCUSTMER;
TABLE SCOTT.TCUSTORD;
為Extract新增遠端tail file,也就是說這個tail file是在目的端生成的。
GGSCI (localhost.localdomain) 24> ADD RMTTRAIL ./dirdat/KK, EXTRACT EORAKK, MEGABYTES 5
RMTTRAIL added.
驗證結果
GGSCI (localhost.localdomain) 28> INFO RMTTRAIL *
Extract Trail: ./dirdat/KK
Extract: EORAKK
Seqno: 0
RBA: 0
File Size: 5M
啟動Extract 程式
GGSCI (localhost.localdomain) 29> start extract eorakk
Sending START request to MANAGER ...
EXTRACT EORAKK starting
驗證結果
GGSCI (localhost.localdomain) 30> INFO EXTRACT EORAKK, DETAIL
EXTRACT EORAKK Last Started 2015-09-11 17:07 Status RUNNING
Checkpoint Lag 00:00:00 (updated 00:00:01 ago)
Log Read Checkpoint Oracle Redo Logs
2015-09-11 17:07:47 Thread 1, Seqno 25, RBA 36139008
SCN 0.1174781 (1174781)
Target Extract Trails:
Remote Trail Name Seqno RBA Max MB
./dirdat/KK 0 1050 5
Extract Source Begin End
/u01/app/oracle/oradata/orcl/redo01.log 2015-09-11 16:58 2015-09-11 17:07
Not Available * Initialized * 2015-09-11 16:58
Current directory /u01/app/ogg
Report file /u01/app/ogg/dirrpt/EORAKK.rpt
Parameter file /u01/app/ogg/dirprm/eorakk.prm
Checkpoint file /u01/app/ogg/dirchk/EORAKK.cpe
Process file /u01/app/ogg/dirpcs/EORAKK.pce
Stdout file /u01/app/ogg/dirout/EORAKK.out
Error log /u01/app/ogg/ggserr.log
GGSCI (localhost.localdomain) 31> VIEW REPORT EORAKK
GGSCI (localhost.localdomain) 32> INFO ALL
Program Status Group Lag at Chkpt Time Since Chkpt
MANAGER RUNNING
EXTRACT RUNNING EORAKK 00:00:00 00:00:06
目標端,配置REPLICAT
安裝checkpoint表
配置checkpoint表的名稱
GGSCI (localhost.localdomain) 33> EDIT PARAMS ./GLOBALS
HECKPOINTTABLE system.ggschkpt
生成checkpoint表
GGSCI (localhost.localdomain) 1> DBLOGIN USERID system, PASSWORD oracle
Successfully logged into database.
GGSCI (localhost.localdomain) 2> ADD CHECKPOINTTABLE
No checkpoint table specified, using GLOBALS specification (system.ggschkpt)...
Successfully created checkpoint table system.ggschkpt.
GGSCI (localhost.localdomain) 3>
新增Replicat
GGSCI (localhost.localdomain) 3> ADD REPLICAT RORAKK, EXTTRAIL ./dirdat/KK
REPLICAT added.
建立Replicat的引數檔案
GGSCI (localhost.localdomain) 4> EDIT PARAMS RORAKK
--
-- Change Delivery parameter file to apply
-- TCUSTMER and TCUSTORD Changes
--
REPLICAT RORAKK
USERID system, PASSWORD oracle
HANDLECOLLISIONS
ASSUMETARGETDEFS
DISCARDFILE ./dirrpt/RORAKK.DSC, PURGE
MAP scott.tcustmer, TARGET scott.tcustmer;
MAP scott.tcustord, TARGET scott.tcustord;
啟動Replicat
GGSCI (localhost.localdomain) 5> start replicat rorakk
Sending START request to MANAGER ...
REPLICAT RORAKK starting
驗證結果
GGSCI (localhost.localdomain) 6> info replicat rorakk
REPLICAT RORAKK Last Started 2015-08-22 15:49 Status RUNNING
Checkpoint Lag 00:00:00 (updated 00:00:08 ago)
Log Read Checkpoint File ./dirdat/KK000000
First Record RBA 1050
驗證資料同步
在源資料庫,執行如下指令碼,對兩個表進行insert、update、delete操作
[oracle@localhost ogg]$ sqlplus scott/tiger
SQL*Plus: Release 11.2.0.1.0 Production on Fri Sep 11 17:58:17 2015
Copyright (c) 1982, 2009, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
SQL> @/u01/app/ogg/demo_ora_misc.sql
檢視源表中的資料
SQL> select count(*) from tcustmer;
COUNT(*)
----------
5
SQL> select count(*) from tcustord;
COUNT(*)
----------
3
檢視目的表的資料
SQL> select count(*) from tcustmer;
COUNT(*)
----------
5
SQL> select count(*) from tcustord;
COUNT(*)
----------
3
資料已同步
來自 “ ITPUB部落格 ” ,連結:http://blog.itpub.net/9034054/viewspace-1973435/,如需轉載,請註明出處,否則將追究法律責任。
相關文章
- oracle 資料透過goldengate 實時同步到kafka訊息佇列中OracleGoKafka佇列
- 使用oracle的logminer同步資料Oracle
- kettle 實現mysql單表增量同步MySql
- MySQL 到Oracle 實時資料同步HYXSMySqlOracle
- 利用python實現mysql資料庫向sqlserver的同步PythonMySql資料庫Server
- Oracle 19C OGG基礎運維-03DML操作同步Oracle運維3D
- Oracle實時同步技術Oracle
- [資料整合/資料同步] 基於資料庫增量日誌的資料同步方案 : Flink CDC/Debezium/DataX/Canal/Oracle Goldengate/Kettle/Sqoop資料庫OracleGoOOP
- Oracle GoldenGate同步服務歸檔空間維護OracleGo
- 異構資料來源同步之表結構同步 → 透過 jdbc 實現,沒那麼簡單JDBC
- GoldenGate 12c 在原有同步程式中新增同步表的操作步驟Go
- Kafka 叢集如何實現資料同步?Kafka
- OGG 簡單DML同步
- 使用async實現非同步控制非同步
- PHP實現非同步操作總結PHP非同步
- 【SQL】Oracle資料庫通過job定期重建同步表資料SQLOracle資料庫
- Node中非同步和同步的實現非同步
- flink-cdc實時同步(oracle to mysql)OracleMySql
- 如何高效實現 MySQL 與 elasticsearch 的資料同步MySqlElasticsearch
- Nuxt.js 中使用 useHydration 實現資料水合與同步UXJS
- mysql和redis實時同步資料怎麼實現MySqlRedis
- Kafka Connect如何實現同步RDS binlog資料?Kafka
- Linux 伺服器如何實現資料同步?Linux伺服器
- 『現學現忘』Docker基礎 — 31、實現MySQL同步資料DockerMySql
- Js使用水桶簡單方便實現同步載入JS
- ORACLE PL/SQL 物件、表資料對比功能儲存過程簡單實現OracleSQL物件儲存過程
- Oracle DBLink跨資料庫訪問SQL server資料同步 踩坑實錄Oracle資料庫SQLServer
- PHP實現非同步PHP非同步
- 內外網資料的簡單單向同步
- 非同步之三:Async 函式的使用及簡單實現非同步函式
- Kettle:Oracle多表格批量同步資料=》mysqlOracleMySql
- flnkcdc+datastream實現mysql到mysql資料同步ASTMySql
- 部署otter實現mysql主備資料同步(上)MySql
- 部署otter實現mysql主備資料同步(下)MySql
- Oracle實驗6--掌握Oracle資料庫的日誌操作Oracle資料庫
- 使用JavaScript和Python實現Oracle資料庫的儲存過程?JavaScriptPythonOracle資料庫儲存過程
- 巧妙利用 iframe,實現和 Ajax 一樣的非同步提交表單效果非同步
- 技術乾貨|如何利用 ChunJun 實現資料實時同步?
- Linux 實現本、異地遠端資料實時同步功能Linux