OGG数据仓库以及单向复制(一)

简介:









Item

Source System

Target System

Platform

OEL5.4

OEL5.4

Hostname

gc1

oraclelinux54.cuug.net

Database

Oracle 10.2.0.5

Oracle 11.2.0.3

Character Set

Zhs16gbk

Zhs16gbk

ORACLE_SID

PROD

TDB112

Listener Name/Port

LISTENER/1521

LISTENER/1521

Goldengate User

ogg

ogg

确保两个数据库的字符集一致,防止传输出现乱码

  1. Install Goldengate 11g on      Linux--------------------------------------------------------------------

1.1Create install directory and unzip downloaded file on both system

 

For source system(gc2):

[oracle@gc1:/home/oracle]$mkdir -p /u01/app/ogg

[oracle@gc1:/home/oracle]$cp V18156-01-linux.zip /u01/app/ogg

[oracle@gc1:/home/oracle]$cd /u01/app/ogg

[oracle@gc1:/u01/app/ogg]$unzip V18156-01-linux.zip

[oracle@gc1:/u01/app/ogg]$tar -xvf ggs_redhatAS40_x86_ora10g_32bit_v10.4.0.19_002.tar

 

For target system(oraclelinux54.cuug.net):

[oracle@oraclelinux54.cuug.net:/u01]$mkdir -p /u01/app/ogg

[oracle@oraclelinux54.cuug.net:/home/oracle]$cp V18156-01-linux.zip /u01/app/ogg

[oracle@oraclelinux54.cuug.net:/home/oracle]$cd /u01/app/ogg

[oracle@oraclelinux54.cuug.net:/u01/app/ogg]$unzip V18156-01-linux.zip

[oracle@oraclelinux54.cuug.net:/u01/app/ogg]$tar -xvf ggs_redhatAS40_x86_ora10g_32bit_v10.4.0.19_002.tar

1.2Create sub working directories for Goldengate

For both Source system and Target system:

[oracle@~]$ vi .bash_profile

 export  LD_LIBRARY_PATH=/u01/app/oracle/product/11.2.0/dbhome_1/lib

 export  LD_LIBRARY_PATH=$ORACLE_HOME/lib

[oracle@oraclelinux54.cuug.net:/home/oracle]$cd /u01/app/ogg

[oracle@oraclelinux54.cuug.net:/u01/app/ogg]$./ggsci

./ggsci: error while loading shared libraries: libnnz10.so: cannot open shared object file: No such file or directory

[oracle@oraclelinux54.cuug.net:/u01/app/ogg]$cd $ORACLE_HOME/lib

[oracle@oraclelinux54.cuug.net:/u01/app/oracle/product/11.2.0/dbhome_1/lib]$ ln -s  libnnz11.so  libnnz10.so   //建立一个链接,让 libnnz10.so指向libnnz11.so

[oracle@oraclelinux54.cuug.net:/u01/app/oracle/product/11.2.0/dbhome_1/lib]$cd /u01/app/ogg

[oracle@oraclelinux54.cuug.net:/u01/app/ogg]$./ggsci

 

Oracle GoldenGate Command Interpreter for Oracle

Version 10.4.0.19 Build 002

Linux, x86, 32bit (optimized), Oracle 10 on Sep 17 2009 23:49:42

 

Copyright (C) 1995, 2009, Oracle and/or its affiliates.  All rights reserved.

 

 

 

GGSCI (oraclelinux54.cuug.net) 1> create subdirs         //在当前路径下创建

 

Creating subdirectories under current directory /u01/app/ogg

 

Parameter files                /u01/app/ogg/dirprm: created       //参数文件

Report files                   /u01/app/ogg/dirrpt: created

Checkpoint files               /u01/app/ogg/dirchk: created      //检查点文件,支持断点续传,知道哪些文件被传输,哪些没有

Process status files           /u01/app/ogg/dirpcs: created

SQL script files               /u01/app/ogg/dirsql: created

Database definitions files     /u01/app/ogg/dirdef: created

Extract data files             /u01/app/ogg/dirdat: created

Temporary files                /u01/app/ogg/dirtmp: created

Veridata files                 /u01/app/ogg/dirver: created

Veridata Lock files            /u01/app/ogg/dirver/lock: created

Veridata Out-Of-Sync files     /u01/app/ogg/dirver/oos: created

Veridata Out-Of-Sync XML files /u01/app/ogg/dirver/oosxml: created

Veridata Parameter files       /u01/app/ogg/dirver/params: created

Veridata Report files          /u01/app/ogg/dirver/report: created

Veridata Status files          /u01/app/ogg/dirver/status: created

Veridata Trace files           /u01/app/ogg/dirver/trace: created

Stdout files                   /u01/app/ogg/dirout: created

Above directories are created for following purpose:

Name

Purpose

dirchk

Checkpoint files

dirdat

GoldenGate trails

dirdef

Data definition files

dirprm

Parameter files

dirpcs

Process status files

dirrpt

Report files

dirsql

SQL script files

dirtmp

Temporary files

  1. Introduction to the Command      Interface---------------------------------------------------------

  • View HELP summary for all      commands

GGSCI> HELP

GGSCI> HELP ALL

  • View HELP summary for a      COMMAND/ENTITY

GGSCI> HELP ADD EXTRACT

GGSCI> HELP ADD EXTTRAIL

  • View your command history

GGSCI> HISTORY

  • View a brief informational      summary of all processes

GGSCI> INFO ALL

  1. Configure Oracle Database for      Goldengate------------------------------------------------------

  1. Create Goldengate user

Create user ogg for both source system and target system, and grant appropriate privileges.

For Source System:

SQL> create tablespace tbs_gguser datafile '/u01/app/oracle/oradata/EMREP/gguser.dbf' size 50M autoextend on;

SQL> create user ogg identified by ogg default tablespace tbs_gguser temporary tablespace TEMP quota unlimited on tbs_gguser;

SQL> col property_value for a30

SQL> select  property_name,property_value from database_properties where property_name='DEFAULT_TEMP_TABLESPACE';

 

PROPERTY_NAME                  PROPERTY_VALUE

------------------------------ ------------------------------

DEFAULT_TEMP_TABLESPACE        TEMP

grant CONNECT, RESOURCE to ogg;

grant CREATE SESSION, ALTER SESSION to ogg;

grant SELECT ANY DICTIONARY, SELECT ANY TABLE to ogg;

grant ALTER ANY TABLE to ogg;

grant FLASHBACK ANY TABLE to ogg;

grant EXECUTE on DBMS_FLASHBACK to ogg;

 

Insert test table and data for Source System:

[oracle@node1 oradata]$ cd /u01/app/ogg

[oracle@node1 ogg]$ !sql

SQL> conn scott/tiger

 

SQL>  @demo_ora_create

 

SQL> @demo_ora_insert 

 

SQL> select * from tcustmer; 

 

CUST NAME                           CITY                 ST

---- ------------------------------ -------------------- --

WILL BG SOFTWARE CO.                SEATTLE              WA

JANE ROCKY FLYER INC.               DENVER               CO

 

SQL> select * from tcustord;

 

CUST ORDER_DAT PRODUCT_   ORDER_ID PRODUCT_PRICE PRODUCT_AMOUNT TRANSACTION_ID

---- --------- -------- ---------- ------------- -------------- --------------

WILL 30-SEP-94 CAR             144         17520              3            100

JANE 11-NOV-95 PLANE           256        133300              1            100

For Target System:

sys@TDB112>select tablespace_name from dba_tablespaces;    //11g数据库临时表空间不叫temp,我们查看下

TABLESPACE_NAME

------------------------------------------------------------------------------------------

SYSTEM

SYSAUX

UNDOTBS1

TEMPTS1

USERS

LXTBS1

LXTBS2

LXTBS3

LXSP

UNDO_SMALL

TOOLS

TBS_GGUSER

sys@TDB112>create user ogg identified by ogg default tablespace tbs_gguser temporary tablespace TEMPTS1  quota unlimited on tbs_gguser;

grant CONNECT, RESOURCE to ogg;

grant CREATE SESSION, ALTER SESSION to ogg;

grant SELECT ANY DICTIONARY, SELECT ANY TABLE to ogg;

grant CREATE TABLE to ogg;

Create empty test table and grant DML privilege to Goldengate user:

在目标数据库创建表,但不插入数据,即一个空表

SQL> conn scott/tiger

SQL> @demo_ora_create

SQL> grant INSERT, UPDATE, DELETE on scott.tcustmer to ogg;  // 将要同步表的DML操作授权给OGG用户

SQL> grant INSERT, UPDATE, DELETE on scott.tcustord to ogg;    //将要同步表的DML操作授权给OGG用户

  1. Enable supplemental log mode in source system

打开补充 日志,除了redo log以外的log

Check supplemental log mode is enabled or not by following query:

SQL> select SUPPLEMENTAL_LOG_DATA_MIN from v$database;

SUPPLEMENTAL_LOG_DATA_MI

------------------------

NO

If not, enable it:

SQL> alter database add supplemental log data;

SQL> alter system switch logfile;    //这步很重要,因为当前的日志是没有补充日志的,所以要马上切换下日志,从新的日志开始就有补充日志

  1. Enable archive log mode in      source system

一定要打开归档模式,当发生延迟比较厉害的时候传输还没有传完,这时候redo 已经切换了,就需要到归档里面找

Enable archive log mode:

[oracle@cdcjp63vm1 ogg] sqlplus / as sysdba

SQL> alter system set log_archive_dest=' /u01/app/oracle/oradata/soraeuc/arch';  

ORA-02097: parameter cannot be modified because specified value is invalid

ORA-16019: cannot use db_recovery_file_dest with LOG_ARCHIVE_DEST or LOG_ARCHIVE_DUPLEX_DEST                这里报错,因为log_archive_destDB_RECOVERY_FILE_DEST冲突进而形成死锁

解决方案,清除db_recovery_file_destlog_archive_dest_n

SQL> alter system set db_recovery_file_dest='';

SQL> alter system set log_archive_dest_1='';重新执行原语句即可

SQL> alter system set log_archive_dest='/u01/app/oracle/oradata/soraeuc/arch';

 

System altered.

 

SQL> shutdown immediate

SQL> startup mount

SQL> alter database archivelog;

SQL> alter database open;

Check database archive log information:

SQL> alter system archive log current;

SQL>  archive log list;

Database log mode              Archive Mode

Automatic archival             Enabled

Archive destination            /u01/app/oracle/oradata/soraeuc/arch

Oldest online log sequence     6

Next log sequence to archive   8

Current log sequence           8

  1. Enable force logging mode in source      system------------------------------------------

设置了force  loging 即使使用nologing 也将无效,还是会产生大量日志

Check force logging mode is enabled or not by following query:

SQL> SELECT force_logging FROM v$database;

 

FOR

---

NO

Enable force logging mode:

SQL> alter database force logging;

 

Enable transaction data change capture for these two tables in Source system:

把要同步的表打开日志补充

GGSCI (cdcjp63vm1.cn.oracle.com) 3> DBLOGIN USERID ogg, PASSWORD ogg  登入到源数据库

Successfully logged into database.

 

GGSCI (cdcjp63vm1.cn.oracle.com) 5> ADD TRANDATA scott.TCUSTMER    为要传送scott用户的TCUSTMER 表打开日志补充,使其                  

                                                                                                                                        可以传送,在此操作前要先切换日志

Logging of supplemental redo data enabled for table SCOTT.TCUSTMER.

 

GGSCI (cdcjp63vm1.cn.oracle.com) 6> ADD TRANDATA scott.TCUSTORD   为要传送scott用户的TCUSTORD 表打开日志补充

Logging of supplemental redo data enabled for table SCOTT.TCUSTORD.

Verify that supplemental logging has been turned on for these tables.

GGSCI (cdcjp63vm3.cn.oracle.com) 7> INFO TRANDATA scott.TCUST*   查看scottTCUST开头的表设置了TRANDATA,即可以传送

Logging of supplemental redo log data is enabled for table SCOTT.TCUSTMER

Logging of supplemental redo log data is enabled for table SCOTT.TCUSTORD

GGSCI (node1) 3> INFO TRANDATA scott.*

Logging of supplemental redo log data is disabled for table SCOTT.BONUS.

Logging of supplemental redo log data is disabled for table SCOTT.DEPT.

Logging of supplemental redo log data is disabled for table SCOTT.EMP.

Logging of supplemental redo log data is disabled for table SCOTT.EMP2.

Logging of supplemental redo log data is disabled for table SCOTT.EMP3.

Logging of supplemental redo log data is disabled for table SCOTT.SALGRADE.

Logging of supplemental redo log data is enabled for table SCOTT.TCUSTMER

Logging of supplemental redo log data is enabled for table SCOTT.TCUSTORD

 enabled  表示可以同步的表

 disabled 表示不能同步的表

  1. Configure Goldengate Manager Process       ------------------------------------------------------

管理进程,系统关闭后要手动启动

  1. Configure MGR in source system

Create the Manager parameter file.

[oracle@gc2 ogg]./ggsci        ./表示当前路径下面

GGSCI (gc2) 1>  EDIT PARAMS MGR

Use the editor to assign a port.

PORT 7809           意思是这个管理进程启动后就监听这个端口,最好用1024以上的端口,最好不要和其他的端口冲突

PURGEOLDEXTRACTS /u01/app/ogg/dirdat, USECHECKPOINTS   要跟踪的文件放在 /u01/app/ogg/dirdat这个目录下面

Start the Manager.

GGSCI (gc2) 2> START MGR   启动管理进程

Verify that the Manager has started.

GGSCI (cdcjp63vm1.cn.oracle.com) 3> INFO MGR

Manager is running (IP port gc2.7809).

[oracle@gc2 ogg]$ ps -ef | grep ogg

[oracle@gc2 ogg]$ ps -ef | grep ogg

oracle    3554  3539  0 17:29 ?        00:00:00 ./mgr PARAMFILE /u01/app/ogg/dirprm/mgr.prm REPORTFILE /u01/app/ogg/dirrpt/MGR.rpt PROCESSID MGR PORT 7809

  1. Configure MGR in target system

Create the Manager parameter file.

[oracle@oraclelinux54.cuug.net:/u01/app/ogg]$./ggsci

GGSCI (oraclelinux54.cuug.net) 2>  EDIT PARAMS MGR

Use the editor to assign a port.

PORT 7809

PURGEOLDEXTRACTS /u01/app/ogg/dirdat, USECHECKPOINTS

 

Start the Manager.

GGSCI (oraclelinux54.cuug.net) 3> START MGR

Verify that the Manager has started.

GGSCI (oraclelinux54.cuug.net) 4>  INFO MGR

 

Manager is running (IP port oraclelinux54.cuug.net.7809).

  1. Load Initial Data by Direct Load      method----------------------------------------------------------------

第一次初始化加载步骤,只做一次就可以,目的是要让源数据库中的表和目标数据库中的表初始化同步,初步变成一样后就不需要在初始化了,再次初始化会出错

第一次同步源数据库和目标数据库中要同步的表,源数据中表的结构和目标数据库中表的结构要一样,可以用IMP导入表到目标数据库

  1. Configure Extract process in source      system

Add an Extract process called EINI_1:

GGSCI (cdcjp63vm1.cn.oracle.com) 1> ADD EXTRACT EINI_1, SOURCEISTABLE

EXTRACT added.

Verify Extract process:

 EINI_1    是为EXTRACT(提取)取的一个名字

SOURCEISTABLE    表示第一次加载不是从redo 而是直接从表中加载数据

 

GGSCI (gc2) 9> INFO EXTRACT *, TASKS

 

EXTRACT    EINI_1    Initialized   2014-08-11 17:43   Status STOPPED

Checkpoint Lag       Not Available

Log Read Checkpoint  Not Available

                     First Record         Record 0

Task                 SOURCEISTABLE

Edit EINI_1:

GGSCI (cdcjp63vm1.cn.oracle.com) 3> EDIT PARAMS EINI_1     编辑参数

Add:

-- GoldenGate Initial Data Capture(捕获)

-- for TCUSTMER and TCUSTORD

--

EXTRACT EINI_1

SETENV (NLS_LANG=AMERICAN_AMERICA.WE8MSWIN1252)

USERID ogg, PASSWORD ogg

RMTHOST oraclelinux54.cuug.net, MGRPORT 7809

 oraclelinux54.cuug.net是目标数据库的主机名,监听端口7809里的内容

RMTTASK REPLICAT, GROUP RINI_1 

 任务是replicat  复制,GROUP RINI_1 表示在目标端也要配置一个 REPLICAT名字叫做RINI_1

TABLE scott.TCUSTMER;  //要同步的表

TABLE scott.TCUSTORD;

For Japanese support, we should set environment variable “NLS_LANG” in Extract/Pump/Replicat process parameters.

  1. Configure replicat(复制)      process in target      system

Add initial load delivery process

GGSCI (oraclelinux54.cuug.net) 5> ADD REPLICAT RINI_1, SPECIALRUN   

                                      SPECIALRUN:表示只为初始化运行一次,运行一次以后就不运行了,停止

REPLICAT added.

Verify result:

GGSCI (oraclelinux54.cuug.net) 6> INFO REPLICAT *, TASKS

 

REPLICAT   RINI_1    Initialized   2014-08-11 05:55   Status STOPPED

Checkpoint Lag       00:00:00 (updated 00:00:36 ago)

Log Read Checkpoint  Not Available

Task                 SPECIALRUN

Edit initial load delivery process RINI_1.

GGSCI (cdcjp63vm2.cn.oracle.com) 3> EDIT PARAMS RINI_1

Add:

--   GoldenGate Initial Load Delivery

--

REPLICAT   RINI_1

SETENV (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK)

ASSUMETARGETDEFS                    意思是这是一个接收方

USERID ogg,PASSWORD   ogg

DISCARDFILE ./dirrpt/RINIaa.dsc, PURGE    不要的信息放到这个目录下

MAP   scott.*, TARGET scott.*;

Note: In the MAP statement, the first owner/schema is for the source and the second for the target.

MAP  scott.* 是源数据库的scott用户下的表

TARGET scott.* 是目标数据库scott用户下的表,和源数据库中的用户名可以不一样

如果还有其他用户的表同时输入多个用户的表

MAP 其他用户.*, TARGET 其他用户.*;

  1. Accomplish Initial Load

Start Initial Load process EINI_1 in source system, then RINI_1 process in target system will be started automatically:

source system

GGSCI (gc2) 18>START EXTRACT EINI_1    测试第一次初始化同步,启动EXTRACT进程,如果etc/hosts文件没配置会失败

注:

127.0.0.1               localhost.localdomain localhost

::1             localhost6.localdomain6 localhost6

192.168.8.47    gc2                  

192.168.8.48    oraclelinux54.cuug.net

 

Sending START request to MANAGER ...

EXTRACT EINI_1 starting

 

GGSCI (gc2) 19>  VIEW REPORT EINI_1 

 

 

2014-08-11 18:31:21  GGS INFO        414  Wildcard resolution set to IMMEDIATE because SOURCEISTABLE is used.

 

***********************************************************************

                 Oracle GoldenGate Capture for Oracle

                      Version 10.4.0.19 Build 002

   Linux, x86, 32bit (optimized), Oracle 10 on Sep 18 2009 00:01:59

 

Copyright (C) 1995, 2009, Oracle and/or its affiliates.  All rights reserved.

 

 

                    Starting at 2014-08-11 18:31:21

***********************************************************************

 

Operating System Version:

Linux

Version #1 SMP Tue Aug 18 15:51:54 EDT 2009, Release 2.6.18-164.el5

Node: gc2

Machine: i686

                         soft limit   hard limit

Address Space Size   :    unlimited    unlimited

Heap Size            :    unlimited    unlimited

File Size            :    unlimited    unlimited

CPU Time             :    unlimited    unlimited

 

Process id: 3792

 

Description:

 

***********************************************************************

**            Running with the following parameters                  **

***********************************************************************

-- GoldenGate Initial Data Capture

-- for EMP_OGG and DEPT_OGG

--

EXTRACT EINI_1

SETENV (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK)

Set environment variable (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK)

USERID ogg, PASSWORD ***

RMTHOST oraclelinux54.cuug.net, MGRPORT 7809

RMTTASK REPLICAT, GROUP RINI_1

TABLE scott.TCUSTMER;

 

Using the following key columns for source table SCOTT.TCUSTMER: CUST_CODE.

TABLE scott.TCUSTORD;

 

Using the following key columns for source table SCOTT.TCUSTORD: CUST_CODE, ORDER_DATE, PRODUCT_CODE, ORDER_ID.

 

 

CACHEMGR virtual memory values (may have been adjusted)

CACHEBUFFERSIZE:                         64K

CACHESIZE:                                2G

CACHEBUFFERSIZE (soft max):               4M

CACHEPAGEOUTSIZE (normal):                4M

PROCESS VM AVAIL FROM OS (min):        2.91G

CACHESIZEMAX (strict force to disk):   2.67G

 

Database Version:

Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - Prod

PL/SQL Release 10.2.0.1.0 - Production

CORE    10.2.0.1.0      Production

TNS for Linux: Version 10.2.0.1.0 - Production

NLSRTL Version 10.2.0.1.0 - Production

 

Database Language and Character Set:

NLS_LANG = "AMERICAN_AMERICA.ZHS16GBK"

NLS_LANGUAGE     = "AMERICAN"

NLS_TERRITORY    = "AMERICA"

NLS_CHARACTERSET = "ZHS16GBK"

 

Processing table SCOTT.TCUSTMER

 

Processing table SCOTT.TCUSTORD

 

***********************************************************************

*                   ** Run Time Statistics **                         *

***********************************************************************

 

 

Report at 2014-08-11 18:31:28 (activity since 2014-08-11 18:31:21)

 

Output to RINI_1:

 

From Table SCOTT.TCUSTMER:

       #                   inserts:         2

       #                   updates:         0

       #                   deletes:         0

       #                  discards:         0

From Table SCOTT.TCUSTORD:

       #                   inserts:         2

       #                   updates:         0

       #                   deletes:         0

       #                  discards:         0

 

You can also verify the results in target system:

GGSCI (oraclelinux54.cuug.net) 3> VIEW REPORT RINI_1

 

 

***********************************************************************

                 Oracle GoldenGate Delivery for Oracle

                      Version 10.4.0.19 Build 002

   Linux, x86, 32bit (optimized), Oracle 10 on Sep 18 2009 00:08:30

 

Copyright (C) 1995, 2009, Oracle and/or its affiliates.  All rights reserved.

 

 

                    Starting at 2014-08-11 06:31:21

***********************************************************************

 

Operating System Version:

Linux

Version #1 SMP Thu Sep 3 02:16:47 EDT 2009, Release 2.6.18-164.el5

Node: oraclelinux54.cuug.net

Machine: i686

                         soft limit   hard limit

Address Space Size   :    unlimited    unlimited

Heap Size            :    unlimited    unlimited

File Size            :    unlimited    unlimited

CPU Time             :    unlimited    unlimited

 

Process id: 18941

 

Description:

 

***********************************************************************

**            Running with the following parameters                  **

***********************************************************************

-- GoldenGate Initial Load Delivery

--

REPLICAT RINI_1

SETENV (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK)

Set environment variable (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK)

ASSUMETARGETDEFS

USERID ogg, PASSWORD ***

DISCARDFILE ./dirrpt/RINIaa.dsc, PURGE

MAP scott.*, TARGET scott.*;

 

 

CACHEMGR virtual memory values (may have been adjusted)

CACHEBUFFERSIZE:                         64K

CACHESIZE:                              512M

CACHEBUFFERSIZE (soft max):               4M

CACHEPAGEOUTSIZE (normal):                4M

PROCESS VM AVAIL FROM OS (min):           1G

CACHESIZEMAX (strict force to disk):    881M

 

Database Version:

Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - Production

PL/SQL Release 11.2.0.3.0 - Production

CORE    11.2.0.3.0      Production

TNS for Linux: Version 11.2.0.3.0 - Production

NLSRTL Version 11.2.0.3.0 - Production

 

Database Language and Character Set:

NLS_LANG = "AMERICAN_AMERICA.ZHS16GBK"

NLS_LANGUAGE     = "AMERICAN"

NLS_TERRITORY    = "AMERICA"

NLS_CHARACTERSET = "ZHS16GBK"

 

For further information on character set settings, please refer to user manual.

 

***********************************************************************

**                     Run Time Messages                             **

***********************************************************************

 

 

Wildcard MAP resolved (entry SCOTT.*):

  MAP SCOTT.TCUSTMER, TARGET scott.TCUSTMER;

Using following columns in default map by name:

  CUST_CODE, NAME, CITY, STATE

 

Using the following key columns for target table SCOTT.TCUSTMER: CUST_CODE.

 

 

Wildcard MAP resolved (entry SCOTT.*):

  MAP SCOTT.TCUSTORD, TARGET scott.TCUSTORD;

Using following columns in default map by name:

  CUST_CODE, ORDER_DATE, PRODUCT_CODE, ORDER_ID, PRODUCT_PRICE,

  PRODUCT_AMOUNT, TRANSACTION_ID

 

Using the following key columns for target table SCOTT.TCUSTORD: CUST_CODE, ORDER_DATE, PRODUCT_CODE, ORDER_ID.

 

 

***********************************************************************

*                   ** Run Time Statistics **                         *

***********************************************************************

 

 

Report at 2014-08-11 06:31:33 (activity since 2014-08-11 06:31:27)

 

From Table SCOTT.TCUSTMER to SCOTT.TCUSTMER:

       #                   inserts:         2

       #                   updates:         0

       #                   deletes:         0

       #                  discards:         0

From Table SCOTT.TCUSTORD to SCOTT.TCUSTORD:

       #                   inserts:         2

       #                   updates:         0

       #                   deletes:         0

       #                  discards:         0

 

Check the initial data has been transferred to Target system:

sys@TDB112>conn scott/tiger

Connected.

scott@TDB112>select * from tab;

 

TNAME                                                                                      TABTYPE                CLUSTERID

------------------------------------------------------------------------------------------ --------------------- ----------

BONUS                                                                                      TABLE

DEPT                                                                                       TABLE

EMP                                                                                        TABLE

EMP2                                                                                       TABLE

SALGRADE                                                                                   TABLE

TCUSTMER                                                                                   TABLE

TCUSTORD                                                                                   TABLE

After initial load, extract process EINI_1 and replicat process RINI_1 stop automatically. 自动停止和上面配置的参数 ADD REPLICAT RINI_1, SPECIALRUN    有关

Source system:

 

GGSCI (gc2) 20>  INFO EXTRACT EINI_1

 

EXTRACT    EINI_1    Last Started 2014-08-11 18:31   Status STOPPED

Checkpoint Lag       Not Available

Log Read Checkpoint  Table SCOTT.TCUSTORD

                     2014-08-11 18:31:28  Record 2

Task                 SOURCEISTABLE

Target System:

 

REPLICAT   RINI_1    Initialized   2014-08-11 05:55   Status STOPPED

Checkpoint Lag       00:00:00 (updated 00:49:48 ago)

Log Read Checkpoint  Not Available

Task                 SPECIALRUN






 本文转自 dbapower 51CTO博客,原文链接:http://blog.51cto.com/suifu/1539820,如需转载请自行联系原作者
相关实践学习
日志服务之使用Nginx模式采集日志
本文介绍如何通过日志服务控制台创建Nginx模式的Logtail配置快速采集Nginx日志并进行多维度分析。
相关文章
|
6月前
|
存储 Java 数据库连接
云数据仓库ADB不管是jdbc写入或者dts同步,均会存在丢数据的情况?
云数据仓库ADB不知道是不是磁盘出问题了不管是jdbc写入或者dts同步,均会存在丢数据的情况?
55 2
|
8月前
|
SQL 消息中间件 JSON
4、离线数仓数据同步策略(全量表数据同步、增量表数据同步、首日同步、采集通道脚本)(二)
4、离线数仓数据同步策略(全量表数据同步、增量表数据同步、首日同步、采集通道脚本)(二)
|
8月前
|
消息中间件 canal SQL
4、离线数仓数据同步策略(全量表数据同步、增量表数据同步、首日同步、采集通道脚本)(一)
4、离线数仓数据同步策略(全量表数据同步、增量表数据同步、首日同步、采集通道脚本)(一)
|
10月前
|
SQL 数据采集 分布式计算
大数据数据采集的数据迁移(同步/传输)的Sqoop之基本命令和使用的导入/导出数据
在大数据领域,数据迁移(同步/传输)也是非常重要的一环。Sqoop作为一个开源的数据迁移工具,可以帮助我们轻松地实现关系型数据库与Hadoop之间的数据迁移。本文将会对Sqoop的基本命令和使用进行详细介绍。
172 1
|
10月前
|
数据采集 SQL 分布式计算
大数据数据采集的数据迁移(同步/传输)的Sqoop之基本命令和使用的查询库/表
在大数据领域中,Sqoop是一款非常流行的数据迁移工具。它可以将关系型数据库中的数据快速地移动到Hadoop生态系统中,方便我们进行更深入的分析和处理。本文将介绍Sqoop的基本命令及如何使用Sqoop来查询库表,希望能够为大家提供一些参考和帮助。
126 0
|
编解码 Oracle 关系型数据库
【大数据实时数据同步】GoldenGate实时同步异常:OGG-03533:character ‘c2 a0‘ at offset 0 that is not available报错解决
博主所在单位目前使用Oracle GoldenGate将各个业务生产库汇聚到一起做数仓实时ODS平台,源端库可能涉及Oracle、Mysql、达梦、Guassdb库。 最近遇到了这个错误:`OGG-03533:character 'c2 a0' at offset 0 that is not available。` 导致报错的原因是源端库有业务人员手动用excel往数据库导入数据,源端库字符集:`AMERICAN_AMERICA.AL32UTF8` ,目标库ODS字符集:`AMERICAN_AMERICA.ZHS16GBK`。
【大数据实时数据同步】GoldenGate实时同步异常:OGG-03533:character ‘c2 a0‘ at offset 0 that is not available报错解决
|
canal SQL Oracle
新的增量数据同步工具闪亮登场,完美支持Oracle增量同步
新的增量数据同步工具闪亮登场,完美支持Oracle增量同步
新的增量数据同步工具闪亮登场,完美支持Oracle增量同步
|
运维 网络协议 关系型数据库
PostgreSQl 12主从流复制及归档配置
PostgreSQl 12主从流复制及归档配置
|
消息中间件 SQL 存储
流式数据库 KSQL 概念详解 (二)
  联接 Join 集合   可以使用具有SQL连接语法的JOIN语句,使用ksqlDB实时合并事件流。ksqlDB连接和关系数据库连接的相似之处在于,它们都基于通用值组合了来自两个或多个源的数据。ksqlDB连接的结果是一个新的流或表,其中填充了您在SELECT语句中指定的列值。   使用ksqlDB,无需围绕连接流和表编写低级逻辑,因此可以专注于用于组合流数据的业务逻辑。   可以通过以下方式联接流和表:   连接多个流以创建新的流。连接多个表以创建一个新表。连接多个流和表以创建一个新的流。
1101 0