Oracle GolgeGate
Uses:
1. Data Replication
2. Data Migration
3. Business Continuity and High Availability
4. Data Warehousing
5. Reporting and Analytics
6. Distributed Databases
7. Data Consolidation
8. Zero Downtime Upgrades and Migrations
9. Real-time Data Integration
10. Data Transformation and Filtering
GoldenGate Processes
Manager:
* controller process
* Control all other processes like extract, pump and replicate.
* allocates port numbers
* Perform trail file management.
* Start GoldenGate processes including dDynamic pProcesses.
* Start the collector process.
DYNAMICPORTLIST: specify the ports that Manager can dynamically allocate to Collector and Replicat processes and to GGSCI sessions.
Extract:
* runs on source database
* extracts all changes for relevant tables and write to the local trail files.
Pump:
* a secondary extract process
* run on source database.
* Read the extracted data from extracted trail file in source database server and stages it in the local trail files on the target database server
Server Collector:
* a server process runs in the background on the target server.
* Receives extracted data from source database server and stages it in the local trail files on the target database server
Replicat:
* Runs on the target database server.
* Reads extracted data from the local trail file on the target database server and applies to the target database.
GoldenGate Commands:
GGSCI> help
GGSCI> INFO MANAGER
GGSCI> SEND MANAGER
GGSCI> START MANAGER
GGSCI> STOP MANAGER
GGSCI> STATUS MANAGER
GGSCI> ADD EXTRACT E_GROUP_NAME
GGSCI> ADD EXTRACT P_NAME
GGSCI> ADD REPLICAT R_GROUP_NAME
GGSCI> ALTER/CLEANUP/DELETE EXTRACT
GGSCI> REGISTER/UNREGISTER EXTRACT
GGSCI> START/STOP PROCESS_NAME
GGSCI> INFO PROCESS_NAME
GGSCI> INFO PROCESS_NAME SHOWCH
GGSCI> INFO PROCESS_NAME DETAIL
GGSCI> SEND PROCESS_NAME
GGSCI> KILL PROCESS_NAME
GGSCI> LAG PROCESS_NAME
GGSCI> STATS PROCESS_NAME
GGSCI> STATUS PROCESS_NAME
GGSCI> ADD CREDENTIALSTORE - a credentials store /wallet that stores encrypted database user credentials.
GGSCI> ALTER/DELETE CREDENTIALSTORE
GGSCI> INFO CREDENTIALSTORE - use to returns information for all credentials store.
Install Oracle GoldenGate 19c:
1. Download and install the software
./runInstaller
2. Create sub directories:
GGSCI (orcl19c.localdomain) 3> CREATE SUBDIRS
3. Create manager process and start
GGSCI (orcl19c.localdomain) 1> view param mgr
port 7809
DYNAMICPORTLIST 7809-7820
DYNAMICPORTREASSIGNDELAY 30
GGSCI (orcl19c.localdomain) 2> start mgr
Configure GolgeGate Replication
1. Install Oracle GoldenGate on source and target databases
2. Setup database in Archive Log Mode
3. Enabling supplemental and force logging
ALTER DATABASE FORCE LOGGING;
ALTER DATABASE ADD SUPPLEMENTAL LOG DATA;
SELECT NAME, SUPPLEMENTAL_LOG_DATA_MIN,FORCE_LOGGING FROM V$DATABASE;
4. ENABLE_GOLDENGATE_REPLICATION
ALTER SYSTEM SET ENABLE_GOLDENGATE_REPLICATION=TRUE SCOPE=BOTH;
5. Create the administrator user/schema for GolgenGate
create tablespace tbs_gg datafile '/u01/oradata/ORCLPRD/tbs_gg.dbf' size 1G;
create user ggusr identified by ggusr_pass default tablespace tbs_gg quota unlimited on tbs_gg;
grant create session,connect,resource,alter system to ggusr;
grant dba to ggusr;
EXEC DBMS_GOLDENGATE_AUTH.GRANT_ADMIN_PRIVILEGE(grantee=>'ggusr', privilege_type=>'CAPTURE', grant_optional_privileges=>'*');
6. Create a User ALIAS for GoldenGate Credential using CREDENTIALSTORE (wallet)
* stores encrypted database user credentials.
* default location of the credential store: $GG_HOME/dircrd
GGSCI (orclprd.localdomain) 3> ADD CREDENTIALSTORE
GGSCI (orclprd.localdomain) 5> DBLOGIN USERID GGUSR, PASSWORD ggusr_password
GGSCI (orclprd.localdomain as GGUSR@orclprd) 7> ALTER CREDENTIALSTORE ADD USER GGUSR ALIAS GGUSR_ORCLPRD
GGSCI (orclprd.localdomain as GGUSR@orclprd) 9> DBLOGIN USERIDALIAS GGUSR_ORCLPRD
GGSCI (orclprd.localdomain as GGUSR@orclprd) 11> INFO CREDENTIALSTORE
GGSCI (orclprd.localdomain as GGUSR@orclprd) 31> ALTER CREDENTIALSTORE REPLACE user ggusr@orclprd ALIAS GGUSR_ORCLPRD
7. Configure Manager process on both sides
GGSCI (orclprd.localdomain) 3> edit param mgr
port 7809
DYNAMICPORTLIST 7809-7820
GGSCI (orclprd.localdomain) 6> start mgr
GGSCI (orclprd.localdomain) 4> info all
GGSCI (orclprd.localdomain) 8> send mgr getportinfo detail
8. Add Checkpointtable
GGSCI (orcl19c.localdomain) 6> dblogin USERIDALIAS GGUSR_ORCL
GGSCI (orcl19c.localdomain as ggusr@orcl) 7> add checkpointtable ggusr.chkpt
GGSCI (orcl19c.localdomain as ggusr@orcl) 9> info checkpointtable ggusr.chkpt
SQL> select count(*) from ggusr.chkpt;
COUNT(*)
----------
0
9. Add Trandata on Source Side for tables which will be replicated
GGSCI (orclprd.localdomain as GGUSR@orclprd) 12> ADD TRANDATA HR.EMPLOYEES #For schema: HR.*
GGSCI (orclprd.localdomain as GGUSR@orclprd) 15> INFO TRANDATA HR.EMPLOYEES
Initial Load:
1. Configure Extract process on source database:
GGSCI (orclprd.localdomain) 7> edit param EEMP
EXTRACT EEMP
SETENV (ORACLE_SID=ORCLPRD)
USERIDALIAS GGUSR_ORCLPRD
WARNLONGTRANS 4H CHECKINTERVAL 5M SKIPEMPTYTRANS
BR BROFF
CACHEMGR CACHESIZE 4GB, CACHEDIRECTORY /u01/goldengate/gg_dircache 5GB
EXTTRAIL /u01/goldengate/db19/dirdat/em
TABLE HR.EMPLOYEES;
TABLE HR.DEPARTMENTS;
2. Add Extract:
GGSCI (orclprd.localdomain) 9> dblogin USERIDALIAS GGUSR_ORCLPRD
GGSCI (orclprd.localdomain as GGUSR@orclprd) 10> ADD EXTRACT EEMP, TRANLOG, BEGIN NOW
GGSCI (orclprd.localdomain as GGUSR@orclprd) 18> ADD EXTTRAIL /u01/goldengate/db19/dirdat/em, EXTRACT EEMP, MEGABYTES 200
GGSCI (orclprd.localdomain) 6> start eemp
GGSCI (orclprd.localdomain) 14> info eemp
GGSCI (orclprd.localdomain as GGUSR@orclprd) 20> INFO EEMP SHOWCH
3. Add Pump:
GGSCI (orclprd.localdomain) 4> view param PEMP
EXTRACT PEMP
SETENV (ORACLE_SID=ORCLPRD)
PASSTHRU
CACHEMGR CACHESIZE 2GB, CACHEDIRECTORY /u01/goldengate/gg_dircache 2GB
EOFDELAYCSECS 1
FLUSHCSECS 1
RMTHOSE 192.168.56.20, MGRPORT 7809
RHTTRAIL /u01/gg_target/hr
GETUPDATEBEFORES
GETUPDATEAFTERS
REPORTCOUNT EVERY 10 MINUTES, RATE
TABLE HR.EMPLOYEES;
TABLE HR.DEPARTMENTS;
GGSCI (orclprd.localdomain) 5> ADD EXTRACT PEMP, EXTTRAILSOURCE /u01/goldengate/db19/dirdat/em, EXTSEQNO 0
GGSCI (orclprd.localdomain) 6> ADD RMTTRAIL /u01/gg_target/dirdat/hr, EXTRACT PEMP, SEQNO 0, RBA 0 MEGABYTES 200
4. GLOBALS Parameter on setting on Target:
GGSCI (orcl19c.localdomain as GGUSR@orcl) 29> view param ./GLOBALS
GGSCHEMA GGUSR
CHECKPOINTTABLE ggusr.CHKPT
ALLOWOUTPUTDIR /u01/gg_target
Replicat process parameter files:
GGSCI (orcl19c.localdomain as GGUSR@orcl) 28> view param REMP
REPLICAT REMP
SETENV (ORACLE_SID=ORCLPRD)
USERIDALIAS GGUSR_ORCL
MAP HR.EMPLOYEES, TARGET HR.EMPLOYEES;
MAP HR.DEPARTMENTS, TARGET HR.DEPARTMENTS;
GGSCI (orcl19c.localdomain as GGUSR@orcl) 45> ADD REPLICAT REMP, EXTTRAIL /u01/gg_target/hr, CHECKPOINTTABLE GGUSR.CHKPT
GGSCI (orcl19c.localdomain as GGUSR@orcl) 47> START REMP
GGSCI (orcl19c.localdomain as GGUSR@orcl) 48> INFO REMP
Validation:
GGSCI (orclprd.localdomain) 1> stats EEMP
GGSCI (orcl19c.localdomain as GGUSR@orcl) 49> STATS REMP
Enable DDL Replication in GoldenGate
1. To enable the DDL, first need to execute below mentioned scripts on source database.
@marker_setup.sql
@ddl_setup
@role_setup.sql
SQL> GRANT GGS_GGSUSER_ROLE TO GGUSR;
@ddl_enable.sql
2. Update Extract and PUMP parameter to include DDL (DDL INCLUDE ALL)
GGSCI (orclprd.localdomain) 2> edit param EEMP
EXTRACT EEMP
SETENV (ORACLE_SID=ORCLPRD)
USERIDALIAS GGUSR_ORCLPRD
WARNLONGTRANS 4H CHECKINTERVAL 5M SKIPEMPTYTRANS
BR BROFF
CACHEMGR CACHESIZE 4GB, CACHEDIRECTORY /u01/goldengate/gg_dircache 5GB
EXTTRAIL /u01/goldengate/db19/dirdat/em
#Enable DDL
DDL INCLUDE ALL
TABLE HR.*;
GGSCI (orclprd.localdomain) 3> edit param PEMP
EXTRACT PEMP
SETENV (ORACLE_SID=ORCLPRD)
PASSTHRU
--CACHEMGR CACHESIZE 2GB, CACHEDIRECTORY /u01/goldengate/gg_dircache 4GB
EOFDELAYCSECS 1
FLUSHCSECS 1
RMTHOST 192.168.56.20, MGRPORT 7809
RMTTRAIL /u01/gg_target/hr
GETUPDATEBEFORES
GETUPDATEAFTERS
REPORTCOUNT EVERY 10 MINUTES, RATE
DDL INCLUDE ALL
TABLE HR.*;
3. Enable DDL at Table Level: (DDL INCLUDE MAPPED OBJNAME)
GGSCI (orclprd.localdomain) 1> view param EEMP
DDL INCLUDE MAPPED OBJNAME HR.TEST
GGSCI (orclprd.localdomain) 2> view param PEMP
DDL INCLUDE MAPPED OBJNAME HR.TEST
GGSCI (orclprd.localdomain) 2> stats EEMP
GoldenGate Error and Solution
1. ERROR OGG-25127 Received an error reply requesting a graceful shutdown:
We may get this error for newly created Pump Process for new remote trail file location.
GGSCI (orclprd.localdomain) 47> view report PEMP
We may get this error for newly created Pump Process for new remote trail file location.
GGSCI (orclprd.localdomain) 47> view report PEMP
Sol.: Add Below parameter and Path on GLOBALS parameter files on Target Database Server:
GGSCI (orcl.localdomain) 69> view param ./GLOBALS
ALLOWOUTPUTDIR /u01/gg_target
2. ERROR OGG-01224 TCP/IP error 113 (No route to host):
we get this error on pump process when target server is not reachable specially when manager process is down on target server.
GGSCI (orclprd.localdomain) 37> view report PEMP
2023-11-21 14:20:29 ERROR OGG-01224 TCP/IP error 113 (No route to host), endpoint: 192.168.56.20:7809.
2023-11-21 14:20:29 ERROR OGG-01668 PROCESS ABENDING.
Sol.: Make sure that manger process are running on target database server and PORT # has been mentioned correctly on PUMP.
Remote host name and port on PUMP:
RMTHOST 192.168.56.20, MGRPORT 7809
RMTTRAIL /u01/gg_target/hr
Manager Process on Target:
GGSCI (orcl19c.localdomain) 5> info mgr
3. ERROR OGG-01224 Connect failed to ::1:7810, error 111:Connection refused – retries exceeded:
GGSCI (orclprd.localdomain) 72> view report pemp
2023-11-21 15:24:39 ERROR OGG-01224 Connect failed to ::1:7810, error 111:Connection refused - retries exceeded.
2023-11-21 15:24:39 ERROR OGG-01668 PROCESS ABENDING.
Check the IP or host name used correctly or not on PUMP:
Check the port is opened or not:
GGSCI (orcl19c.localdomain) 8> send mgr getportinfo detail
Initial Load for GoldenGate Replication Setup
Initial Loading Methods:
Using RMAN
Oracle Export and Import (Data PUMP)
Oracle Transportable Tablespace
ETL Tools
SQL Loader – Useful for heterogeneous environments.
GoldenGate Initial Loading Methods:
File to Replicat
File to Database Utility
Direct Load
Direct Bulk Load.
Oracle GoldenGate Direct Load:
1. Create Initial Extract Load:
GGSCI (orclprd.localdomain as ggusr@orclprd) 24> VIEW PARAM EINIT1
extract EINIT1
SETENV (ORACLE_SID=ORCLPRD)
USERIDALIAS GGUSR_ORCLPRD
RMTHOST 192.168.56.20, MGRPORT 7809
RMTTASK REPLICAT, GROUP RINIT1
TABLE HR.*;
GGSCI (orclprd.localdomain as ggusr@orclprd) 16> ADD EXTRACT EINIT1 SOURCEISTABLE
2. Create Initial Load Replicate on Target:
GGSCI (orcl19c.localdomain) 7> view param RINIT1
REPLICAT RINIT1
SETENV (ORACLE_SID=ORCLPRD)
USERIDALIAS GGUSR_ORCL
MAP HR.*, TARGET HR1.*;
GGSCI (orcl19c.localdomain) 8> ADD REPLICAT RINIT1 SPECIALRUN
3. Create All Objects (Tables/View) on Target Database. We may generate the table creation scripts from source database and execute on Target.
4. Start Extract Initial Load Process:
GGSCI (orclprd.localdomain) 2> start EINIT1
Note: We need to start extract and pump prior to the initial load starting to capture the changes while initial load is running.
Step-by-Step Installation of Oracle GolgenGate (OGG) 21c Microservices
Oracle GoldenGate Microservices Architecture (MA):
Key Components of OGG Microservices:
1. Service Manager:
* acts as the central point to monitor and manage all other services.
* provides a web interface to view and manage deployments, configure processes, and monitor system health.
2. Administration Service:
* primary component responsible for the management of Oracle GoldenGate configurations.
* can configure, start, stop, and manage replication tasks
3. Receiver Service:
handles the receipt of trail files from the source system.
designed to be fault-tolerant
ensures that data is reliably transferred between environments.
4. Distribution Service:
responsible for sending trail files (data) from the source to the target in a secure and efficient manner.
supports both push and pull models.
5. Performance Metrics Service:
collects, processes, and presents performance-related data
allowing administrators to monitor the performance and health of the GoldenGate replication setup.
6. Deployment Service:
manages the actual Oracle GolgenGate processes (Extract, Replicat)
used to deploy and manage the replication configurations.
1. Download and unzip the Binary
2. create three directories on OGG Home
Directory ogg21c_ma for OGG Home.
Directory ogg21c_sm for Service Manager Home.
Directory ogg21c_deploy for Deployment Home.
3. Run the runInstaller file to start the Installation process with GUI mode
OGG Microservice Deployment:
1. Setup the Environment Variable:
cat ogg_21c.env
export ORACLE_HOME=/u01/app/oracle/product/19.3.0/dbhome_1
export ORACLE_SID=ORCLPRD
export LD_LIBRARY_PATH=$ORACLE_HOME/lib:$LD_LIBRARY_PATH
export TNSADMIN=$ORACLE_HOME/network/admin
export OGG_HOME=/u01/goldengate/ogg21c_ma
cd $OGG_HOME/bin
2. Run the oggca.sh file under bin to start the deployment process of OGG Microservice:
/u01/goldengate/ogg21c_ma/bin]$ ./oggca.sh
create new service manager ->
Deployment home (/u01/goldengate/ogg21c_sm) ->
check Register Service Manager ->
Listening host: localhost ->
Listening port: 7830
Listening Port will use for Service Manager Connection. ->
Add new GG Deployment
Deployment name: OGG21C
Software Home: /u01/goldengate/ogg21c_ma
Deployment home: /u01/goldengate/ogg21c_deploy ->
Provide the OGG_HOME and TNS_ADMIN Path ->
Provide the port for each service
Administration: 8001
Distribution: 8002
Receiver: 8003
Metric Service Port: 8004
Metric Service UDP Port: 8005 ->
Provide Schema name to add it in the GLOBALS file: c##ggadmin
Note: As registered the Service Manager as daemon during installation, it will be started automatically.
Service Manager: localhost:7830
Administration Service: We create Extract and Replicat processes on Administration Service.
Login to the Administration Server: From Service Manager Page click on port number link to redirect the Administration Server Link.
Using AdminClient for Command Line Utility for OGG MA
cd $OGG_HOME/bin
./adminclient
GG (not connected) 1> help
Administration Client Command Summary:
! - Executes the previous command without modifications.
ADD CREDENTIALS - Create user credentials for use by the Administration Client.
ALLOWNESTED - Enables the use of nested OBEY files.
CD - Change the Admin Client working directory
CONNECT - Connect to an Oracle GoldenGate Service Manager
DELETE CREDENTIALS - Remove user credentials from the Administration Client.
DISCONNECT - Disconnect from the Oracle GoldenGate Service Manager
EXIT - Exit the Oracle GoldenGate Admin Client
HELP - Provides assistance with syntax and usage of commands.
HISTORY - Shows a list of the most recently issued commands since the startup of the session.
INFO CREDENTIALS - Display information about Administration Client user credentials.
NOALLOWNESTED - Disables the use of nested OBEY files.
OBEY - Processes a file that contains a list of Oracle GoldenGate commands.
SET COLOR - Enable or disable colored text in the Administration Client.
SET DEBUG - Enable or disable debugging mode for the Administration Client.
SET EDITOR - Sets the default text editor program for editing parameter files.
SET PAGER - Sets the default text viewer program for viewing parameter and report files.
SET VERBOSE - Enable or disable verbose command result output.
SHELL - Executes shell commands on the local system.
SHOW - Displays the attributes of the Oracle GoldenGate environment.
Connect to the Service Manager:
GG (http://192.168.56.10:7830 OGG21c) 7> connect 'http://192.168.56.10:7830' as oggadmin deployment OGG21c
OGG (http://192.168.56.10:7830 OGG21c) 22> help
Administration Client Command Summary:
! - Executes the previous command without modifications.
ADD AUTORESTART - (Command removed) Create an autorestart rule.
ADD CHECKPOINTTABLE - Creates a checkpoint table in a database.
ADD CREDENTIALS - Create user credentials for use by the Administration Client.
ADD CREDENTIALSTORE - (Deprecated) Creates a credentials store (wallet) that stores encrypted database user credentials.
ADD DISTPATH - Creates a distribution path.
ADD ENCRYPTIONPROFILE - Create an encryption profile for trail encryption/decryption.
ADD EXTRACT - Creates an Extract group.
ADD EXTTRAIL - Adds a local trail to the Oracle GoldenGate configuration.
ADD HEARTBEATTABLE - Add a heartbeat table to the database
ADD MASTERKEY - Adds a master encryption key to a master encryption key wallet.
ADD PROCEDURETRANDATA - Enables procedure-level supplemental logging.
ADD PROFILE - Create a profile for managed processes.
ADD RECVPATH - Creates a target-initiated distribution path in Receiver Service.
ADD REPLICAT - Adds a Replicat group.
ADD RMTTRAIL - Adds a remote trail to the Oracle GoldenGate configuration.
ADD SCHEMATRANDATA - Enables schema-level supplemental logging.
ADD TRACETABLE - Creates a trace table.
ADD TRANDATA - Enables table-level supplemental logging.
ALLOWNESTED - Enables the use of nested OBEY files.
ALTER CREDENTIALSTORE - Changes the contents of a credentials store.
ALTER DISTPATH - Changes the attributes of a distribution path.
ALTER ENCRYPTIONPROFILE - Alter an encryption profile for trail encryption/decryption.
ALTER EXTRACT - Changes attributes of an Extract group.
ALTER EXTTRAIL - Changes attributes of a local trail.
ALTER HEARTBEATTABLE - Alter a heartbeat table in the database
ALTER RECVPATH - Changes the attributes of a target-initiated distribution path in Receiver Service.
ALTER REPLICAT - Changes attributes of a Replicat group.
ALTER RMTTRAIL - Changes attributes of a remote trail.
CD - Change the Admin Client working directory
CLEANUP CHECKPOINTTABLE - Removes checkpoint records that are no longer needed.
CLEANUP EXTRACT - Deletes run history for an Extract group.
CLEANUP REPLICAT - Deletes run history of a Replicat group.
CLEAR INSTANTIATION CSN FOR - Clear the instantiation CSN on a target table.
CONNECT - Connect to an Oracle GoldenGate Service Manager
CREATE WALLET - (Deprecated) Creates a wallet that stores master encryption keys.
DBLOGIN USERIDALIAS - Logs the session into a database so that other commands that affect the database can be issued.
DELETE AUTORESTART - (Command removed) Remove an autorestart rule.
DELETE CHECKPOINTTABLE - Removes a checkpoint table from a database.
DELETE CREDENTIALS - Remove user credentials from the Administration Client.
DELETE CREDENTIALSTORE - Deletes the wallet that serves as a credentials store.
DELETE DISTPATH - Deletes a distribution path.
DELETE ENCRYPTIONPROFILE - Remove an encryption profile.
DELETE EXTRACT - Deletes an Extract group.
DELETE EXTTRAIL - Removes a local trail from the Oracle GoldenGate configuration.
DELETE HEARTBEATENTRY - Delete heartbeat table entries from the database
DELETE HEARTBEATTABLE - Delete a heartbeat table from the database
DELETE MASTERKEY - Marks a master encryption key for deletion.
DELETE PROCEDURETRANDATA - Disables procedure-level supplemental logging.
DELETE PROFILE - Remove a managed process profile.
DELETE RECVPATH - Deletes a target-initiated distribution path in Receiver Service.
DELETE REPLICAT - Deletes a Replicat group.
DELETE RMTTRAIL - Removes a remote trail from the Oracle GoldenGate configuration.
DELETE SCHEMATRANDATA - Disables schema-level supplemental logging.
DELETE TRACETABLE - Removes a trace table.
DELETE TRANDATA - Disables table-level supplemental logging.
DISABLE SERVICE - Disable the specified Oracle GoldenGate services.
DISCONNECT - Disconnect from the Oracle GoldenGate Service Manager
EDIT ENCKEYS - Opens the ENCKEYS file for editing in the default text editor.
EDIT GLOBALS - Opens the GLOBALS parameter file for editing in the default text editor.
EDIT PARAMS - Opens a parameter file for editing in the default text editor.
ENABLE SERVICE - Enable the specified Oracle GoldenGate services.
ENCRYPT PASSWORD - Encrypt a password that is used in an Oracle GoldenGate parameter file or command.
EXIT - Exit the Oracle GoldenGate Admin Client
FLUSH SEQUENCE - Updates an Oracle sequence so that initial redo records are available at the time that Extract starts capturing transaction data.
HEALTH DEPLOYMENT - Display the health of the specified Oracle GoldenGate deployments.
HELP - Provides assistance with syntax and usage of commands.
HISTORY - Shows a list of the most recently issued commands since the startup of the session.
INFO ALL - Displays status and lag for all Oracle GoldenGate processes on a system.
INFO AUTORESTART - (Command removed) Returns information about autorestart rules.
INFO CHECKPOINTTABLE - Returns information about one or more checkpoint tables.
INFO CREDENTIALS - Display information about Administration Client user credentials.
INFO CREDENTIALSTORE - Returns information about a credentials store.
INFO DISTPATH - Returns information about distribution path(s).
INFO ENCRYPTIONPROFILE - Returns information about encryption profiles.
INFO ER - Returns information about the specified wildcarded groups.
INFO EXTRACT - Returns information about an Extract group.
INFO EXTTRAIL - Returns information about a local trail.
INFO HEARTBEATTABLE - Describe a heartbeat table in the database
INFO MASTERKEY - Returns information about master encryption keys.
INFO PARAM - Displays parameter definition information.
INFO PROCEDURETRANDATA - Returns information about the state of procedure-level supplemental logging.
INFO PROFILE - Returns information about managed process profiles.
INFO RECVPATH - Returns information about target-initiated distribution path(s) in Receiver Service.
INFO REPLICAT - Returns information about a Replicat group.
INFO RMTTRAIL - Returns information about a remote trail.
INFO SCHEMATRANDATA - Returns information about the state of schema-level supplemental logging.
INFO TRACETABLE - Returns information about a trace table.
INFO TRANDATA - Returns information about the state of table-level supplemental logging.
KILL ER - Forcibly terminates the specified wildcarded groups.
KILL EXTRACT - Forcibly terminates the run of an Extract group.
KILL REPLICAT - Forcibly terminates a Replicat group.
LAG ER - Returns lag information about the specified wildcarded groups.
LAG EXTRACT - Returns information about Extract lag.
LAG REPLICAT - Returns information about Replicat lag.
LIST TABLES - Lists the tables in the database with names that match the input specification.
MININGDBLOGIN USERIDALIAS - Specifies the credentials of the user that an Oracle GoldenGate process uses to log into an Oracle mining database.
NOALLOWNESTED - Disables the use of nested OBEY files.
OBEY - Processes a file that contains a list of Oracle GoldenGate commands.
OPEN WALLET - (Deprecated) Opens a master encryption key wallet.
PURGE EXTTRAIL - Removes files related to a local trail from the file system.
PURGE WALLET - Permanently removes from a wallet the master encryption keys that are marked as deleted.
REGISTER EXTRACT - Registers an Extract group with the database.
REGISTER REPLICAT - Registers a Replicat group with the database.
RENEW MASTERKEY - Adds a new version of a master encryption key.
RESTART DEPLOYMENT - Restart the specified Oracle GoldenGate deployments.
RESTART ER - Stops, then starts the specified wildcarded groups.
RESTART EXTRACT - Stops, then starts an Extract group.
RESTART REPLICAT - Stops, then starts a Replicat group.
RESTART SERVICE - Restart the specified Oracle GoldenGate services.
SEND ER - Sends instructions to, or returns information about, the specified wildcarded groups.
SEND EXTRACT - Sends instructions to, or returns information about, a running Extract group.
SEND REPLICAT - Sends instructions to, or returns information about, a running Replicat group.
SET COLOR - Enable or disable colored text in the Administration Client.
SET DEBUG - Enable or disable debugging mode for the Administration Client.
SET EDITOR - Sets the default text editor program for editing parameter files.
SET INSTANTIATION CSN - Set the instantiation CSN on a target table.
SET PAGER - Sets the default text viewer program for viewing parameter and report files.
SET VERBOSE - Enable or disable verbose command result output.
SHELL - Executes shell commands on the local system.
SHOW - Displays the attributes of the Oracle GoldenGate environment.
START DEPLOYMENT - Start the specified Oracle GoldenGate deployments.
START DISTPATH - Starts a distribution path.
START ER - Starts the specified wildcarded groups.
START EXTRACT - Starts an Extract group.
START RECVPATH - Starts a target-initiated distribution path in Receiver Service.
START REPLICAT - Starts a Replicat group.
START SERVICE - Start the specified Oracle GoldenGate services.
STATS DISTPATH - Returns statistics for a distribution path.
STATS ER - Returns processing statistics for the specified wildcarded groups.
STATS EXTRACT - Returns processing statistics for an Extract group.
STATS RECVPATH - Returns statistics for a target-initiated distribution path in Receiver Service.
STATS REPLICAT - Returns processing statistics for a Replicat group.
STATUS DEPLOYMENT - Display status of the specified Oracle GoldenGate deployments.
STATUS ER - Returns the state of the specified wildcarded groups.
STATUS EXTRACT - Returns the state of an Extract group.
STATUS REPLICAT - Returns the state of a Replicat group.
STATUS SERVICE - Display status of the specified Oracle GoldenGate services.
STOP DEPLOYMENT - Stop the specified Oracle GoldenGate deployments.
STOP DISTPATH - Stops a distribution path.
STOP ER - Stops the specified wildcarded groups.
STOP EXTRACT - Stops an Extract group.
STOP RECVPATH - Stops a target-initiated distribution path in Receiver Service.
STOP REPLICAT - Stops a Replicat group.
STOP SERVICE - Stop the specified Oracle GoldenGate services.
SYNCHRONIZE REPLICAT - Returns all threads of a coordinated Replicat to a uniform start point after an unclean shutdown of the Replicat process.
UNDELETE MASTERKEY VERSION - Changes the state of a master encryption key from being marked as deleted to marked as available.
UNREGISTER EXTRACT - Unregisters an Extract group from the database.
UNREGISTER REPLICAT - Unregisters a Replicat group from the database.
UPGRADE CHECKPOINTTABLE - Adds a supplemental checkpoint table when upgrading Oracle GoldenGate from version 11.2.1.0.0 or earlier.
UPGRADE HEARTBEATTABLE - Alters heartbeat tables to track Extract restart position.
VALIDATE ENCRYPTIONPROFILE - Validates that data can be encrypted with the given profile.
VERSIONS - Displays information about the operating system and database.
VIEW DISCARD - Displays the discard file that is generated by Extract or Replicat.
VIEW ENCKEYS - Displays the contents of the ENCKEYS file in read-only mode on-screen.
VIEW GLOBALS - Displays the contents of the GLOBALS parameter file in read-only mode on-screen.
VIEW MESSAGES - Displays the Oracle GoldenGate message log (ggserr.log file).
VIEW PARAMS - Displays the contents of a parameter file in read-only mode on-screen.
VIEW REPORT - Displays the process report that is generated by Extract or Replicat.
OGG Microservices Architecture (OGG MA) Log File Paths
$OGG_DEPLOYMENT_HOME= /u01/goldengate/ogg21c_deploy
$OGG_HOME= /u01/goldengate/ogg21c_ma
1. Parameter Files Location: $OGG_DEPLOYMENT_HOME/etc/conf/ogg
2. Report File Location: $OGG_DEPLOYMENT_HOME/var/lib/report
3. Admin Client Log: $OGG_HOME/var/log
4. Service Manager Log: $OGG_HOME/var/log
5. All Services Log: (Administration / Distribution / Receiver / Performance Metrics / Deployment Service): $OGG_DEPLOYMENT_HOME/var/log
6. Oracle GG Error Log File: cd $OGG_DEPLOYMENT_HOME/var/log/ggserr.log
Migrate Oracle GoldenGate Classic to MicroServices:
GoldenGate Migration Utility 21c
Prerequisites for the Migration Utility:
1. Java 1.8 JRE or higher
2. GoldenGate 19.1 with Bundle Patch 200714 or later
3. A new Microservices Architecture (MA) deployment must be created, and all services must be running.
4. All processes in the Classic deployment must be stopped. Any abended processes should be restarted and then properly shutdown
5. The Classic deployment must either be on the same server as the MA deployment or have its file system accessible on that server.
6. The migration utility must be run from a shell with MA deployment environmental variable
Migration Utility Restrictions:
1. PUMP Processes: Cannot migrate if they perform transformations or use dblogin
2. Classic Extract: Deprecated in GoldenGate 19c and unsupported in versions 21c and above for MA targets greater than 19.1.
3. Unsupported Parameters: Processes using parameters: MACRO, OBEY, MACROCHAR
4. Remote Configurations: Does not support remote trail files, remote tasks, or initial load operations.
5. Trail File Location: Trail files must be in ./dirdat or its subdirectories.
6. INCLUDE Restrictions:
Nested INCLUDE statements are not supported.
INCLUDE can only be used in Extract and Replicat, not in Pump Extract.
1. Processes Status on Classic Architecture: (all classic processes need to stopped)
2. All Parameter Files on Classic.
GGSCI (orclprd.localdomain as ggusr@orclprd) 44> sh ls -lrt dirprm/*
3. Useful Migration Commands:
java -jar ogg-migration-package-21.1.0.0.0.jar -classicHome $OGG_CLASSIC_HOME –dryrun
java -jar ogg-migration-package-21.1.0.0.0.jar -classicHome $OGG_CLASSIC_HOME –debug
Migration Command:
java -jar ogg-migration-package-21.1.0.0.0.jar -classicHome $OGG_CLASSIC_HOME
Note: To avoid migration errors, ensure that any unused parameter files are removed from the dirprm directory before starting the migration to MA.
Manually Create / Recreate the distribution Path Using AdminClient:
1. Existing DistPath List:
OGG (http://192.168.56.10:7830 OGG21c) 16> info distpath all
PEMPDistPath running
2. Get Details of the DISTPATH:
OGG (http://192.168.56.10:7830 OGG21c) 17> INFO DISTPATH PEMPDistPath DETAIL
3. Delete and Add the DISTPATH:
OGG (http://192.168.56.10:7830 OGG21c) 18> DELETE DISTPATH PEMPDistPath
OGG (http://192.168.56.10:7830 OGG21c) 21> ADD DISTPATH DPNS SOURCE TRAIL://127.0.0.1:8002/services/v2/sources?trail=./em TARGET ogg://192.168.56.20:7809/services/v2/targets?trail=/u01/gg_target/hr AUTHENTICATION USERIDALIAS ORCL_GGUSR_20 DOMAIN OGG21c
OGG (http://192.168.56.10:7830 OGG21c) 22> info DISTPATH DPNS
Reposition the SEQNO and RBA from existing one (Get the Seqno and RBA from Input Checkpoint).
OGG (http://192.168.56.10:7830 OGG21c) 25> ALTER DISTPATH DPNS, BEGIN SEQNO 22 RBA 1379
OGG (http://192.168.56.10:7830 OGG21c) 26> INFO DISTPATH DPNS DETAIL
4. Start the DISTPAH:
OGG (http://192.168.56.10:7830 OGG21c) 27> START DISTPATH DPNS
OGG (http://192.168.56.10:7830 OGG21c) 28> INFO DISTPATH ALL
Comments
Post a Comment