implement a data replication solution using Oracle GoldenGate. Learn aboutOracle GoldenGate concepts, why and when should you use it, and get. Oracle GoldenGate 12c is a high-performance software application for real- Oracle GoldenGate offered tighter integration with the Oracle Database and. Oracle Fusion Middleware Understanding Oracle GoldenGate, 18c () . Learn aboutOracle GoldenGate concepts, why and when should you use it, and.
|Language:||English, Dutch, French|
|ePub File Size:||16.43 MB|
|PDF File Size:||15.56 MB|
|Distribution:||Free* [*Register to download]|
Oracle Corporation acquired GoldenGate in as part of future strategy to implement advanced replication technologies within the product. Examples in this document were developed and tested using Oracle GoldenGate Oracle GoldenGate is the official name of the software. •Oracle GoldenGate's Capture (Extract) process reads data transactions as they occur, by source and target trail files, Oracle GoldenGate's unique architecture .
This enables the delivery of all committed records to the target, even in the event of a restart or cluster failover. Checkpoints store the current position as processed by both the Capture and Delivery modules. Following a network or system outage, Oracle GoldenGate restarts from the last good checkpoint. Oracle GoldenGate also persists uncommitted operations to disk to enable fast and simple data recovery for long running transactions in the event that the replication process is paused or interrupted.
The Capture module can create unique as well as overlapping sets of data in each Trail File. Based on the requirements of the implementation, users can store Trail Files on the target system, the source system, or both.
Trail Files can be delivered to alternative queue types and application interfaces. By staging data in Trail Files, Oracle GoldenGate decouples the data source and target for heterogeneous support.
Unlike architectures that implement a tight process-to-process coupling, this decoupled architecture allows each module to perform its tasks independently. In the event of an unplanned outage, decoupling ensures that the unaffected systems continue to operate. Oracle GoldenGate also provides flexibility in the choice of hardware, operating system, and databases for sources and targets.
For maximum flexibility and ease of use, customers can use different versions of Capture, Delivery, and Trail Files in the same implementation. This configuration enhances the fault tolerance and reliability of the overall Oracle GoldenGate environment.
In the event of a network failure between the source and the target systems , Oracle GoldenGate can continue to capture transactions because the data can be queued up locally in the Trail Files on the source, enhancing the recoverability in case of database failures. The Data Pump feature is strongly recommended if data needs to be distributed to multiple targets from the same source one to many.
Whereas the Capture module can focus solely on capturing transactions, individual Data Pumps can be set up to distribute the data to those targets, increasing the efficiency of the overall environment. Fault tolerance is also greatly increased in such a configuration because any failure associated with one target has no impact on the source capture or delivery to other targetstransactions will continue to be captured, routed, and delivered to the other targets even when one of them is down.
Data Pumps can also be used to route data through an intermediate system, even if that system doesnt have a database installed. Trail Files can create an archive of purged information from the source database by transforming delete and update records into inserts in a different location.
For auditing and compliance purposes, Oracle GoldenGate can also maintain a separate history table to track each update to individual records as they change. Oracle GoldenGate Delivery The Delivery module takes changed transactional data that has been placed in a Trail File and immediately applies it to the target database.
Delivery process executable name Replicat is typically used in documentation to refer to the Delivery module of the product. Data Integrity and Transaction Consistency Each Delivery module applies each database change in the same order as it was committed in the source database to provide data and referential integrity. In addition, it applies changes within the same transaction context as they were on the source system for consistency on the target.
Column Mapping and Transformation As with Capture, users can configure the Delivery module via user-defined criteria too not only specify target tables but also individual rows and columns. By default, the Delivery module populates any target table column with data from a source table column if the two columns share the same name, and this is also true of like-named tables.
However, you can easily configure Oracle GoldenGate to move data from a single table into multiple target tables or vice versa. This can be used to normalize or denormalize data in a data warehouse or OLTP environment. Users can also define explicit mapping and transformation rules, ranging from simple column assignments to more-complex transformations for which Oracle GoldenGate provides a suite of date, math, string, and utility functions.
The module also supports the use of stored database procedures and functions and enables implicit mapping and explicit rules to be combined. If additional transformations, data quality, aggregation, and other functionality are required, Oracle GoldenGate 12c integrates with Oracle Data Integrator Enterprise Edition 12c to support end-to- end data integration.
Optimized High-Speed, High-Volume Data Delivery The Delivery module provides a variety of techniques to optimize the posting of changed transactions to the target database.
Oracle GoldenGates posting processes, where possible, run local to the target database, maximizing throughput by avoiding network limitations. In addition, where possible, updates are executed via native database interfaces rather than through middleware, and internal caches are used to ensure fast execution of repetitive statements.
When applying transactions to a target Oracle Database Integrated Delivery leverages Oracle Database parallel apply servers for automatic dependency tracking and parallel aware apply.
When applying transactions to non-Oracle datastores, Coordinated Delivery capability was introduced with Oracle GoldenGate 12c to simplify deployment of multiple Delivery modules, which can minimize lag time in the event of high data volumes during peak processing times or seasonality.
These capture-route-transform-apply processes run continuously, so that the most recent transactions committed at the source are immediately moved and delivered to the target. This allows an additional layer of data protection when needed and keeps the secondary system at a consistent state behind the primary system.
In this configuration, Oracle GoldenGate routes the changed data to the Trail File on the target server but does not deliver it to the target database until all captured changes have been delivered to the target Trail File. All changed data in the target Trail File can then be immediately applied to the target database, to bring it to a consistent state relative to the source, whenever the user chooses.
To give users control over Oracle GoldenGate processes, the Manager module provides a command-line interface to perform a variety of administrative, housekeeping, and reporting activities, including Setting parameters to configure and fine-tune Oracle GoldenGate processes Starting, stopping, and monitoring the Capture and Delivery modules Critical, informational event, and threshold reporting Resource management Trail File management The Manager module executes requests on demand as well as unattended.
For example, it can be used to restart Oracle GoldenGate components as well as monitor latency. The command-line interface lets users perform a variety of administrative, housekeeping, and reporting tasks. The module also automatically recycles Trail File data when no longer needed, providing insurance against inadvertent disk-full conditions and offering an alternative to error-prone manual housekeeping procedures. Oracle GoldenGate offers transaction tracing flexibility to easily identify bottlenecks and tune the Oracle GoldenGate implementation for optimum performance.
Management Pack for Oracle GoldenGate provides components that enable designing, configuring, managing, and monitoring Oracle GoldenGate core replication processes implemented across the enterprise. A data comparison utility that quickly compares data between two online databases and reports any discrepancies can run as a standalone product. Oracle Management Pack for Oracle GoldenGate Oracle Management Pack for Oracle GoldenGate is a centralized, server-based graphical enterprise application that offers an intuitive way to define, configure, manage, and monitor Oracle GoldenGate processes.
It leverages the management services of the core Oracle GoldenGate platform to help users reduce the deployment time for their continuous availability and real-time data integration configurations. GoldenGate Monitor can integrate with the existing alerting infrastructure with its sophisticated alerts based on SNMP, email and command line integration CLI for third-party call outs. One agent per GoldenGate instance collects monitoring pointssuch as status, lag, number of inserts, updates, and deletesand sends them to the GoldenGate Monitor Server.
Using this data, Oracle GoldenGate Monitor graphically displays a customers end-to-end replication solutions and provides sophisticated server side alerting logic. Oracle GoldenGate Director is a graphical tool that expedites the Oracle GoldenGate process design and simplifies the management of GoldenGate replication components.
GUI-based configuration reduces human errors and enables rapid production of multi-server solutions from a central location. Oracle GoldenGate Veridata is a high-speed, low-impact data comparison solution that identifies and reports data discrepancies between two databases, without interrupting those systems or the business processes they support. Using this application, companies can audit and verify large volumes of data shared across different business applications with absolute certainty.
Oracle GoldenGate Veridata reduces the amount of time and the number of resources required to compare data, minimizes the impact of human errors, and accelerates the discovery of potential problems for rapid resolution. These include one-to-one, one- to-many, many-to-one, and many-to-manyfor both unidirectional and bidirectional configurations.
For unlimited scalability, cascading topologies can be created to eliminate any potential bottlenecks. By staging specific sets of database changes on the source or target system, different requirements can be met through a single pass on the data source. Each set of staged data can contain unique or overlapping sets of data. Figure 2. Oracle GoldenGate supports numerous data propagation solutions to support real-time visibility across the enterprise.
Oracle GoldenGate can also integrate with JMS-based messaging systems for increased flexibility in distributing real-time data. This capability, along with the flat file delivery feature, allows Oracle GoldenGate to provide different architectures to augment existing investments. This single real-time data movement platform enables companies to easily and successfully implement a variety of solutions for improving the availability, accessibility, performance, and integration of critical data across the enterprise.
Through real-time, bidirectional data movement and synchronization between old and new systems, Oracle GoldenGate enables switchover from the existing system to the new system, when the new system is readywithout ever denying access to the application.
The solution can support heterogeneous environments for cross-platform upgrades and database migrations from non-Oracle databases to Oracle databases including Oracle Exadata.
In addition, the solution provides robust failback contingencies by keeping the old and new environments in sync in real time. By simultaneously using Oracle GoldenGate Veridata, users can identify and report data discrepancies across systems before switchover, without impacting the production environment. Oracle GoldenGate also provides zero-down time rolling upgrades for Oracle Database 10g or 11g to Oracle Database 12c. Figure 3. Oracle GoldenGate enables organizations to upgrade and migrate mission-critical applications with no downtime.
Query Offloading Oracle GoldenGates real-time data integration capabilities enable users to offload queries and read-only activity from production databases to a dedicated reporting server. This solution maximizes performance of the production system, reduces cost of ownership, and enables users to optimize the secondary reporting database for read-only activities. In addition, Oracle GoldenGate supports Oracle Database Standard Edition and offers bidirectional data replication to run multi-master synchronization between Oracle Database or non-Oracle databases for continuous availability.
It also immediately initiates real- time data capture from the standby database to update the primary system. With Oracle GoldenGate.
Want Presale Ticket Access?
JD Edwards. Oracle GoldenGate 12c is certified to support operational reporting solutions for major Oracle applications including Oracle E-Business Suite. Oracle GoldenGate delivers up-to-the-second data to the backup system and enables immediate switchover to the new system if an outage occurs.
Oracle GoldenGate supports Oracle Database Standard Edition and offers bidirectional data replication to run multi-master synchronization between Oracle Database or non-Oracle databases for continuous availability. Operational Reporting and Real-Time Data Warehousing Many operational reporting activities ideally seek to use the latest data available.
Its multi-directional replication configuration keeps data centers in synch for access to timely. It also enables continuous availability if one data center is not available. Transform E-LT architecture that further improves performance and reduces cost of ownership by eliminating the middle-tier transformation server.
Oracle GoldenGate enables data distribution and synchronization for distributed systems. By continuously moving source data to a reporting database. Oracle Data Integrator enables Extract. Oracle GoldenGate can also be used for feeding data warehousing solutions with timely data. Oracle GoldenGate parameter files can be automatically deployed to source and target Oracle GoldenGate instances through the JAgent technology.
The combined solution can be used to capture real-time data from source systems without performance impact and loading data warehouse tables with timely information. In addition to supporting replication of DML. When the transaction is committed to the database. GoldenGate runs as a database user and must have the appropriate database privileges to access the redo and archive logs.
The following sections describe GoldenGate functionality. Advanced options of the product provide for the capture. Oracle GoldenGate can perform near real-time capture. Oracle GoldenGate can efficiently operate on any platform running the database. If the transaction details exceed the allocated process memory. GoldenGate can also capture and apply DDL changes.
When using Integrated Capture. The data in this trail file is in commit order sequence. When a qualified transaction starts. This Capture mechanism enables GoldenGate to track and capture multiple transactions simultaneously. Oracle Exadata. The Integrated Capture mechanism can seamlessly traverse between reading the in memory log buffer.
This multi- threaded Capture mechanism enables a variety of enhancements for customers extracting data from an Oracle Database. When operating in Integrated Capture mode. At the target locations. Routing Data Pump A separate Capture process continually scans the staging trail file.
An acknowledgement is returned to the Data Pump that the data was received and written to the trail file successfully. Downstream capture can also be used to enable mining of earlier versions of the database in either real-time or archive log mode. Integrated capture handles point-in-time recovery and RAC integration more efficiently. This system does not need to be identical to the target. Adjusting the read size can improve Capture performance.
It is possible to capture from redo logs stored inside of ASM. The database where the downstream capture is being performed must be Oracle Database 11g Release When using ALO in connected mode.
Because it is fully integrated with the database. When new data is detected in the staging trail file.
To minimize overhead on the source database. Using Oracle GoldenGate 12c for Oracle Database Performing the capture downstream is useful when it is necessary to minimize overhead at the source database. Using disconnected mode eliminates overhead on the source system. In this mode. The target location can be a single server disk location. Minimal changes are required to implement this change.
The Preparer computes dependencies between the transactions and then groups and sorts them in dependency order. Oracle GoldenGate also runs as a database user.
The Delivery process continually scans the trail file for incoming data. Once detected. When new data is detected. This advanced replication. In an active-active configuration. The Database Apply processes perform all necessary changes for the assigned transactions. With Integrated Delivery. The Inbound Server consists of the Receiver.
The new process simplifies configuration and increases performance more than percent. Unique Index and Foreign Key are needed to support the dependency aware apply processing at the target. Oracle GoldenGate recommends that users upgrade to Oracle Database Primary Key updates. Integrated Delivery can process non-Oracle database trail files as long as all of the scheduling columns are logged by the non-Oracle database and are available in the trail file.
Coordinated Delivery can be used with both Oracle and non- Oracle data stores. Coordinated Delivery also automatically provides coordination across selected events that require ordering. In addition to requiring a single parameter file for multiple Delivery processes. Just as shown in the prior section.
Coordinated Delivery Customers delivering data to non-Oracle data stores or Oracle Database versions before Users running on an Oracle Database version prior to The plug-in for Oracle Enterprise Manager Cloud Control lets users gather configuration data and track configuration changes for Oracle GoldenGate instances. It also provides users with the capability to raise alerts and violations based on thresholds set on monitored targets and configuration data.
Oracle GoldenGate transformation supports capture and delivery between dissimilar databases. Oracle GoldenGate 12c Coordinated Delivery Transformation Data transformation can occur within any step of the capture. Optimized for Oracle Database Monitoring and Managing Oracle provides a variety of tools for monitoring and managing Oracle GoldenGate.
The Automatic Workload Repository is a repository of historical performance data. Beginning with Oracle GoldenGate 11g Release 2. Capturing changed data at the container level rather than at the individual databases reduces overhead. Memory and processes are required at the CDB level only. GoldenGate Downstream Capture is able to utilize the Data Guard redo log transport mechanism to process transactions off-source.
In Oracle Database 12c. The Delivery process can connect and apply changes to a single pluggable database. Should the primary site become unavailable. Users can restart the Oracle GoldenGate environment at the new primary site. To configure replication from multiple source pluggable databases to multiple target pluggable databases.
Oracle-GoldenGate-12c-Fundamentals-for-Oracle-D84357GC10-ag.pdf | Oracle Database | Sql
The Integrated Capture process must be configured to run at the root container as a common user in order to interact with the log mining server. Yet another alternative is to use one Integrated Capture writing to multiple trails. Consolidating into Private Cloud Oracle Data Integrator and Oracle GoldenGate can connect on-premise enterprise systems to a private cloud by moving data in bulk or as real-time transactions across geographies.
They are also essential to platform-as-a-service PaaS implementations because they support cloud deployments with data-layer application integration between on-premise and cloud environments. The new Oracle Database 12c release introduced new multitenant architecture. A failback option allows the IT team to test the target environment as long as necessary.
This trend brings the importance of implementing reliable real- time replication across the cloud and on-premises environments to make sure data remains fresh Data integration solutions play a vital role in migrating data simply. Integrating Public Cloud Environments with On Premises Systems The trend for enterprises to utilize both cloud-based and on-premises systems to host their database instances is increasing. Oracle GoldenGate 12c is optimized for Oracle Database 12c and supports its new multitenant architecture.
Lack of centralized monitoring and management causes extra work for system administrators. Oracle GoldenGate provides support for compression. Oracle GoldenGate offers real-time data replication between on premises databases and databases hosted on public cloud environments to enable reliable.
Data must remain fresh. For more information please review the knowledge article ID. Some of the key requirements in keeping the data fresh in hybrid environments include — minimal latency. Customer Examples As described earlier. The company used the solution to replicate its databases. Here are just a few of the many real-life examples of how customers have chosen to improve performance and enhance availability by implementing Oracle GoldenGate in an Oracle Database environment.
Reliability must be guaranteed despite system or connectivity issues that can occur between the cloud and on-premises instances. Credishop ensured high availability and high processing speed for both environments. With this combination. DBCA does not enable minimal supplemental during database creation.
Minimal supplemental logging only needs to be configured on the source database. It may be prudent to enable it on the target database as well. In both databases create a user schema called US In both databases grant the following permissions to the new user. As these are test databases, security is not an issue and therefore DBA privilege has been granted to the new user.
Start Listener Processes Before attempting to configure the network, ensure that the listener processes are running on both servers. ORA file on each server describing the database on the other server.Notice that you can substitute mgr for Manager, and you can add an exclamation mark! GUI-based configuration reduces human errors and enables rapid production of multi-server solutions from a central location.
Table of contents
Re starting the Manager created an MGR. This document is provided for information purposes only and the contents hereof are subject to change without notice. Using Oracle GoldenGate 12c for Oracle Database Architecture Overview The Oracle GoldenGate 12c architecture consists of decoupled modules that can be combined across the enterprise to provide maximum flexibility.
Oracles solution accelerated the companys reporting performance by three to ten times by integrating platforms, source systems, and operational data stores with Oracle GoldenGate. It is possible to capture from redo logs stored inside of ASM. It is also possible to download the Oracle GoldenGate documentation from the same screen.