Chapter 4. Debezium release notes

Red Hat Integration 2020-Q3 includes a General Availability release of Debezium on OpenShift based on the Debezium open source project. Debezium is a distributed change data capture platform that tracks database operations and streams data change events. Debezium is built on Apache Kafka and is deployed and integrated with AMQ Streams.

Debezium captures row-level changes to database tables and passes corresponding change event records to AMQ Streams. Applications can read these change event streams and access the change events in the order in which they occurred.

The following topics provide release details:

4.1. Debezium database connectors

Debezium provides connectors based on Kafka Connect for the following common databases:

  • MySQL
  • PostgreSQL
  • MongoDB
  • SQL Server
  • Db2 - this is a Technology Preview release.

4.2. Supported database versions for Debezium

When trying out the database connectors, the following database versions are supported for this release:

DatabaseVersions

MySQL

5.7, 8.0

PostgreSQL *

10, 11, 12

MongoDB

3.6, 4.0, 4.2 **

SQL Server

2017, 2019

Db2

11.5.0.0

*For PostgreSQL deployments, you use the pgoutput logical decoding output plug-in, which is the default for PostgreSQL versions 10 and later.

**When using the Debezium connector for MongoDB, there is a limitation if you are using MongoDB 4.2. The limitation is that you cannot use the connector’s transaction metadata feature. This limitation is expected to be removed in a future release.

Additional resources

4.3. Debezium installation options

You can install Debezium with AMQ Streams on OpenShift or RHEL:

Important

Technology Preview features are not supported with Red Hat production service-level agreements (SLAs) and might not be functionally complete. Red Hat does not recommend implementing any Technology Preview features in production environments. This Technology Preview feature provides early access to upcoming product innovations, enabling you to test functionality and provide feedback during the development process. For more information about support scope, see Technology Preview Features Support Scope.

4.4. New Debezium features

This release provides the following new Debezium features:

  • Schema change topic - The SQL Server connector now emits events that capture schema updates to a schema change topic.

This release provides the following Technology Preview features:

  • Debezium Db2 connector.
  • Content-based router single message transformation (SMT) for re-routing data change event records to topics based on event content.
  • Filter SMT that evaluates an expression for each change event and drops or emits the event based on the evaluation result.
  • CloudEvents converter for emitting change event records that conform to the CloudEvents specification. Avro encoding type is now supported for the CloudEvents envelope structure.
  • Avro serialization - You can configure Debezium connectors to use Avro to serialize message keys and values.
  • Outbox event router SMT that supports the outbox pattern for safely and reliably exchanging data between multiple (micro) services.