RHEA-2024:1726 - Product Enhancement Advisory

Topic

Red Hat build of Debezium connectors in version 2.5.4 is now available for Red Hat Integration.

Description

Debezium is a distributed platform that turns your existing databases into event streams, so applications can see and respond immediately to each row-level change in the databases.

Debezium is built on top of Apache Kafka and provides Kafka Connect compatible connectors that monitor specific database management systems. Debezium records the history of data changes in Kafka logs, from where your application consumes them. This makes it possible for your application to easily consume all of the events correctly and completely. Even if your application stops unexpectedly, it will not miss anything: when the application restarts, it will resume consuming the events where it left off.

Solution

To apply this update just follow standard installation procedure

https://access.redhat.com/documentation/en-us/red_hat_integration/2024.q2/html/installing_debezium_on_openshift/index

https://access.redhat.com/documentation/en-us/red_hat_integration/2024.q2/html/installing_debezium_on_rhel/index

Affected Products

• Red Hat Integration Text-Only Advisories x86_64
• Red Hat Integration 1 x86_64

Fixes

• DBZ-3605 - Add support for XML_TYPE column type to Debezium connector for Oracle (LogMiner)
• DBZ-3642 - Debezium Outbox not working with CloudEventsConverter
• DBZ-3925 - Mysql connector fails to parse statement FLUSH FIREWALL_RULES
• DBZ-4321 - Explore BLOB support via re-selection
• DBZ-5350 - Oracle RAC throws ORA-00310: archive log sequence required
• DBZ-5359 - Add the API endpoint to expose running connector metrics
• DBZ-5464 - Snapshot result not saved if LAST record is filtered out
• DBZ-5518 - Define and document schema history topic messages schema
• DBZ-5656 - oracle missing CDC data
• DBZ-5676 - Align query.fetch.size across connectors
• DBZ-5750 - Missing oracle cdc records
• DBZ-6047 - Upgrade to Apache Kafka 3.5.0
• DBZ-6151 - Deprecate support for MongoDB 4.0 and 4.2
• DBZ-6182 - Don't require cluster-wide privileges when watching a single database/collection
• DBZ-6236 - PostgreSQL connector doesn't restart properly if database if not reachable
• DBZ-6240 - Provide by DDL type schema event filtering
• DBZ-6317 - JDBC Sink Connector - Support batch operations
• DBZ-6416 - Notify about initial snapshot progress
• DBZ-6417 - Make Signal actions extensible
• DBZ-6434 - NullPointerException in MongoDB connector
• DBZ-6458 - Only publish deltas instead of full snapshots to reduce size of sync event messages
• DBZ-6468 - Set Readpreference tags in the MongoDB client
• DBZ-6472 - MySqlSnapshotChangeEventSource parallel execute createSchemaEventsForTables
• DBZ-6481 - Postgres - Incremental snapshot fails on tables with an enum type in the primary key
• DBZ-6484 - JDBC Schema History: When the table name is passed as dbName.tableName, the connector does not start
• DBZ-6518 - Update mongodb incremental snapshot to allow multiple threads reading chunks
• DBZ-6521 - MongoDB change stream pipeline not respecting hard coded `readPreference=secondaryPreferred`
• DBZ-6566 - Support blocking ad-hoc snapshots
• DBZ-6567 - SMT for handling timezone conversions
• DBZ-6577 - Explain failure on existing publication update when switching to `filtered` from `all_tables`
• DBZ-6578 - Debezium should honor read preference from connection string
• DBZ-6595 - Use source field in topic in table.format.name
• DBZ-6602 - Support for getting primary key from header
• DBZ-6603 - Support for custom tags in the connector metrics
• DBZ-6615 - Max transaction duration for Oracle connector
• DBZ-6617 - Add shard field to events
• DBZ-6627 - Update docs for new shard field
• DBZ-6632 - Improve JDBC connector documentation
• DBZ-6635 - Debezium heartbeat.action.query does not start before writing to WAL.
• DBZ-6636 - Include only certain columns in JDBC sink connector
• DBZ-6637 - Received an unexpected message type that does not have an 'after' Debezium block
• DBZ-6641 - Schema name changed with Custom topic naming strategy
• DBZ-6653 - Add configurable timeout to initialization procedure
• DBZ-6654 - CloudEvents converter is broken for JSON message deserialization
• DBZ-6658 - Send tombstone events when partition queries are finished
• DBZ-6669 - Snapshot will not capture data when signal.data.collection is present without table.include.list
• DBZ-6676 - Update documentation on XML and RAW data types
• DBZ-6679 - Log Mining Processor advances SCN incorrectly if LogMiner query returns no rows
• DBZ-6682 - Wrong behavior of quote.identifiers in JdbcSinkConnector
• DBZ-6684 - Propagate source column name and allow sink to use it
• DBZ-6685 - Partition duplication after rebalances with single leader task
• DBZ-6686 - JDBC Sink Connector Fails on Loading Flat Data Containing Struct Type Fields from Kafka
• DBZ-6687 - SQLSyntaxErrorException using Debezium JDBC Sink connector
• DBZ-6689 - Make the Kafka channel consumer group ID configurable for the PostgreSQL connector
• DBZ-6700 - Missing operationTime field on ping command when executed against Atlas
• DBZ-6712 - schema.history.internal.store.only.captured.databases.ddl flag not considered while snapshot schema to history topic
• DBZ-6714 - Specify decimal precision in schema for MySQL unsigned bigints in precise mode
• DBZ-6715 - Refactor EmbeddedEngine::run method
• DBZ-6720 - Toasted UUID array is not properly processed
• DBZ-6726 - Utilize $changeStreamSplitLargeEvent to handle large change events with post and pre images
• DBZ-6727 - Support alternative JDBC drivers in MySQL connector
• DBZ-6731 - Blocking snapshot must take snapshot configurations from signal
• DBZ-6740 - Update Quarkus to 3.2.3.Final
• DBZ-6741 - Support custom authentication on MongoDB connector
• DBZ-6742 - Use JSON format for JMX Notification userData
• DBZ-6745 - SingleProcessor remove redundant filter logic
• DBZ-6748 - Debezium should convert _bin collate varchar columns to strings not byte arrays
• DBZ-6775 - Table schemas should be updated for each shard individually
• DBZ-6778 - Refactor ElapsedTimeStrategy
• DBZ-6782 - Oracle XML column types are not properly resolved when adding XMLTYPE column during streaming
• DBZ-6785 - Upgrade Kafka to 3.5.1
• DBZ-6786 - Use custom RowDeserializers in case of binlog compression
• DBZ-6787 - Incremental snapshot data-collections are not deduplicated
• DBZ-6788 - Document `mongodb.authentication.class`
• DBZ-6793 - Add timestamp to Notification
• DBZ-6801 - JDBC sink does not support SQL Server identity inserts
• DBZ-6811 - SqlServer connector send heartbeats when there is no change in the DB
• DBZ-6814 - Make finished partition deletion delay configurable.
• DBZ-6820 - Fix bug with getsnapshottingtask
• DBZ-6828 - Ad-hoc blocking snaps trigger emits schema changes of all tables
• DBZ-6831 - Error with propagation source column name
• DBZ-6834 - Provide INSERT/DELETE semantics for incremental snapshot watermarking
• DBZ-6835 - Docs for Timezone SMT
• DBZ-6843 - When using `skip.messages.without.change=true` a WARN log message is reported for each record
• DBZ-6844 - Support truncating large columns
• DBZ-6853 - Kafka offset store fails with NPE
• DBZ-6855 - JDBC Offset storage - configuration of table name does not work
• DBZ-6857 - JDBC sink insert fails with Oracle target database due to semicolon
• DBZ-6862 - Tombstone events causes NPE on JDBC connector
• DBZ-6864 - Debezium-MySQL not filtering AWS RDS internal events
• DBZ-6865 - Avoid getting NPE when executing the arrived method in ExecuteSnapshot
• DBZ-6869 - When the start_scn corresponding to the existence of a transaction in V$TRANSACTION is 0, log mining starts from the oldest scn when the oracle connector is started for the first time
• DBZ-6870 - Ensure that the connector can handle rebalance events robustly
• DBZ-6871 - ChangeStream aggregation pipeline fails on large documents which should be excluded
• DBZ-6873 - Add support for MySQL 8.2
• DBZ-6874 - Drop support for MySQL 5.7
• DBZ-6878 - Enhance Notification information and more notifications for Initial Snapshots
• DBZ-6881 - Deprecate MongoDB 4.4
• DBZ-6882 - Add support for MongoDB 7
• DBZ-6892 - Remove deprecated mongodb.hosts and mongodb.members.autodiscover properties
• DBZ-6893 - Migrate all examples from mongodb.hosts to mongodb.connection.string
• DBZ-6899 - Refactor Oracle streaming metrics beans
• DBZ-6907 - Setting "none" to "delete.handle.mode" is recommended
• DBZ-6911 - Support for PostgreSQL 16
• DBZ-6935 - fix logger named
• DBZ-6940 - Timezone Transformation can't work
• DBZ-6941 - MySQL Kafka Signalling documentation is incorrect
• DBZ-6945 - Drop events has wrong table changes information
• DBZ-6956 - Infinite loop when using OR condition in additional-condition
• DBZ-6958 - Wrong case-behavior for non-avro column name in sink connector
• DBZ-6966 - Filter out specified DDL events logic is reverted
• DBZ-6967 - Handle properly bytea field for jdbc sink to postgresql
• DBZ-6968 - Documentation for cursor.oversize.skip.threshold is missing units
• DBZ-6970 - Debezium jdbc sink process truncate event failure
• DBZ-6971 - DDL parser does not support NOCOPY keyword
• DBZ-6973 - Add MongoDB Connector support for `filtering.match.mode=regex|literal` property
• DBZ-6974 - Decrease time spent in handling rebalance events
• DBZ-6975 - Single quote replication includes escaped quotes for N(CHAR/VARCHAR) columns
• DBZ-6982 - Provide configuration option to exclude extension attributes from a CloudEvent
• DBZ-6983 - Add the ability to sanitize field name when inferencing json schema
• DBZ-6990 - Debezium jdbc sink should throw not supporting schema change topic exception
• DBZ-7015 - Enable replication slot advance check
• DBZ-7016 - Add configuration option to CloudEventsConverter to retrieve id and type from headers
• DBZ-7030 - DDL statement couldn't be parsed
• DBZ-7033 - Upgrade Kafka to 3.6.0
• DBZ-7035 - Blocking ad-hoc snapshot is not really blocking for MySQL
• DBZ-7037 - Fake ROTATE event on connection restart cleans metadata
• DBZ-7041 - Update documentation with Postgres's pgoutput limitation
• DBZ-7043 - Emit a notification when completed reading from a capture instance
• DBZ-7050 - Support snapshot with automatic retry
• DBZ-7058 - Field exclusion does not work with events of removed fields
• DBZ-7060 - Rename metadata.location ->metadata.source
• DBZ-7062 - Update transformation property "delete.tombstone.handling.mode" to debezium doc
• DBZ-7065 - JDBC sink connector not working with CloudEvent
• DBZ-7066 - The DefaultDeleteHandlingStrategy couldn't add the rewrite "__deleted" field to a non-struct value
• DBZ-7067 - Improve logging at DEBUG level for Commit events
• DBZ-7069 - JDBC connection leak when error occurs during processing
• DBZ-7071 - Replace schema tracking restriction for SYS/SYSTEM users with configurable option
• DBZ-7083 - Implement strategy pattern for MariaDB and MySQL differences
• DBZ-7093 - Check schema length when create value to find missed DDL by SQL_BIN_LOG=OFF
• DBZ-7095 - MySQL parser does not conform to arithmetical operation priorities
• DBZ-7108 - Switch default connection mode to shared for sharded clusters
• DBZ-7109 - Upgrade MSSQL JDBC driver to support sensitivity classification
• DBZ-7119 - Debezium crashes on parsing MySQL DDL statement (specific INSERT)
• DBZ-7132 - Failed to authenticate to the MySQL database after snapshot
• DBZ-7139 - MongoDB data collection filter requires replica set specification on blocking/initial snapshot execution
• DBZ-7140 - Debezium-ddl-parser crashes on parsing MySQL DDL statement (specific UNION)
• DBZ-7141 - Remove deprecated ComputePartition SMT
• DBZ-7142 - outbox.EventRouter SMT throws NullPointerException when there is a whitespace in fields.additional.placement value
• DBZ-7146 - Inactivity pause in MongoDB connector should be configurable
• DBZ-7152 - Debezium-ddl-parser crashes on parsing MySQL DDL statement (specific UPDATE)
• DBZ-7157 - JsonSerialisation is unable to process changes from sharded collections with composite sharding key
• DBZ-7159 - Fail fast during deserialization if a value is not a CloudEvent
• DBZ-7162 - Add last event process time, number of events, number of heartbeat events metrics to MongoDb connector
• DBZ-7164 - Support persistent history for snapshot requests for the kafka signal topic.
• DBZ-7177 - Change metrics endpoint of Connect REST Extensions to use the MBeanServerv directly instead of HTTP calls to the Jolokia endpoint
• DBZ-7178 - Metrics endpoint must handle connectors with multiple tasks (SQL Server)
• DBZ-7179 - Fix DebeziumMySqlConnectorResource not using the new MySQL adatper structure to support different MySQL flavors
• DBZ-7181 - Support logical decoding from Postgres 16 stand-bys
• DBZ-7183 - Support MySQL 8 high resolution replication timestamps from GTID events
• DBZ-7184 - Use buffer queue when reading MongoDB change stream events
• DBZ-7186 - Cleanup event processing loop in streaming event source of MongoDB connector
• DBZ-7189 - Parsing MySQL indexes for JSON field fails, when casting is used with types double and float
• DBZ-7191 - JDBC connector wrongly uses default value when value is NULL on optional fields
• DBZ-7193 - Unchanged toasted array columns are substituted with unavailable.value.placeholder, even when REPLICA IDENTITY FULL is configured.
• DBZ-7194 - Enable ability to stream changes against Oracle 23c for LogMiner
• DBZ-7196 - Add modify range_partitions to modify_table_partition rule in parsing PL/SQL
• DBZ-7197 - Add ability to avoid throwing an exception for missing additional fields
• DBZ-7206 - MongoDB streaming pauses for Blocking Snapshot only when there is no event
• DBZ-7208 - Handle Drop Tablespace in PL/SQL
• DBZ-7213 - DDL GRANT statement couldn't be parsed
• DBZ-7216 - When metadata is in headers, a schema name of a structure in CE `data` field is incorrect
• DBZ-7217 - Add tracing logs to track execution time for Debezium JDBC connector
• DBZ-7218 - Validate & clarify multiple archive log destination requirements for Oracle
• DBZ-7230 - MySQL BIT Type should have a default length 1
• DBZ-7235 - Add configuration option to CloudEventsConverter to customize schema type name
• DBZ-7236 - Oracle abandoned transaction implementation bug causes OoM
• DBZ-7237 - Oracle LOB to be properly ignored if lob.enabled=false
• DBZ-7242 - Add Grammar Oracle Truncate Cluster
• DBZ-7251 - Length value is not removed when changing a column's type
• DBZ-7252 - MongoDB table/colelction snapshot notification contain incorrect offsets
• DBZ-7257 - Debezium Oracle plugin 2.5.0 Beta does not support Oracle 11g
• DBZ-7259 - Debezium-ddl-parser crashes on parsing MySQL DDL statement (subquery with UNION)
• DBZ-7264 - Error during snapshot with multiple snapshot threads will not properly abort snasphostting
• DBZ-7268 - Add PL/SQL Parser for Alter Table Memoptimize
• DBZ-7271 - MySQL RDS UPDATE queries not ignored
• DBZ-7272 - Guard against implicit offset invalidation caused by switch of default connection mode
• DBZ-7275 - Leaking JDBC connections
• DBZ-7277 - Debezium MySQL could not parse certain grant privileges.
• DBZ-7279 - Add PL/SQL Parser for Create Table Memoptimize
• DBZ-7283 - Support for Creating EDITIONABLE or NONEDITIONABLE Packages
• DBZ-7299 - MongoDb connector doesn't use post-images
• DBZ-7311 - PostgreSQL ad-hoc blocking snapshots fail when snapshot mode is "never"
• DBZ-7312 - Ad-hoc blocking snapshot dies with "invalid snapshot identifier" immediately after connector creation
• DBZ-7315 - Specifying a table include list with spaces between elements cause LogMiner queries to miss matches
• DBZ-7316 - Debezium heartbeat.action.query does not start before writing to WAL: part 2
• DBZ-7347 - Initial snapshot notifications should use full identifier.
• DBZ-7358 - Re-select columns should use the table's primary instead of the event's key
• DBZ-7359 - Full incremental snapshot on SQL Server Table skipping block of 36 records
• DBZ-7360 - Debezium fails after table split operation
• DBZ-7374 - MSSQL wrong default values in db schema for varchar, nvarchar, char columns
• DBZ-7379 - Support connector scoped trustore/keystore for MongoDB
• DBZ-7420 - ParsingException (MariaDB Only): alterSpec drop foreign key with 'tablename.' prefix
• DBZ-7421 - Poor performance with incremental snapshot with long list of tables
• DBZ-7425 - Oracle Snapshot mistakenly uses LogMiner Offset Loader by default
• DBZ-7429 - Reselect columns should source key values from after Struct when not using event-key sources
• DBZ-7431 - Allow the C3P0ConnectionProvider to be customized via configuration
• DBZ-7436 - Stopwatch throw NPE when toString is called without having statistics
• DBZ-7437 - ReselectColumnsPostProcessor filter not use exclude predicate
• DBZ-7441 - Adhoc snapshots are not triggered via File channel signal when submitted before the start of the application
• DBZ-7445 - LogMiner batch size does not increase automatically
• DBZ-7456 - Oracle connector does not ignore reselection for excluded clob/blob columns
• DBZ-7460 - The expected value pattern for table.include.list does not align with the documentation
• DBZ-7467 - Signals actions are not loaded for SQLServer
• DBZ-7468 - MySQL connector cannot parse table with WITH SYSTEM VERSIONING PARTITION BY SYSTEM_TIME
• DBZ-7479 - PreparedStatement leak in Oracle ReselectColumnsProcessor
• DBZ-7488 - Poor snapshot performance with new reselect SMT
• DBZ-7489 - Debezium Oracle Connector ParsingException on XMLTYPE with lob.enabled=true
• DBZ-7500 - Fix MySQL 8 event timestamp resolution logic error where fallback to seconds occurs erroneously for non-GTID events
• DBZ-7562 - Numeric default value decimal scale mismatch
• DBZ-7567 - Fix null event timestamp possible from FORMAT_DESCRIPTION and PREVIOUS_GTIDS events in MySqlStreamingChangeEventSource::setEventTimestamp
• DBZ-7581 - Improved logging in case of PostgreSQL failure
• DBZ-7582 - Unavailable Toasted HSTORE Json Storage Mode column causes serialization failure
• DBZ-7593 - Deploying Debezium for the first time, it not captures the schema of all tables in the database.
• DBZ-7594 - Incorrect value of TIME(n) replicate from MySQL if the original value is negative
• DBZ-7596 - Re-select Post Processor not working for complex types
• DBZ-7599 - Null instead of toast placeholder written for binary types when "hex" mode configured
• DBZ-7608 - Poor snapshot performance during schema snapshot DDL processing
• DBZ-7611 - Re-select post processor performance
• DBZ-7617 - Incremental snapshot query doesn't honor message.key.columns order
• DBZ-7619 - Metric ScnFreezeCount never increases
• DBZ-7643 - Numerci value without mantissa cannot be parsed
• DBZ-7647 - Add documentation for MongoDB capture.mode.full.update.type property
• DBZ-7666 - MySQL connector fails to parse DDL with RETURNING keyword
• DBZ-7690 - Schema history comparator doesn't handle SERVER_ID_KEY and TIMESTAMP_KEY properly

CVEs

(none)

References

(none)