RHEA-2022:5682 - Product Enhancement Advisory

Topic

Debezium connectors in version 1.9.4 are now available for Red Hat Integration.

Description

Debezium is a distributed platform that turns your existing databases into event streams, so applications can see and respond immediately to each row-level change in the databases.

Debezium is built on top of Apache Kafka and provides Kafka Connect compatible connectors that monitor specific database management systems. Debezium records the history of data changes in Kafka logs, from where your application consumes them. This makes it possible for your application to easily consume all of the events correctly and completely. Even if your application stops unexpectedly, it will not miss anything: when the application restarts, it will resume consuming the events where it left off.

Solution

To apply this update just follow standard installation procedure

• https://access.redhat.com/documentation/en-us/red_hat_integration/2022.q2/html/installing_debezium_on_openshift/index
• https://access.redhat.com/documentation/en-us/red_hat_integration/2022.q2/html/installing_debezium_on_rhel/index

Affected Products

• Red Hat Integration Text-Only Advisories x86_64
• Red Hat Integration 1 x86_64

Fixes

• DBZ-1042 - PostgresConnector does not allow a numeric slot name
• DBZ-1297 - Expose outbox event structure at level of Kafka Connect messages
• DBZ-1344 - False empty schema warning for snapshot mode never
• DBZ-1539 - Improve interval type support in Oracle
• DBZ-1847 - No option fullDocument for the connection to MongoDB oplog.rs
• DBZ-1931 - money data type should be controlled by decimal.handling.mode
• DBZ-2097 - Support Knative Eventing
• DBZ-2224 - Migrate logger used for tests to Logback
• DBZ-2306 - Long running transaction in Debezium 1.2.0 (PostgreSQL)
• DBZ-2363 - Support pg_logical_emit_message
• DBZ-2514 - Add support for Cassandra 4.x
• DBZ-2546 - Make antora playbook_author.yml use current branch
• DBZ-2594 - OpenShift deployment instruction improvements
• DBZ-2646 - Add Kubernetes version of deployment page
• DBZ-2792 - Parallel write can be lost during catch-up phase
• DBZ-2793 - Document "schema.include.list"/"schema.exclude.list" for SQL Server connector
• DBZ-2975 - Support for Multiple Databases per SQL Server Connector
• DBZ-3108 - nulls for some MySQL properties in the connector-types backend response
• DBZ-3143 - Use main repo workflow for CI/CD checks in Debezium UI repository checks
• DBZ-3306 - Intermittent test failure: SqlServerChangeTableSetIT#readHistoryAfterRestart()
• DBZ-3317 - Align decimal.handling.mode documentation for Oracle like other connectors
• DBZ-3342 - Implement incremental snapshotting for MongoDB
• DBZ-3517 - Support Kerberos for Debezium MS SQL plugin
• DBZ-3528 - Outbox Event Router for MongoDB
• DBZ-3535 - SchemaNameAdjuster is too restrictive by default
• DBZ-3541 - MySQL connector fails to parse default integer value expressed as decimal
• DBZ-3552 - Allow to configure custom Hibernate user types for Quarkus outbox extension
• DBZ-3570 - Debezium server stops with wrong exit code (0)
• DBZ-3611 - "table" is null for table.include.list and column.include.list
• DBZ-3626 - Rename "master" branches to "main" for remaining repos
• DBZ-3657 - NPE on PostgreSQL Domain Array
• DBZ-3679 - Database.include.list results in tables being returned twice
• DBZ-3691 - Re-enable building PostgreSQL alpine images
• DBZ-3697 - Add schema descriptors for the UI JSON Schema for SQL Server Connector
• DBZ-3700 - MysqlSourceConnector issue with latin1 tables
• DBZ-3708 - Debezium server crashes when deleting a record from a SQLServer table (redis sink)
• DBZ-3710 - Invalid default value error on captured table DDL with default value
• DBZ-3762 - Exclude dummy events from database history
• DBZ-3785 - Upgrade to Quarkus 2.2.3.Final
• DBZ-3786 - Tutorial shows incorrectly shows "op": "c" for initial change events
• DBZ-3807 - Debezium build is unstable for Oracle connector
• DBZ-3848 - Connector throws java.lang.ArrayIndexOutOfBoundsException
• DBZ-3872 - Possible performance issue after Debezium 1.6.1 upgrade (from 1.5)
• DBZ-3874 - Add a backend service for UI to fetch the SMT and topic auto-creation configuration properties
• DBZ-3881 - Update downstream docs in regards to deprecated elements
• DBZ-3895 - Make "snapshot.include.collection.list" case insensitive like "table.include.list"
• DBZ-3897 - Add canonical URL links to older doc versions
• DBZ-3907 - Publish website-builder and tooling images once per week
• DBZ-3919 - Intermittent test failure on CI - RecordsStreamProducerIT#shouldReceiveHeartbeatAlsoWhenChangingNonWhitelistedTable()
• DBZ-3929 - Support Oracle Logminer docker image in system level test-suite
• DBZ-3938 - Set up testing job for MongoDB 5.0
• DBZ-3940 - Outbox Event Router not working in Oracle Connector
• DBZ-3942 - Incorrect loading of LSN from offsets
• DBZ-3949 - Log DML replication events instead of throwing an error
• DBZ-3952 - "snapshot.include.collection.list" doesn't work with the new MySQL connector implementation
• DBZ-3953 - Deprecate wal2json support
• DBZ-3963 - Oracle testing in system-level testsuite
• DBZ-3966 - TableChangesSerializer ignored defaultValue and enumValues
• DBZ-3980 - Upgrade Jenkins and Introduce JCasC to jnovotny
• DBZ-3986 - [oracle] Add the SCHEMA_ONLY_RECOVERY snapshot mode
• DBZ-3989 - Error processing binlog event
• DBZ-3991 - Update connector documentation to reflect new deployment mechanism
• DBZ-3992 - SQL Server fails to read CDC events if there is a schema change ahead
• DBZ-3993 - Upgrade Java version for GH actions
• DBZ-3997 - Broken links to the Transaction metadata topics from descriptions for provide.transaction.metadata property
• DBZ-4000 - Support parse table and columns comment
• DBZ-4005 - Replace hard-coded version of MySQL example image with getStableVersion()
• DBZ-4014 - Document kafka-connect-offset related properties
• DBZ-4028 - Create Debezium Kafka Connect REST Extension
• DBZ-4029 - Support for heartbeat action queries for MySQL
• DBZ-4032 - Crash processing MariaDB DATETIME fields returns empty blob instead of null (Snapshotting with useCursorFetch option)
• DBZ-4033 - column.the mask.hash.hashAlgorithm.with.... data corruption occurs when using this feature
• DBZ-4034 - Compilation of MySQL grammar displays warnings
• DBZ-4035 - Upgrade to Quarkus 2.5.0.Final
• DBZ-4045 - Upgrade to Apache Kafka 3.0
• DBZ-4046 - Upgrade postgres JDBC driver to version 42.2.24
• DBZ-4052 - Review SqlServerConnector properties
• DBZ-4063 - Add script to check for missing backports
• DBZ-4065 - Recreate webhook for linking PRs to JIRA issues
• DBZ-4066 - Change Debezium UI configurations property names
• DBZ-4068 - Extra double quotes on Kafka message produced by Quarkus Outbox Extension
• DBZ-4071 - Recipient email address should be a variable in all Jenkins jobs
• DBZ-4072 - Protect release from using invalid version name
• DBZ-4073 - Allow [ci] tag as commit message prefix
• DBZ-4074 - Debezium Docker build job fails on rate limiter
• DBZ-4075 - Add Postgresql 14 container image (Alpine)
• DBZ-4077 - Expose the transaction topicname as a config
• DBZ-4078 - Connection failure while reading chunk during incremental snapshot
• DBZ-4079 - Add Postgresql 14 container image
• DBZ-4080 - Postgres 12/13 images are not buildable
• DBZ-4082 - Test failure: SchemaHistoryTopicIT::schemaChangeAfterSnapshot()
• DBZ-4083 - CloudEventsConverter omits payload data of deleted documents
• DBZ-4084 - Fail Docker build scripts on error
• DBZ-4107 - Incremental snapshot doesn't work without primary key
• DBZ-4110 - Display commit SHA in page footer
• DBZ-4111 - projectId not being set when injecting a custom PublisherBuilder
• DBZ-4112 - Handle large comparisons results from GH API to address missing authors in release workflow
• DBZ-4113 - Add debezium-connect-rest-extension module to GH workflows
• DBZ-4114 - Support JSON logging formatting
• DBZ-4117 - Upgrade to Quarkus 2.6.2.Final
• DBZ-4119 - Once user click on "Review and finish" button that step in link in not enabled in wizard side menu.
• DBZ-4121 - Can't parse DDL for View
• DBZ-4122 - Jenkins job for creating image snapshot used by new Jenkins nodes
• DBZ-4123 - Display commit SHA in documentation footer
• DBZ-4128 - Add Debezium Kafka Connect REST Extension to Debezium Kafka Connect NIGHTLY container image
• DBZ-4131 - Use Postgres 10 by default
• DBZ-4140 - Oracle connector throws NPE during streaming in archive only mode
• DBZ-4142 - Migrate from Gitter to Zulip
• DBZ-4145 - Postgres module build times out after 6h on CI
• DBZ-4146 - Use SMT/Transformation UI backend endpoint
• DBZ-4147 - debezium-api and debezium-core jars missing in NIGHTLY Kafka Connect container image libs dir
• DBZ-4148 - Use topic auto-creation UI backend endpoint
• DBZ-4150 - Trim numerical defaultValue before converting
• DBZ-4152 - Upgrade mysql-binlog-connector-java to v0.25.4
• DBZ-4153 - Wrong class name in SMT predicates documentation
• DBZ-4164 - Close open file handle
• DBZ-4165 - Outreach jobs should test all connectors
• DBZ-4167 - Debezium 1.7 image disables unsecure algorithms. Breaks unpatched databases
• DBZ-4169 - Extend configuration support for Infinispan caches
• DBZ-4170 - DDL Statement couldn't be parsed
• DBZ-4171 - Suspected inconsistent documentation for 'Ad-hoc read-only Incremental snapshot'
• DBZ-4172 - Improvement to the topic creation step
• DBZ-4181 - In multiple connect clusters monitoring, no matter which cluster is selected from the dropdown list, the detailed information is always for the first cluster.
• DBZ-4184 - Remove MINUSMINUS operator
• DBZ-4185 - Oracle upstream tests in internal CI
• DBZ-4190 - Add Redis to debezium-server-architecture.png
• DBZ-4191 - wrong variable naming in an unit test for Outbox Event Router SMT
• DBZ-4192 - MongoDB connector support user defined topic delimiter
• DBZ-4193 - Parse the "window" keyword for agg and nonagg function in mysql8
• DBZ-4195 - Missing debezium/postgres:14-alpine in Docker Hub
• DBZ-4196 - Support schema changes during incremental snapshot
• DBZ-4199 - Broken link in MySQL docs
• DBZ-4200 - Remove superfluous build triggers
• DBZ-4201 - wrong field on change event message example in MongoDB Connector documentation
• DBZ-4205 - Complete CDC implementation based on MongoDB Change Streams
• DBZ-4206 - DDL with Oracle SDO_GEOMETRY cannot be parsed
• DBZ-4208 - DDL with Oracle sequence as default for primary key fails schema generation
• DBZ-4214 - Create GH Action for tearing down abandoned website preview environments
• DBZ-4225 - The lastOffset variable in MySqlStreamingChangeEventSource is always null
• DBZ-4227 - Ability to use base image from authenticated registry with KC build mechanism
• DBZ-4231 - Remove SqlServerConnector database.user Required Validator
• DBZ-4232 - Unknown entity: io.debezium.outbox.quarkus.internal.OutboxEvent
• DBZ-4235 - QE jenkins jobs consolidation
• DBZ-4236 - Unify Memory and Infinispan event processor implementations
• DBZ-4238 - Tag debezium/tooling:1.2 version
• DBZ-4240 - Oracle connector parses NUMBER(*,0) as NUMBER(0,0) in DDL
• DBZ-4241 - Rework MySqlTimestampColumnIT test
• DBZ-4242 - Specify database hot name as 0.0.0.0 for Oracle connector tests CI
• DBZ-4244 - Signal based incremental snapshot is failing if database name contains dash
• DBZ-4245 - SQL Server connector doesn't handle retriable errors during database state transitions
• DBZ-4246 - Does Debezium support database using charset GB18030?
• DBZ-4249 - Optionally add OPTION(RECOMPILE) to incremental snapshot queries
• DBZ-4252 - Remove unused code
• DBZ-4254 - Broken anchors in Debezium Documentation
• DBZ-4257 - When Debezium executes `select *` in the snapshot phase, it does not catch the sql exception, resulting in confusing exceptions and logs
• DBZ-4258 - Optimize tooling image
• DBZ-4260 - Record video demo showing Kafka topics creation and transformation UIs
• DBZ-4261 - Suport all charsets in MySQL parser
• DBZ-4267 - Update system-level testsuite CI job
• DBZ-4268 - Change DB2 image in testsuite to use private registry
• DBZ-4273 - SQL Server connector doesn't handle multiple capture instances for the same table with equal start LSN
• DBZ-4274 - Debezium UI - some issues with browser support for replaceAll
• DBZ-4275 - AbstractDatabaseHistory.java has typo
• DBZ-4279 - OracleConnectorIT - two tests fail when using Xstream
• DBZ-4285 - Handle login failure during instance upgrade as retriable
• DBZ-4287 - Handle out of order transaction start event
• DBZ-4289 - Only build debezium-core and dependences in cross-repo builds
• DBZ-4291 - Reduce log verbosity
• DBZ-4293 - Topic Group UI step does not refresh correctly after setting properties
• DBZ-4294 - Random test failure - ZZZGtidSetIT#shouldProcessPurgedGtidSet
• DBZ-4295 - Vitess connector should expose vstream flags
• DBZ-4296 - Rhel preparation jenkins job pushes extra image
• DBZ-4297 - Vitess connector should allow client to config starting VGTID
• DBZ-4299 - Layout glitch on docs landing page
• DBZ-4300 - Point to supported versions in connector pages
• DBZ-4301 - Improve rendering of linked option names
• DBZ-4302 - Provide outbox routing example for MongoDB
• DBZ-4304 - Add MariaDB specific username for MySQL parser
• DBZ-4305 - Verify compatibility with Oracle 21c (21.3.0.0.0)
• DBZ-4311 - Fix wrong option names in examples
• DBZ-4314 - Add metadata to OracleConnectorConfig for Debezium UI
• DBZ-4316 - Update functional test CI to work with downstream source archive
• DBZ-4317 - Allow for additional custom columns in an outbox table
• DBZ-4318 - Modify the type of aggregateid in MongoDB Outbox Event Router
• DBZ-4324 - Remove vtctld dependency in Vitess connector
• DBZ-4326 - Provide example showing usage of remote Infinispan cache
• DBZ-4327 - Provide CI for MongoDB 4.4
• DBZ-4330 - Explicit the MS SQL Materialized view limitation
• DBZ-4334 - Convert mysql time type default value error
• DBZ-4337 - Wrong configuration option name for MongoDB Outbox SMT
• DBZ-4341 - Log count of changed records sent
• DBZ-435 - Provide MongoDB CDC implementation based on 4.0 change streams
• DBZ-4351 - Add create/update/delete event seen metrics for monitor upstream dml operation
• DBZ-4353 - Test case for schema migration in Vitess connector
• DBZ-4355 - Enable transaction metadata for vitess connector
• DBZ-4360 - Oracle connector - Cannot parse column default value 'NULL ' to type '2'
• DBZ-4364 - io.debezium.data.VerifyRecord.isValid(SourceRecord) is a no-op
• DBZ-4366 - Oracle Logminer: LOB truncated in streaming mode
• DBZ-4367 - Oracle Logminer: snapshot->stream switch misses DB changes in ongoing transactions
• DBZ-4370 - SignalsIT times out after 6h on CI
• DBZ-4371 - Log problematic values if they cannot be processed
• DBZ-4373 - Run Jenkins CI on weekends too
• DBZ-4374 - Update Postgres JDBC driver to 42.3.1
• DBZ-4375 - Allow additional config options for Debezium Server Pubsub Connector
• DBZ-4376 - NullPointer exception on Final stage of snapshot for Oracle connector
• DBZ-4377 - Oracle pipeline matrix docker conflict
• DBZ-4378 - Debezium UI - Connector create fails if topic group defaults not specified
• DBZ-4382 - System testsuite unable to pull apicurio operator from quay
• DBZ-4383 - Release pipeline should use Jira API token
• DBZ-4385 - Add support for truncate in oracle connector
• DBZ-4386 - Upgrade impsort-maven-plugin from 1.6.0 to 1.6.2
• DBZ-4387 - Upgrade formatter-maven-plugin from 2.15.0 to 2.16.0
• DBZ-4388 - Oracle DDL Parser Error
• DBZ-4389 - VStream gRPC connection closed after being idle for a few minutes
• DBZ-4391 - Unstable test for online DDL changes
• DBZ-4392 - Use Red Hat Maven repo for custom build image in docs
• DBZ-4393 - Create a Debezium schema generator for Debezium connectors (initial work)
• DBZ-4394 - Build and deploy Debezium OpenAPI / JSON Schema definitions with every Debezium release
• DBZ-4397 - MySQL: DDL Statement could not be parsed 'GRANT'
• DBZ-4400 - Support binary_handling_mode for Oracle connector
• DBZ-4402 - Support keyword CHAR SET for defining charset options
• DBZ-4403 - Fix issues with blob and uint64 types in Vitess connector
• DBZ-4404 - Allow adhoc snapshots using signals in Oracle versions prior to 12c
• DBZ-4408 - Remove log.mining.log.file.query.max.retries configuration property
• DBZ-4409 - Enforce consistent vgtid representation in vitess connector
• DBZ-4412 - Fix source fields and keyspace field in vitess connector
• DBZ-4413 - MongoDB ExtractNewDocumentState SMT overwrites existing document ID field
• DBZ-4415 - Fail MongoDB start when oplog is used for MongoDB 5+
• DBZ-4419 - Deprecated TruncateHandlingMode config property in favor of skipped_operations
• DBZ-4420 - Document MongoDB source format
• DBZ-4423 - Simplify the implementation of method duration in debezium/util/Strings.java
• DBZ-4426 - Missing log message for snapshot.locking.mode = none
• DBZ-4428 - Clean up "source" strucure for Vitess connector
• DBZ-4429 - Caching not working in formatting job
• DBZ-4430 - Promote Outbox Quarkus extension to stable
• DBZ-4436 - Restructure Oracle connector documentation
• DBZ-4438 - Add Debezium Server example using Postgres and Pub/Sub
• DBZ-4440 - Use images from quay.io in docs and examples
• DBZ-4451 - Database history recovery will retain old tables after they've been renamed
• DBZ-4452 - Exclude log4j from Debezium Server distribution in 1.8
• DBZ-4457 - JSON Payload not expanding when enabling it
• DBZ-4459 - Introduce interfaces and default implementations for change event source metrics
• DBZ-4460 - Create a Debezium schema generator for Debezium connectors (follow-up work)
• DBZ-4461 - Document Outbox SMT behaviour with postgres bytea_output = escape
• DBZ-4462 - Run formatting check in the same connector/module workflows
• DBZ-4463 - Upgrade SQL Server driver to 9.4
• DBZ-4464 - Add snapshot repository to Vitess connector
• DBZ-4465 - Kafka Connect REST extension cannot be built with 1.9
• DBZ-4466 - REST extension tests must not depend on source code version
• DBZ-4467 - snapshotPreceededBySchemaChange should not be tested for Db2
• DBZ-4468 - Debezium Server workflow should build PG connector without tests
• DBZ-4469 - PostgresShutdownIT must not depend on Postgres version
• DBZ-4472 - Make connector task partition readability for logs
• DBZ-4473 - Remove unused brackets in MySqlParser
• DBZ-4478 - Partition-scoped metrics for the SQL Server connector
• DBZ-4485 - DDL statement couldn't be parsed
• DBZ-4486 - Updating jenkins job creating image snapshots
• DBZ-4494 - Document DB permissions for Oracle Connector
• DBZ-4497 - Parse multiple signed/unsigned keyword from ddl statement failed
• DBZ-4499 - Enable Oracle connector to execute INITIAL_ONLY snapshot.mode
• DBZ-4500 - Set the correct binlog serverId & threadId
• DBZ-4501 - Null out query in read-only incremental snapshot
• DBZ-4502 - R/O incremental snapshot can blocks the binlog stream on restart
• DBZ-4503 - Drop the primary key column getting exception
• DBZ-4504 - [MySQL Debezium] DDL Parsing error - curdate() & cast()
• DBZ-4506 - Set jenkins jobs to store last 10 builds
• DBZ-4507 - Extra file checker-qual in PostgreSQL package
• DBZ-4508 - website-builder image is not buildable
• DBZ-4509 - Save and load offsets in Redis
• DBZ-4510 - Redis sink - Retry in case of connection error/OOM
• DBZ-4511 - Ability to support all Redis connection schemes
• DBZ-4513 - Provide a script to generate release notes section
• DBZ-4514 - Remove INTERNAL_KEY_CONVERTER and INTERNAL_VALUE_CONVERTER env vars
• DBZ-4516 - Job for creating gold image not reading credentials correctly
• DBZ-4517 - Replication stream retries are not configured correctly
• DBZ-4518 - Make KAFKA_QUERY_TIMEOUT configurable
• DBZ-4520 - Add backend errors among retriable for Postgres connector
• DBZ-4526 - Infinispan doesn't work with underscores inside cache names
• DBZ-4527 - Bump protobuf version to the latest 3.x
• DBZ-4528 - Document automatic log-switch setting for low-frequency change systems
• DBZ-4532 - Add support for extra gRPC headers in Vitess connector
• DBZ-4536 - Mining session stopped due to 'No more data to read from socket'
• DBZ-4537 - Organize properties of Db2 connector
• DBZ-4538 - Connector list should update immediately when a connector is deleted
• DBZ-4539 - Update release procedure to cover required documentation config changes
• DBZ-4540 - Mongo filters page show nulls in namespace name
• DBZ-4541 - A failure to register JMX metrics should fail the connector
• DBZ-4542 - LogMinerHelperIT fails when running Oracle CI with a fresh database
• DBZ-4544 - Module debezium-testing-testcontainers tests are not executed
• DBZ-4546 - Oracle-Connector fails parsing a DDL statement (VIRTUAL keyword)
• DBZ-4547 - MySQL history topic creation needs DESCRIBE_CONFIGS at the Cluster level
• DBZ-4548 - DatabaseVersionResolver comparison logic skips tests unintendedly
• DBZ-4552 - Fix links to connector incremental snapshots topic
• DBZ-4553 - io.debezium.text.ParsingException when column name is 'seq'
• DBZ-4558 - Create trigger job for connector jobs
• DBZ-4559 - Vitess connector image cannot be built
• DBZ-4561 - MySQL `FLUSH TABLE[S]` with empty table list not handled
• DBZ-4562 - Reduce GitHub action build times with formatting
• DBZ-4563 - Doc updates to address downstream build issues
• DBZ-4565 - Debezium apicurio version is not aligned with Quarkus
• DBZ-4566 - Debezium Engine should use topic names for conversion
• DBZ-4567 - Oracle built-in schema exclusions should also apply to DDL changes
• DBZ-4568 - Remove CVE affected files from log4j 1.x JAR
• DBZ-4569 - Upgrade Avro converter to 7.0.1 and Apicurio to 2.1.5.Final
• DBZ-4570 - Simplify and clean up system testsuite job
• DBZ-4571 - Older degree of parallelism DDL syntax causes parsing exception
• DBZ-4575 - mongo-source-connector config database.include.list does not work
• DBZ-4577 - Allow user to define custom retriable message
• DBZ-4580 - Avoid build warning about maven-filtering missing plugin descriptor
• DBZ-4581 - Fix build failure when xstream missing when building the micro benchmark for Oracle
• DBZ-4582 - Update shared UG deployment file to clarify that connectors can use existing KC instance
• DBZ-4583 - Can't process column definition with length exceeding Integer.MAX_VALUE
• DBZ-4584 - Incremental snapshots does not honor column case sensitivity
• DBZ-4585 - Implement Renovate to fix legacy-peer-deps issue with npm
• DBZ-4588 - Restructure documentation for custom converters
• DBZ-4589 - Typo in connect README
• DBZ-4592 - Test Failure - RecordsStreamProducerIT
• DBZ-4595 - Unsupported column type 'ROWID' error
• DBZ-4597 - Oracle connector can't find the SCN
• DBZ-4600 - Allow mongodb-connector to decode Binary payloads
• DBZ-4601 - Extract component preparation from test-suite job
• DBZ-4602 - Cleanup project management in testsuite job
• DBZ-4603 - Improve documentation about max_replication_slots
• DBZ-4605 - JSON data corrupted in update events
• DBZ-4606 - Connector doc formatting and link fixes
• DBZ-4609 - nCaused by: Multiple parsing errors\nio.debezium.text.ParsingException: DDL statement couldn't be parsed. Please open a Jira
• DBZ-4610 - Upgrade Kafka to 3.1.0
• DBZ-4611 - Jenkins job for creating image snapshot does not update gitlab certificate correctly
• DBZ-4613 - Server transformation properties should refer to "type" rather than "class"
• DBZ-4622 - When running the NPM build I always end up with an updated/diverged package-lock.json
• DBZ-4623 - Release pipeline should check existence of GA version
• DBZ-4624 - Release pipeline - conditionalize and parameterize backport check
• DBZ-4628 - Debezium Deploy Snapshots job is blocked for a long time
• DBZ-4630 - Update the UI README node and npm requirements
• DBZ-4632 - Update downstream Getting Started guide to describe revised deployment mechanism
• DBZ-4633 - Update downstream OCP Installation guide to describe revised deployment mechanism
• DBZ-4635 - Upgrade of Oracle connector causes NullPointerException
• DBZ-4636 - Update UI dependency and it's configuration accordingly?
• DBZ-4637 - Redis Sink - change records should be streamed in batches
• DBZ-4640 - Parse including keyword column table ddl error
• DBZ-4641 - Oracle-Connector fails parsing a DDL statement (external tables)
• DBZ-4642 - Migrating UI from webpack-dev-server v3 to v4
• DBZ-4644 - Nightly installation links do not use snapshot repository download links
• DBZ-4645 - Don't run checkstyle/dependency check on documentation-only pull requests or commits
• DBZ-4646 - schema_only_recovery mode not working for FileDatabaseHistory
• DBZ-4648 - SQL Server ad-hoc snapshot - SnapshotType is case sensitive
• DBZ-4649 - DDL parsing issue: ALTER TABLE ... MODIFY PARTITION ...
• DBZ-4650 - Mark incompatible Xstream tests as LogMiner only
• DBZ-4652 - Downstream docs for outbox event routing SMTs
• DBZ-4654 - Oracle DDL parser failure with supplemental log group clause with a custom name
• DBZ-4659 - Link for apicurio-registry-distro-connect-converter packege is broken
• DBZ-4660 - Remove legacy --zookeeper option from example instructions
• DBZ-4661 - DDL statement couldn't be parsed mismatched input '`encrypted`
• DBZ-4662 - oracle-connector DDL statement couldn't be parsed
• DBZ-4665 - Extend Debezium Schema Generator
• DBZ-4666 - debezium-examples fail when using confluentinc/cp-schema-registry:7.0.0
• DBZ-4668 - Make sure right protoc version is applied
• DBZ-4672 - Build trigger issues
• DBZ-4675 - DDL parsing exception
• DBZ-4676 - MongoUtilIT test failure - unable to connect to primary
• DBZ-4677 - Upgrade to Quarkus 2.7.0.Final
• DBZ-4700 - Update shared UG deployment file for use with downstream OCP Install Guide
• DBZ-4701 - JdbcConnection#executeWithoutCommitting commits when auto-commit is enabled
• DBZ-4702 - Indicate ROWID is not supported by XStream
• DBZ-4703 - OracleSchemaMigrationIT fails with Xstream adapter
• DBZ-4704 - Cannot expand JSON payload with nested arrays of objects
• DBZ-4705 - Add bytes support for blob and binary types in Vitess connector
• DBZ-4706 - Oracle parsing error for ALTER TABLE EXT_SIX LOCATION
• DBZ-4707 - MySQL unparseable DDL - CREATE PROCEDURE
• DBZ-4710 - Replication role check on RDS Postgres fails
• DBZ-4712 - Docs build failure
• DBZ-4713 - Confusing example for schema change topic
• DBZ-4715 - Source timestamp timezone differs between snapshot and streaming records
• DBZ-4716 - Document that Oracle Xstream emits DBMS_LOB method calls as separate events
• DBZ-4719 - Changes config for renovate bot to auto-merge only for non-major update
• DBZ-4721 - Incorrect connector version in Debezium RHEL Installation Guide
• DBZ-4723 - Property "log.mining.view.fetch.size" does not take effect
• DBZ-4730 - Expect plain value instead of scientific exponential notation when using decimal string mode
• DBZ-4731 - Verify Debezium connector can be used with MongoDB Atlas
• DBZ-4734 - Document *xmin.fetch.interval.ms* property for Postgres connector
• DBZ-4736 - Postgres debezium send wrong value of column has default NULL::::character varying in kafka message
• DBZ-4737 - Oracle Logminer: streaming start offset is off by one
• DBZ-4738 - Remove NATS example
• DBZ-4739 - Apache Pulsar example doesn't work
• DBZ-4742 - Cannot use Secrets in Debezium server connector config
• DBZ-4743 - Upgrade to Quarkus 2.7.1.Final
• DBZ-4744 - Oracle dbname/signal with dots parsed incorrectly
• DBZ-4746 - Oracle DDL statement couldn't be parsed
• DBZ-4748 - UI layout fixes
• DBZ-4751 - Overly verbose Debezium Server Redis logs
• DBZ-4752 - DDL statement couldn't be parsed
• DBZ-4754 - Update cache-invalidation example
• DBZ-4759 - Upgrade MySQL JDBC driver to 8.0.28
• DBZ-4760 - Redis runs OOM log in wrong scenario
• DBZ-4762 - Document no relevant tables should be in the SYS or SYSTEM tablespaces.
• DBZ-4763 - Relax parsing of Heap and Index organized DDL clauses
• DBZ-4766 - Nightly build artifacts not published
• DBZ-4771 - Save and load database history in Redis
• DBZ-4773 - java.lang.NoSuchMethodError: org.apache.kafka.clients.admin.NewTopic
• DBZ-4776 - Clarify need for link attributes in docs
• DBZ-4777 - Connection validation fails for Db2
• DBZ-4780 - Error and connector stops when DDL contains lateral
• DBZ-4781 - Test suite unable to run due to jackson dependency overlaps
• DBZ-4782 - Schema changes should flush SCN to offsets if there are no other active transactions
• DBZ-4783 - Accept multiple database names in the configuration
• DBZ-4786 - java.lang.NullPointerException while handling DROP column query
• DBZ-4787 - Not reading the keystore/truststore when enabling MySQL SSL authentication
• DBZ-4788 - Elasticsearch in jpa-aggregations example fails
• DBZ-4790 - Switch to fabric8 model provided by Apicurio team
• DBZ-4791 - Incorrect downstream modularization comments in mongodb-outbox-event-router.adoc
• DBZ-4792 - Connector stops streaming after a re-balance
• DBZ-4800 - Debezium UI build fails on Windows
• DBZ-4801 - Use JdbcConfiguration instead of Configuration for JDBC config values
• DBZ-4802 - "DebeziumException: Unable to find primary from MongoDB connection" post upgrade to 1.8.1
• DBZ-4807 - Upgrade to Quarkus 2.7.2.Final
• DBZ-4809 - Add task id and partition to the logging context for multi-partition connectors
• DBZ-4810 - Oracle TO_DATE cannot be parsed when NLS parameter is provided
• DBZ-4813 - Add logs in Outbox Event Router to indicate message id and key
• DBZ-4814 - spatial_ref_sys table should be excluded in Postgres connector
• DBZ-4819 - Oracle test FlushStrategyIT fails
• DBZ-4821 - run.sh is not working in windows environment
• DBZ-4822 - Mysql: Getting ERROR `Failed due to error: connect.errors.ConnectException: For input string: "false"`
• DBZ-4823 - Log the tableId is null when filter out some tables
• DBZ-4824 - Expect the null value with snapshot CapturedTables metric when skipping snapshotting
• DBZ-4832 - Don't set truststore/keystore parameters to system variables
• DBZ-4833 - MySQL 5.7 - no viable alternative at input 'ALTER TABLE ORD_ALLOCATION_CONFIG CHANGE RANK'
• DBZ-4834 - Adding new table with incremental snapshots not working
• DBZ-4835 - missing notes on using db2 connector
• DBZ-4836 - ParsingException when adding a new table to an existing oracle connector
• DBZ-4841 - Debezium Mysql connector can't handle CREATE INDEX IF NOT EXISTS (MariaDB)
• DBZ-4842 - Supplemental log check fails when restarting connector after table dropped
• DBZ-4844 - CREATE_TOPIC docker image regression
• DBZ-4850 - Logminer mining session stopped due to several kinds of SQL exceptions
• DBZ-4851 - DDL statement couldn't be parsed
• DBZ-4852 - Gracefully pass unsupported column types from DDL parser as OracleTypes.OTHER
• DBZ-4853 - Debezium oracle connector stopped because of Unsupported column type: LONG
• DBZ-4856 - Compilation of SqlServerConnectorIntegrator fails
• DBZ-4860 - Maven cannot compile debezium-microbenchmark-oracle
• DBZ-4861 - Postgresql connector prints uninformative log on snapshot phase
• DBZ-4862 - Oracle: Parsing failed for SEL_LOB_LOCATOR sql: 'DECLARE
• DBZ-4864 - pass SINK config properties to OffsetStore and DatabaseHistory adapters
• DBZ-4869 - oracle connector fails because of Supplemental logging not properly configured
• DBZ-4878 - Re-read incremental snapshot chunk on DDL event
• DBZ-4879 - Getting java.sql.SQLException: ORA-01291: missing logfile while running with archive log only
• DBZ-4880 - oracle connector fails because of unsupported column type nclob
• DBZ-4883 - Docs: JDBC driver should go to Oracle connector dir
• DBZ-4884 - Oracle connector stops calling logminer without any error message
• DBZ-4885 - Debezium throws CNFE for Avro converter
• DBZ-4886 - Support maxInboundMessageSize in grpc client
• DBZ-4887 - MySQL undocumented but accepted ANALYZE TABELS statement is not parsable
• DBZ-4890 - BigDecimal has mismatching scale value for given Decimal schema
• DBZ-4891 - Single quotes replication
• DBZ-4892 - Migrate test-suite fixtures to JUnit extension
• DBZ-4896 - Support ON as variable value
• DBZ-4897 - Default value of ('N') is not correctly emitted in Oracle change event
• DBZ-4900 - Use back-off strategy for log availability check
• DBZ-4901 - Update com.google.cloud/libraries-bom to latest version
• DBZ-4906 - Typo - Misplaced backtick in link text breaks downstream build
• DBZ-4911 - Use Jedis' clientSetname when establishing Redis connections
• DBZ-4912 - Redis Sink - using Transaction does not work in sharded Redis
• DBZ-4913 - Oracle connector page have typo since version 1.5.
• DBZ-4917 - Read-only incremental snapshots blog post
• DBZ-4919 - Upgrade postgres driver to version 42.3.3
• DBZ-4920 - Kafka topics list throw exception
• DBZ-4924 - Update Quality Outreach workflow to official Oracle Java GH action
• DBZ-4926 - Spelling mistake in doc about Oracle metrics
• DBZ-4927 - MariaDB Trigger Parsing Error
• DBZ-4932 - Debezium uses wrong LCR format for Oracle 12.1
• DBZ-4933 - NPE during snapshotting MySQL database if custom converters present and column is null
• DBZ-4935 - Avro converter requires Guava in lib directory
• DBZ-4936 - Oracle duplicates on connector restart
• DBZ-4937 - Debezium Server 1.9 Fails to start up when transferring 1.8 offsets
• DBZ-4939 - MySQL connector increment snapshot failed parse datetime column lenth when connector set "snapshot.fetch.size": 20000
• DBZ-4943 - Missing images for 1.9.0.Beta1 and 1.9.0.CR1 releases
• DBZ-4948 - Making Postgres `PSQLException: This connection has been closed.` retriable
• DBZ-4953 - Oracle truncate causes exception
• DBZ-4955 - Bump jackson to 2.13.2
• DBZ-4958 - [MySQL Debezium] DDL Parsing error - CREATE OR REPLACE TABLE
• DBZ-4961 - Update Pulsar client version used by Debezium Server
• DBZ-4963 - ORA-04030: out of process memory when trying to allocate 65568 bytes (Logminer LCR c,krvxrib:buffer)
• DBZ-4966 - Intermittent failure of RedisStreamIT.testRedisConnectionRetry
• DBZ-4976 - NPE caused by io.debezium.connector.oracle.antlr.listener.ColumnDefinitionParserListener.resolveColumnDataType
• DBZ-4978 - Oracle connector may throw NullPointerException when stopped after an unsuccessful startup
• DBZ-4979 - NPE for non-table related DDLs
• DBZ-4980 - CTE statements aren't parsed by MySQL connector
• DBZ-4983 - Unsupported MySQL Charsets during Snapshotting for fields with custom converter
• DBZ-4987 - Debezium raised an exception and the task was still running
• DBZ-4989 - Outbox Transform does not allow expanded payload with additional fields in the envelope
• DBZ-4993 - Redis Sink - clientSetname is taking place before auth
• DBZ-4994 - CLOB with single quotes causes parser exception
• DBZ-4996 - Oracle DDL parser fails on references_clause with no column list
• DBZ-5003 - Can't use 'local' database through mongos
• DBZ-5005 - adjust LogMiner batch size based on comparison with currently used batch size
• DBZ-5006 - Unable to mine Oracle source table which have "/" in table names
• DBZ-5011 - InstanceAlreadyExistsException during MongoDb connector metrics registration
• DBZ-5014 - DateTimeParseException: Text 'infinity' could not be parsed in Postgres connector
• DBZ-5015 - Triggering Incremental Snapshot on MongoDB connector throws json parsing error
• DBZ-5019 - Redis Sink - Check if client is not null before closing it
• DBZ-5025 - Nexus Staging Maven plugin is incompatible with OpenJDK 17
• DBZ-5028 - OracleOffsetContextTest should be scoped to LogMiner only
• DBZ-5029 - Scope several new Oracle tests to LogMiner only
• DBZ-5031 - Debezium has never found starting LSN
• DBZ-5033 - SQL Server in multi-partition mode fails if a new database is added to an existing configuration
• DBZ-5037 - Debezium Server tarball 1.9.1 does not work
• DBZ-5040 - Debezium official documentation typo
• DBZ-5054 - Mysql tests start before MySQL DB constainer is running
• DBZ-5057 - Add FAQ about ORA-01882 and Oracle 11 to documentation
• DBZ-5058 - Debezium server configuration properties not rendered correctly
• DBZ-5060 - Align Postgresql driver with Quarkus
• DBZ-5063 - Fix inconsistent transaction id when handling transactional messages in Vitess connector
• DBZ-5074 - 4 Connections per connector (postgres)
• DBZ-5076 - Oracle documentation refers to archive_log_target rather than archive_lag_target
• DBZ-5077 - 'ALTER TABLE mytable DROP FOREIGN KEY IF EXISTS mytable_fk' no viable alternative at input 'ALTER TABLE mytable DROP FOREIGN KEY IF'
• DBZ-5078 - Rename "Mysql" to "MySql" in related MysqlFieldReader interface
• DBZ-5084 - Cursor fetch is used for all results during connection
• DBZ-5085 - Oracle Logminer: records missed during switch from snapshot to streaming mode
• DBZ-5087 - Interrupting a snapshot process can hang for some JDBC drivers
• DBZ-5090 - Debezium fails to undo change event due to transaction id ending in ffffffff with LogMiner
• DBZ-5097 - Postgresql connector does not retry one some errors when postgres is taken offline
• DBZ-5099 - Parsing zero day fails
• DBZ-5101 - Remove auto-generation and default values for MySQL database.server.id
• DBZ-5105 - Cannot Set debezium.sink.kafka.producer.ssl.endpoint.identification.algorithm to empty value
• DBZ-5107 - Upgrade Jackson Databind to 2.13.2.2
• DBZ-5108 - Debezium connector failed with create table statement
• DBZ-5112 - Current version of surefire/failsafe skips tests on failure in BeforeAll
• DBZ-5114 - Switch to released version of Fixture5 extension in System testsuite
• DBZ-5118 - Use range to activate jdk11 profile
• DBZ-5119 - Include heartbeat table to the heartbeat process in the Debezium Oracle Connector
• DBZ-5129 - Avoid reading entire schema history file into memory in the test suite
• DBZ-5131 - Test IncrementalSnapshotIT##schemaChanges fails randomly
• DBZ-5132 - Misc edits to prepare Oracle connector docs for GA
• DBZ-5134 - Cannot parse default value 0.000000000000000000 for bigint column
• DBZ-5137 - MilliSecondsBehindSource is not reported by SQL Server connector
• DBZ-5138 - Restarting mysql connector task fails with: java.lang.RuntimeException: Unable to register the MBean
• DBZ-5140 - No raising of "WARN Event for transaction X has already been processed, skipped."
• DBZ-5141 - Should be sleep with REGISTRATION_RETRY_DELAY when registry MBean failed
• DBZ-5147 - Pro-actively detect issues with LogMiner records
• DBZ-5148 - Oracle connector restarts after ORA-01291
• DBZ-5153 - MBean name registrations no longer correct in documentation
• DBZ-5159 - TestContainers method DebeziumContainer#getConnectorTaskState can raise a NullPointerException
• DBZ-5166 - ExtractNewRecordState SMT Replaces Null Value with Column's Default Value
• DBZ-5172 - Expose more useful exception info with building the field default value schema
• DBZ-5179 - Oracle connector metrics tracking of rollback and abandoned transactions may cause high memory usage
• DBZ-5199 - Use ubi9 as the base image for Debezium UI
• DBZ-5200 - io.debezium.text.ParsingException: DDL statement couldn't be parsed
• DBZ-5201 - Debezium does NOT support "unix_timestamp() as DEFAULT value
• DBZ-5202 - Oracle io.debezium.DebeziumException: io.debezium.DebeziumException: Failed to get transaction id for current SCN
• DBZ-5204 - Debezium Postgres v1.9.3 fails in Materialize CI
• DBZ-5210 - Oracle Connector failing due to ALTER TABLE for adding column with foreign key
• DBZ-5211 - DDL statement couldn't be parsed - Oracle connector 1.9.3.Final
• DBZ-5219 - Restore deleted topic heading in mongodb-outbox-event-router.adoc
• DBZ-5225 - Include event scn in Oracle records
• DBZ-5230 - DDL statement couldn't be parsed 2 - Oracle connector 1.9.3.Final
• DBZ-5233 - Create shared adoc fragments for specifying MBean name format in connector metrics sections
• DBZ-5236 - Cannot convert field type tinyint(1) unsigned to boolean
• DBZ-5237 - Oracle unparsable ddl create table
• DBZ-5241 - Character set influencers are not properly parsed on default values
• DBZ-5256 - Oracle LogMiner may fail with an in-progress transaction in an archive log that has been deleted
• DBZ-5257 - Order of source block table names in a rename schema change event is not deterministic
• DBZ-5258 - Several Oracle tests do not get database name from TestHelper
• DBZ-5260 - Debezium fails to connect to replicaset if a node is down
• DBZ-5268 - Redis Store does not work with GCP Managed Redis
• DBZ-5271 - io.debezium.text.ParsingException: DDL statement couldn't be parsed
• DBZ-5272 - Deadlock during snapshot with Mongo connector
• DBZ-5273 - Mysql parser is not able to handle variables in KILL command
• DBZ-732 - Set up CI for Oracle

CVEs

(none)

References

(none)