Cloud Watch Namespace*

The CloudWatch metric namespace.

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Overwrite Endpoint URI

The overriding endpoint URI. To use this option, you must also select the overrideEndpoint option.

Endpoint Overwrite

Select this option to override the endpoint URI. To use this option, you must also provide a URI for the uriEndpointOverride option.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Table*

The name of the DynamoDB table.

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Operation

The operation to perform. The options are PutItem, UpdateItem, or DeleteItem.

Write Capacity

The provisioned throughput to reserve for writing resources to your table.

Overwrite Endpoint URI

The overriding endpoint URI. To use this option, you must also select the overrideEndpoint option.

Endpoint Overwrite

Select this option to override the endpoint URI. To use this option, you must also provide a URI for the uriEndpointOverride option.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Table*

The name of the DynamoDB table.

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Stream Iterator Type

Defines where in the DynamoDB stream to start getting records. There are two enums and the value can be one of FROM_LATEST and FROM_START. Note that using FROM_START can cause a significant delay before the stream has caught up to real-time.

Overwrite Endpoint URI

The overriding endpoint URI. To use this option, you must also select the overrideEndpoint option.

Endpoint Overwrite

Select this option to override the endpoint URI. To use this option, you must also provide a URI for the uriEndpointOverride option.

Delay

The number of milliseconds before the next poll from the database.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Stream Name*

The Kinesis stream that you want to access. The Kinesis stream that you specify must already exist.

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Overwrite Endpoint URI

The overriding endpoint URI. To use this option, you must also select the overrideEndpoint option.

Endpoint Overwrite

Select this option to override the endpoint URI. To use this option, you must also provide a URI for the uriEndpointOverride option.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that the source connector sends to Kafka.

Stream Name*

The Kinesis stream that you want to access. The Kinesis stream that you specify must already exist.

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Overwrite Endpoint URI

The overriding endpoint URI. To use this option, you must also select the overrideEndpoint option.

Endpoint Overwrite

Select this option to override the endpoint URI. To use this option, you must also provide a URI for the uriEndpointOverride option.

Delay

The number of milliseconds before the next poll of the selected stream.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Function Name*

The Lambda Function name.

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Server Name*

The server name for the data source.

Server Port

The server port for the AWS RedShi data source.

Username*

The username to access a secured AWS Redshift Database.

Password*

The password to access a secured AWS Redshift Database. / An opaque reference to the sql_password

Query*

The query to execute against the AWS Redshift Database.

Database Name*

The name of the AWS RedShift Database.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Server Name*

The server name for the data source.

Server Port

The server port for the data source.

Username*

The username to access a secured AWS RedShift Database.

Password*

The password to access a secured AWS RedShift Database. / An opaque reference to the sql_password

Query*

The query to execute against the AWS RedShift Database.

Database Name*

The name of the AWS RedShift Database.

Consumed Query

A query to run on a tuple consumed.

Delay

The number of milliseconds before the next poll from the AWS RedShift database.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Bucket Name*

The S3 Bucket name or Amazon Resource Name (ARN).

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Autocreate Bucket

Specifies to automatically create the S3 bucket.

Overwrite Endpoint URI

The overriding endpoint URI. To use this option, you must also select the overrideEndpoint option.

Endpoint Overwrite

Select this option to override the endpoint URI. To use this option, you must also provide a URI for the uriEndpointOverride option.

Key Name

The key name for saving an element in the bucket.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Bucket Name*

The S3 Bucket name or Amazon Resource Name (ARN).

Auto-delete Objects

Specifies to delete objects after consuming them.

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Autocreate Bucket

Specifies to automatically create the S3 bucket.

Include Body

If true, the exchange is consumed and put into the body and closed. If false, the S3Object stream is put raw into the body and the headers are set with the S3 object metadata.

Prefix

The AWS S3 bucket prefix to consider while searching.

Ignore Body

If true, the S3 Object body is ignored. Setting this to true overrides any behavior defined by the includeBody option. If false, the S3 object is put in the body.

Overwrite Endpoint URI

The overriding endpoint URI. To use this option, you must also select the overrideEndpoint option.

Endpoint Overwrite

Select this option to override the endpoint URI. To use this option, you must also provide a URI for the uriEndpointOverride option.

Delay

The number of milliseconds before the next poll of the selected bucket.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

From*

From address

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Topic Name*

The SNS topic name name or Amazon Resource Name (ARN).

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Autocreate Topic

Setting the autocreation of the SNS topic.

Overwrite Endpoint URI

The overriding endpoint URI. To use this option, you must also select the overrideEndpoint option.

Endpoint Overwrite

Select this option to override the endpoint URI. To use this option, you must also provide a URI for the uriEndpointOverride option.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Queue Name*

The SQS Queue name or or Amazon Resource Name (ARN).

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Autocreate Queue

Automatically create the SQS queue.

AWS Host

The hostname of the Amazon AWS cloud.

Protocol

The underlying protocol used to communicate with SQS.

Overwrite Endpoint URI

The overriding endpoint URI. To use this option, you must also select the overrideEndpoint option.

Endpoint Overwrite

Select this option to override the endpoint URI. To use this option, you must also provide a URI for the uriEndpointOverride option.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Queue Name*

The SQS Queue Name or ARN

Auto-delete Messages

Delete messages after consuming them

Access Key*

The access key obtained from AWS. / An opaque reference to the aws_access_key

Secret Key*

The secret key obtained from AWS. / An opaque reference to the aws_secret_key

AWS Region*

The AWS region to access.

Autocreate Queue

Setting the autocreation of the SQS queue.

AWS Host

The hostname of the Amazon AWS cloud.

Protocol

The underlying protocol used to communicate with SQS

Queue URL

The full SQS Queue URL (required if using KEDA)

Overwrite Endpoint URI

The overriding endpoint URI. To use this option, you must also select the overrideEndpoint option.

Endpoint Overwrite

Select this option to override the endpoint URI. To use this option, you must also provide a URI for the uriEndpointOverride option.

Delay

The number of milliseconds before the next poll of the selected stream

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Eventhubs Namespace*

The eventhubs namespace

Eventhubs Name*

The eventhub name

Share Access Name*

EventHubs SAS key name

Share Access Key*

The key for EventHubs SAS key name / An opaque reference to the azure_shared_access_key

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Eventhubs Namespace*

The Event Hubs namespace.

Eventhubs Name*

The Event Hub name.

Share Access Name*

The Event Hubs SAS key name.

Share Access Key*

The key for the Event Hubs SAS key name. / An opaque reference to the azure_shared_access_key

Azure Storage Blob Account Name*

The name of the Storage Blob account.

Azure Storage Blob Container Name*

The name of the Storage Blob container.

Azure Storage Blob Access Key*

The key for the Azure Storage Blob service that is associated with the Storage Blob account name. / An opaque reference to the azure_blob_access_key

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

URL*

The Azure Functions URL you want to send the data to.

Method

The HTTP method to use.

Key

A function-specific API key is required, if the authLevel of the function is FUNCTION or master key if the authLevel is ADMIN. / An opaque reference to the azure_key

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Account Name*

The Azure Storage Blob account name.

Container Name*

The Azure Storage Blob container name.

Access Key*

The Azure Storage Blob access key. / An opaque reference to the azure_access_key

Operation name

The operation to perform.

Credential Type

Determines the credential strategy to adopt. Possible values are SHARED_ACCOUNT_KEY, SHARED_KEY_CREDENTIAL and AZURE_IDENTITY

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Period between Polls*

The interval (in milliseconds) between fetches to the Azure Storage Container.

Account Name*

The Azure Storage Blob account name.

Container Name*

The Azure Storage Blob container name.

Access Key*

The Azure Storage Blob access key. / An opaque reference to the azure_access_key

Credential Type

Determines the credential strategy to adopt. Possible values are SHARED_ACCOUNT_KEY, SHARED_KEY_CREDENTIAL and AZURE_IDENTITY

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Account Name*

The Azure Storage Queue account name.

Queue Name*

The Azure Storage Queue container name.

Access Key*

The Azure Storage Queue access key. / An opaque reference to the azure_access_key

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Account Name*

The Azure Storage Queue account name.

Queue Name*

The Azure Storage Queue container name.

Access Key*

The Azure Storage Queue access key. / An opaque reference to the azure_access_key

Maximum Messages

The maximum number of messages to get. You can specify a value between 1 and 32. The default is 1 (one message). If there are fewer than the maximum number of messages in the queue, then all the messages are returned.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Connection Host*

The hostname(s) for the Cassandra server(s). Use a comma to separate multiple hostnames.

Connection Port*

The port number(s) of the cassandra server(s). Use a comma to separate multiple port numbers.

Keyspace*

The keyspace to use.

Username

The username for accessing a secured Cassandra cluster.

Password

The password for accessing a secured Cassandra cluster. / An opaque reference to the cassandra_password

Consistency Level

The consistency level to use. Set the value to one of these options - ANY, ONE, TWO, THREE, QUORUM, ALL, LOCAL_QUORUM, EACH_QUORUM, SERIAL, LOCAL_SERIAL, or LOCAL_ONE.

Prepare Statements

If true, specifies to use PreparedStatements as the query. If false, specifies to use regular Statements as the query.

Query*

The query to execute against the Cassandra cluster table.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Connection Host*

The hostname(s) for the Cassandra server(s). Use a comma to separate multiple hostnames.

Connection Port*

The port number(s) of the cassandra server(s). Use a comma to separate multiple port numbers.

Keyspace*

The keyspace to use.

Username

The username for accessing a secured Cassandra cluster.

Password

The password for accessing a secured Cassandra cluster. / An opaque reference to the cassandra_password

Result Strategy

The strategy to convert the result set of the query. Possible values are ALL, ONE, LIMIT_10, or LIMIT_100.

Consistency Level

The consistency level to use. Possible values are ANY, ONE, TWO, THREE, QUORUM, ALL, LOCAL_QUORUM, EACH_QUORUM, SERIAL, LOCAL_SERIAL, or LOCAL_ONE.

Query*

The query to execute against the Cassandra cluster table.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Period

The interval (in milliseconds) to wait between producing the next message.

Message*

The message to generate.

Content Type

The content type of the generated message.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Topic prefix*

Topic prefix that identifies and provides a namespace for the particular database server/cluster is capturing changes. The topic prefix should be unique across all other connectors, since it is used as a prefix for all Kafka topic names that receive events emitted by this connector. Only alphanumeric characters, hyphens, dots and underscores must be accepted.

Hosts

The hostname and port pairs (in the form 'host' or 'host:port') of the MongoDB server(s) in the replica set.

User

Database user for connecting to MongoDB, if necessary.

Password

Password to be used when connecting to MongoDB, if necessary.

Enable SSL connection to MongoDB

Should connector use SSL to connect to MongoDB instances

Credentials Database

Database containing user credentials.

Include Databases

A comma-separated list of regular expressions that match the database names for which changes are to be captured

Exclude Databases

A comma-separated list of regular expressions that match the database names for which changes are to be excluded

Include Collections

A comma-separated list of regular expressions that match the collection names for which changes are to be captured

A comma-separated list of regular expressions that match the collection names for which changes are to be excluded

Exclude Fields

A comma-separated list of the fully-qualified names of fields that should be excluded from change event message values

Snapshot mode

The criteria for running a snapshot upon startup of the connector. Options include: 'initial' (the default) to specify the connector should always perform an initial sync when required; 'never' to specify the connector should never perform an initial sync

Query fetch size

The maximum number of records that should be loaded into memory while streaming. A value of '0' uses the default JDBC fetch size.

Change event batch size

Maximum size of each batch of source records. Defaults to 2048.

Change event buffer size

Maximum size of the queue for change events read from the database log but not yet recorded or forwarded. Defaults to 8192, and should always be larger than the maximum batch size.

Kafka topic name

The name of the topic for the database schema history.

Kafka bootstrap servers

A list of host/port pairs that the connector will use for establishing the initial connection to the Kafka cluster for retrieving database schema history previously stored by the connector. This should point to the same Kafka cluster used by the Kafka Connect process.

Kafka Message Key Format

The serialization format for the Kafka message key.

Kafka Message Value Format

The serialization format for the Kafka message value.

Topic prefix*

Topic prefix that identifies and provides a namespace for the particular database server/cluster is capturing changes. The topic prefix should be unique across all other connectors, since it is used as a prefix for all Kafka topic names that receive events emitted by this connector. Only alphanumeric characters, hyphens, dots and underscores must be accepted.

Cluster ID*

A numeric ID of this database client, which must be unique across all currently-running database processes in the cluster. This connector joins the MySQL database cluster as another server (with this unique ID) so it can read the binlog.

Hostname*

Resolvable hostname or IP address of the database server.

Port

Port of the database server.

User*

Name of the database user to be used when connecting to the database.

Password

Password of the database user to be used when connecting to the database.

Include Databases

The databases for which changes are to be captured

Exclude Databases

A comma-separated list of regular expressions that match database names to be excluded from monitoring

Include Tables

The tables for which changes are to be captured

Exclude Tables

A comma-separated list of regular expressions that match the fully-qualified names of tables to be excluded from monitoring

Include Columns

Regular expressions matching columns to include in change events

Exclude Columns

Regular expressions matching columns to exclude from change events

Snapshot mode

The criteria for running a snapshot upon startup of the connector. Options include: 'when_needed' to specify that the connector run a snapshot upon startup whenever it deems it necessary; 'schema_only' to only take a snapshot of the schema (table structures) but no actual data; 'initial' (the default) to specify the connector can run a snapshot only when no offsets are available for the logical server name; 'initial_only' same as 'initial' except the connector should stop after completing the snapshot and before it would normally read the binlog; and’never' to specify the connector should never run a snapshot and that upon first startup the connector should read from the beginning of the binlog. The 'never' mode should be used with care, and only when the binlog is known to contain all history.

Decimal Handling

Specify how DECIMAL and NUMERIC columns should be represented in change events, including: 'precise' (the default) uses java.math.BigDecimal to represent values, which are encoded in the change events using a binary representation and Kafka Connect’s 'org.apache.kafka.connect.data.Decimal' type; 'string' uses string to represent values; 'double' represents values using Java’s 'double', which may not offer the precision but will be far easier to use in consumers.

Columns PK mapping

A semicolon-separated list of expressions that match fully-qualified tables and column(s) to be used as message key. Each expression must match the pattern '<fully-qualified table name>:<key columns>', where the table names could be defined as (DB_NAME.TABLE_NAME) or (SCHEMA_NAME.TABLE_NAME), depending on the specific connector, and the key columns are a comma-separated list of columns representing the custom key. For any table without an explicit key configuration the table’s primary key column(s) will be used as message key. Example: dbserver1.inventory.orderlines:orderId,orderLineId;dbserver1.inventory.orders:id

Query fetch size

The maximum number of records that should be loaded into memory while streaming. A value of '0' uses the default JDBC fetch size.

Change event batch size

Maximum size of each batch of source records. Defaults to 2048.

Change event buffer size

Maximum size of the queue for change events read from the database log but not yet recorded or forwarded. Defaults to 8192, and should always be larger than the maximum batch size.

Kafka topic name

The name of the topic for the database schema history.

Kafka bootstrap servers

A list of host/port pairs that the connector will use for establishing the initial connection to the Kafka cluster for retrieving database schema history previously stored by the connector. This should point to the same Kafka cluster used by the Kafka Connect process.

Kafka Message Key Format

The serialization format for the Kafka message key.

Kafka Message Value Format

The serialization format for the Kafka message value.

Topic prefix*

Topic prefix that identifies and provides a namespace for the particular database server/cluster is capturing changes. The topic prefix should be unique across all other connectors, since it is used as a prefix for all Kafka topic names that receive events emitted by this connector. Only alphanumeric characters, hyphens, dots and underscores must be accepted.

Hostname*

Resolvable hostname or IP address of the database server.

Port

Port of the database server.

User*

Name of the database user to be used when connecting to the database.

Password

Password of the database user to be used when connecting to the database.

Slot

The name of the Postgres logical decoding slot created for streaming changes from a plugin. Defaults to 'debezium

Publication

The name of the Postgres 10+ publication used for streaming changes from a plugin. Defaults to 'dbz_publication'

Publication Auto Create Mode

Applies only when streaming changes using pgoutput.Determine how creation of a publication should work, the default is all_tables.DISABLED - The connector will not attempt to create a publication at all. The expectation is that the user has created the publication up-front. If the publication isn’t found to exist upon startup, the connector will throw an exception and stop.ALL_TABLES - If no publication exists, the connector will create a new publication for all tables. Note this requires that the configured user has access. If the publication already exists, it will be used. i.e CREATE PUBLICATION <publication_name> FOR ALL TABLES;FILTERED - If no publication exists, the connector will create a new publication for all those tables matchingthe current filter configuration (see table/database include/exclude list properties). If the publication already exists, it will be used. i.e CREATE PUBLICATION <publication_name> FOR TABLE <tbl1, tbl2, etc>

Include Schemas

The schemas for which events should be captured

Exclude Schemas

The schemas for which events must not be captured

Include Tables

The tables for which changes are to be captured

Exclude Tables

A comma-separated list of regular expressions that match the fully-qualified names of tables to be excluded from monitoring

Include Columns

Regular expressions matching columns to include in change events

Exclude Columns

Regular expressions matching columns to exclude from change events

Snapshot mode

The criteria for running a snapshot upon startup of the connector. Options include: 'always' to specify that the connector run a snapshot each time it starts up; 'initial' (the default) to specify the connector can run a snapshot only when no offsets are available for the logical server name; 'initial_only' same as 'initial' except the connector should stop after completing the snapshot and before it would normally start emitting changes;'never' to specify the connector should never run a snapshot and that upon first startup the connector should read from the last position (LSN) recorded by the server; and’exported' deprecated, use 'initial' instead; 'custom' to specify a custom class with 'snapshot.custom_class' which will be loaded and used to determine the snapshot, see docs for more details.

Decimal Handling

Specify how DECIMAL and NUMERIC columns should be represented in change events, including: 'precise' (the default) uses java.math.BigDecimal to represent values, which are encoded in the change events using a binary representation and Kafka Connect’s 'org.apache.kafka.connect.data.Decimal' type; 'string' uses string to represent values; 'double' represents values using Java’s 'double', which may not offer the precision but will be far easier to use in consumers.

Columns PK mapping

A semicolon-separated list of expressions that match fully-qualified tables and column(s) to be used as message key. Each expression must match the pattern '<fully-qualified table name>:<key columns>', where the table names could be defined as (DB_NAME.TABLE_NAME) or (SCHEMA_NAME.TABLE_NAME), depending on the specific connector, and the key columns are a comma-separated list of columns representing the custom key. For any table without an explicit key configuration the table’s primary key column(s) will be used as message key. Example: dbserver1.inventory.orderlines:orderId,orderLineId;dbserver1.inventory.orders:id

Query fetch size

The maximum number of records that should be loaded into memory while streaming. A value of '0' uses the default JDBC fetch size.

Change event batch size

Maximum size of each batch of source records. Defaults to 2048.

Change event buffer size

Maximum size of the queue for change events read from the database log but not yet recorded or forwarded. Defaults to 8192, and should always be larger than the maximum batch size.

Kafka topic name

The name of the topic for the database schema history.

Kafka bootstrap servers

A list of host/port pairs that the connector will use for establishing the initial connection to the Kafka cluster for retrieving database schema history previously stored by the connector. This should point to the same Kafka cluster used by the Kafka Connect process.

Kafka Message Key Format

The serialization format for the Kafka message key.

Kafka Message Value Format

The serialization format for the Kafka message value.

Topic prefix*

Topic prefix that identifies and provides a namespace for the particular database server/cluster is capturing changes. The topic prefix should be unique across all other connectors, since it is used as a prefix for all Kafka topic names that receive events emitted by this connector. Only alphanumeric characters, hyphens, dots and underscores must be accepted.

Hostname*

Resolvable hostname or IP address of the database server.

Port

Port of the database server.

User

Name of the database user to be used when connecting to the database.

Password

Password of the database user to be used when connecting to the database.

Databases

The names of the databases from which the connector should capture changes

Include Tables

The tables for which changes are to be captured

Exclude Tables

A comma-separated list of regular expressions that match the fully-qualified names of tables to be excluded from monitoring

Include Columns

Regular expressions matching columns to include in change events

Exclude Columns

Regular expressions matching columns to exclude from change events

Snapshot mode

The criteria for running a snapshot upon startup of the connector. Options include: 'initial' (the default) to specify the connector should run a snapshot only when no offsets are available for the logical server name; 'schema_only' to specify the connector should run a snapshot of the schema when no offsets are available for the logical server name.

Decimal Handling

Specify how DECIMAL and NUMERIC columns should be represented in change events, including: 'precise' (the default) uses java.math.BigDecimal to represent values, which are encoded in the change events using a binary representation and Kafka Connect’s 'org.apache.kafka.connect.data.Decimal' type; 'string' uses string to represent values; 'double' represents values using Java’s 'double', which may not offer the precision but will be far easier to use in consumers.

Columns PK mapping

A semicolon-separated list of expressions that match fully-qualified tables and column(s) to be used as message key. Each expression must match the pattern '<fully-qualified table name>:<key columns>', where the table names could be defined as (DB_NAME.TABLE_NAME) or (SCHEMA_NAME.TABLE_NAME), depending on the specific connector, and the key columns are a comma-separated list of columns representing the custom key. For any table without an explicit key configuration the table’s primary key column(s) will be used as message key. Example: dbserver1.inventory.orderlines:orderId,orderLineId;dbserver1.inventory.orders:id

Query fetch size

The maximum number of records that should be loaded into memory while streaming. A value of '0' uses the default JDBC fetch size.

Change event batch size

Maximum size of each batch of source records. Defaults to 2048.

Change event buffer size

Maximum size of the queue for change events read from the database log but not yet recorded or forwarded. Defaults to 8192, and should always be larger than the maximum batch size.

Kafka topic name

The name of the topic for the database schema history.

Kafka bootstrap servers

A list of host/port pairs that the connector will use for establishing the initial connection to the Kafka cluster for retrieving database schema history previously stored by the connector. This should point to the same Kafka cluster used by the Kafka Connect process.

Kafka Message Key Format

The serialization format for the Kafka message key.

Kafka Message Value Format

The serialization format for the Kafka message value.

Username

The username to connect to ElasticSearch.

Password

The password to connect to ElasticSearch. / An opaque reference to the elasticsearch_password

Enable SSL

Specifies to connect by using SSL.

Host Addresses*

A comma-separated list of remote transport addresses in ip:port format.

ElasticSearch Cluster Name*

The name of the ElasticSearch cluster.

Index in ElasticSearch

The name of the ElasticSearch index.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Connection Host*

The hostname of the FTP server.

Connection Port*

The port of the FTP server.

Username*

The username to access the FTP server.

Password*

The password to access the FTP server. / An opaque reference to the ftps_password

Directory Name*

The starting directory.

Passive Mode

Set the passive mode connection.

File Existence

Specifies how the Kamelet behaves if the file already exists. Possible values are Override, Append, Fail, or Ignore.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Connection Host*

The hostname of the FTPS server.

Connection Port*

The port of the FTPS server.

Username*

The username to access the FTPS server.

Password*

The password to access the FTPS server. / An opaque reference to the ftps_password

Directory Name*

The starting directory.

Passive Mode

Specifies to use passive mode connection.

Recursive

If a directory, look for files in all sub-directories as well.

Idempotency

Skip already-processed files.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Google Cloud Project Id*

The Google Cloud Project ID.

Big Query Dataset Id*

The Big Query Dataset ID.

Big Query Table Id*

The Big Query Table ID.

Google Cloud Platform Credential File*

The credential for accessing Google Cloud Platform API services. This value must be a path to a service account key file.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Project Id*

The Google Cloud Functions Project ID.

Region*

The region where Google Cloud Functions has been deployed.

Function Name*

The Function name.

Service Account Key*

The path to the service account key file that provides credentials for the Google Cloud Functions platform. / An opaque reference to the aws_access_key

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Project Id*

The Google Cloud Pub/Sub Project ID.

Destination Name*

The destination name.

Service Account Key*

The service account key to use as credentials for the Pub/Sub publisher/subscriber. You must encode this value in base64. / An opaque reference to the aws_access_key

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Project Id*

The Google Cloud Pub/Sub Project ID.

Subscription Name*

The subscription name.

Service Account Key*

The service account key to use as credentials for the Pub/Sub publisher/subscriber. You must encode this value in base64. / An opaque reference to the aws_access_key

Synchronous Pull

Specifies to synchronously pull batches of messages.

Max Messages Per Poll

The maximum number of messages to receive from the server in a single API call.

Concurrent Consumers

The number of parallel streams to consume from the subscription.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Bucket Name Or ARN*

The Google Cloud Storage bucket name or Bucket Amazon Resource Name (ARN).

Service Account Key*

The service account key to use as credentials for Google Cloud Storage access. You must encode this value in base64. / An opaque reference to the aws_access_key

Autocreate Bucket

Specifies to automatically create the Google Cloud Storage bucket.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Bucket Name Or ARN*

The Google Cloud Storage bucket name or Bucket Amazon Resource Name (ARN).

Service Account Key*

The service account key to use as credentials for Google Cloud Storage access. You must encode this value in base64. / An opaque reference to the aws_access_key

Auto-delete Objects

Specifies to delete objects after consuming them.

Autocreate Bucket

Specifies to automatically create the Google Cloud Storage bucket.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

URL*

The URL to which you want to send data.

Method

The HTTP method to use.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Jira URL*

The URL of your instance of Jira

Username*

The username to access Jira

Password*

The password or the API Token to access Jira / An opaque reference to the jira_password

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Jira URL*

The URL of your instance of Jira

Username*

The username to access Jira

Password*

The password or the API Token to access Jira / An opaque reference to the jira_password

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Jira URL*

The URL of your instance of Jira.

Username*

The username to access Jira.

Password*

The password or the API Token to access Jira. / An opaque reference to the jira_password

JQL

A query to filter issues.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Destination Type

The JMS destination type (queue or topic).

Destination Name*

The JMS destination name.

Broker URL*

The JMS URL.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Destination Type

The JMS destination type (queue or topic).

Destination Name*

The JMS destination name.

Broker URL*

The JMS URL.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Destination Type

The JMS destination type (queue or topic).

Destination Name*

The JMS destination name.

Broker URL*

The JMS URL.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Destination Type

The JMS destination type (queue or topic).

Destination Name*

The JMS destination name.

Broker URL*

The JMS URL.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Server Name*

The server name for the data source.

Server Port

The server port for the data source.

Username*

The username to access a secured MariaDB Database.

Password*

The password to access a secured MariaDB Database. / An opaque reference to the db_password

Query*

The query to execute against the MariaDB Database.

Database Name*

The name of the MariaDB Database.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Server Name*

The server name for the data source.

Server Port

The server port for the data source.

Username*

The username to access a secured MariaDB Database.

Password*

The password to access a secured MariaDB Database. / An opaque reference to the db_password

Query*

The query to execute against the MariaDB Database.

Database Name*

The name of the MariaDB Database.

Consumed Query

A query to run on a tuple consumed.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Bucket Name*

The Minio Bucket name.

Access Key*

The access key obtained from MinIO. / An opaque reference to the minio_access_key

Secret Key*

The secret key obtained from MinIO. / An opaque reference to the minio_secret_key

Endpoint*

The MinIO Endpoint. You can specify an URL, domain name, IPv4 address, or IPv6 address.

Autocreate Bucket

Specify to automatically create the MinIO bucket.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Bucket Name*

The MinIO Bucket name.

Auto-delete Objects

Delete objects after consuming them.

Access Key*

The access key obtained from MinIO. / An opaque reference to the minio_access_key

Secret Key*

The secret key obtained from MinIO. / An opaque reference to the minio_secret_key

Endpoint*

The MinIO Endpoint. You can specify an URL, domain name, IPv4 address, or IPv6 address.

Autocreate Bucket

Specifies to automatically create the MinIO bucket.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

MongoDB Hosts*

Comma separated list of MongoDB Host Addresses in host:port format.

MongoDB Collection*

Sets the name of the MongoDB collection to bind to this endpoint.

MongoDB Password

User password for accessing MongoDB. / An opaque reference to the mongodb_password

MongoDB Username

Username for accessing MongoDB.

MongoDB Database*

Sets the name of the MongoDB database to target.

Write Concern

Configure the level of acknowledgment requested from MongoDB for write operations, possible values are ACKNOWLEDGED, W1, W2, W3, UNACKNOWLEDGED, JOURNALED, MAJORITY.

Collection

Create collection during initialisation if it doesn’t exist.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

MongoDB Hosts*

A comma-separated list of MongoDB host addresses in host:port format.

MongoDB Collection*

The name of the MongoDB collection to bind to this endpoint.

MongoDB Password

The user password for accessing MongoDB. / An opaque reference to the mongodb_password

MongoDB Username

The username for accessing MongoDB. The username must be present in the MongoDB’s authentication database (authenticationDatabase). By default, the MongoDB authenticationDatabase is 'admin'.

MongoDB Database*

The name of the MongoDB database.

MongoDB Persistent Tail Tracking

Specifies to enable persistent tail tracking, which is a mechanism to keep track of the last consumed data across system restarts. The next time the system is up, the endpoint recovers the cursor from the point where it last stopped consuimg data. This option will only work on capped collections.

MongoDB Tail Track Increasing Field

The correlation field in the incoming data which is of increasing nature and is used to position the tailing cursor every time it is generated.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Server Name*

The server name for the data source.

Server Port

The server port for the data source.

Username*

The username to access a secured MySQL Database.

Password*

The password to access a secured MySQL Database. / An opaque reference to the db_password

Query*

The query to execute against the MySQL Database.

Database Name*

The name of the MySQL Database.

Topic Names*

A comma-separated list of Kafka topic names.

Data Shape

The format of the data that Kafka sends to the sink connector.

Server Name*

The server name for the data source.

Server Port

The server port for the data source.

Username*

The username to access a secured MySQL Database.

Password*

The password to access a secured MySQL Database. / An opaque reference to the db_password

Query*

The query to execute against the MySQL Database.

Database Name*

The name of the MySQL Database.

Consumed Query

A query to run on a tuple consumed.

Topic Name*

The name of the Kafka Topic to use.

Data Shape

The format of the data that the source connector sends to Kafka.

Server Name*

The server name for the data source.

Server Port