ApsaraMQ for Kafka provides fully managed connectors to synchronize data between ApsaraMQ for Kafka and other Alibaba Cloud services. This topic describes the available connector types, the procedures for using them, their limits, and how to synchronize data between services in different regions.
The connector feature for ApsaraMQ for Kafka is in public preview. This feature is independent of ApsaraMQ for Kafka instances and does not incur fees for the ApsaraMQ for Kafka service. Alibaba Cloud does not provide a service-level agreement (SLA) for the connector feature. For information about the SLAs and pricing of other services on which the connector feature depends, see the documentation for those services.
Connector types
ApsaraMQ for Kafka supports the following two types of connectors:
Sink Connector: The term 'sink' refers to an outbound data flow. In this case, ApsaraMQ for Kafka is the data source and other products are the data targets.
Connector
Description
Document
FC Sink connector
Export data from ApsaraMQ for Kafka and sync it to Function Compute.
MaxCompute Sink connector
Exports data from ApsaraMQ for Kafka and syncs it to MaxCompute.
OSS Sink connector
Exports data from ApsaraMQ for Kafka and syncs it to Object Storage Service (OSS).
Elasticsearch Sink connector
Exports data from ApsaraMQ for Kafka and syncs it to Alibaba Cloud Elasticsearch.
Tablestore Sink connector
Exports data from a source topic in an ApsaraMQ for Kafka instance and syncs it to Tablestore.
AnalyticDB Sink connector
Export data from a source topic of an ApsaraMQ for Kafka instance and sync it to AnalyticDB for MySQL or AnalyticDB for PostgreSQL.
Source Connector: The term 'source' indicates an inbound data flow. In this case, other products are the data source and ApsaraMQ for Kafka is the data destination.
Connector
Description
Document
MySQL Source connector
Exports data from ApsaraDB RDS for MySQL and syncs it to ApsaraMQ for Kafka.
Usage process
The procedure for using a connector is as follows:
Limits
ApsaraMQ for Kafka has the following limits on connectors:
Item | Limit |
Quantity | A single instance supports a maximum of 20 connectors. Create multiple connector tasks to export data from the same instance to different services. |
Region | This feature is not available in some regions. For more information, see Supported regions. |
Cross-region data synchronization
To synchronize data between services in different regions using a connector, you must enable public network access for the connector. The data is then synchronized over the public network. For more information, see Enable public network access for a connector.
Cross-region data synchronization for MySQL Source connectors is a special case. You must enable Express Connect. For more information, see Create a MySQL Source connector.