Create a RocketMQ data source

Security risk notice

When you use OceanBase Data Transmission Service, you can choose to automatically or manually add its public CIDR blocks. However, this may pose security risks. Using this product, you acknowledge and accept the potential security risks. You must take basic security measures. These measures include, but are not limited to, using complex account passwords, restricting open ports for each CIDR block, using authentication for internal API communication, and regularly reviewing and restricting unnecessary IP address ranges.

OceanBase Data Transmission Service adjusts the automatically added whitelists or security groups by adding or deleting entries based on factors such as business needs and security risks. Do not use the IP address segments in these whitelists or security groups for business purposes unrelated to OceanBase Data Transmission Service. Any issues that arise because you use these IP address segments for other business purposes are not covered by the Service-Level Agreement (SLA) for OceanBase Data Transmission Service. For more information about the whitelists and security groups that OceanBase Data Transmission Service adds automatically or manually, see the Add Whitelist documentation.

Prerequisites

• Data Transmission Service has been granted access permissions to cloud resources. For more information, see Grant permissions to a Data Transmission Service migration role.

• A group has been created in the RocketMQ instance. For more information, see Create a group.

• A topic named oms_test_topic has been created in the RocketMQ instance.

• Enable Skip Identity Recognition For Internal Network in the Smart Identity Recognition access control settings for your RocketMQ instance.

  By default, RocketMQ instances use the Intelligent Identity Recognition access control type. This type authenticates internal network access by default. If Internal Network Authentication Exemption is not enabled, a VPC endpoint requires a username and password to pass the data source connection test.

Limits

Data Transmission Service supports RocketMQ V4.x and V5.x instances, including commercial and community editions.

Procedure

1. Log on to the OceanBase console .

2. In the navigation pane on the left, click Data Transmission Service > Data Source Management.

3. On the Data Source List page, click New Data Source in the upper-right corner.

4. In the New Data Source dialog box, set Data Source Type to RocketMQ.

5. Configure the parameters.

   Parameter	Description
   Instance Type	Currently, only the Alibaba Cloud RocketMQ Instance is supported.
   Data Source Identifier	The identifier can consist of letters, digits, and Chinese characters. The identifier cannot contain spaces and must be no more than 32 characters long.
   Cross-Alibaba Cloud Account	Data Transmission Service supports data migration and synchronization tasks for instances under different Alibaba Cloud accounts. You can select this option as needed. If you select this option, enter the other party's Alibaba Cloud account. If you do not have the required permissions for that account, request authorization first. For more information, see Request cross-account authorization.
   Instance List	Select a created Alibaba Cloud RocketMQ instance from the drop-down list.
   RocketMQ Endpoint Information	The endpoint of the RocketMQ instance, in the format of <IP>:PORT or <Domain Name>:PORT.
   AccessKey ID	The AccessKey ID that you created in the Alibaba Cloud console. It is used for identity authentication. You can hover over the profile picture in the upper-right corner of the page and click AccessKey Management to view the AccessKey ID.
   Secret Key	The AccessKey secret that you created in the Alibaba Cloud console. It is used for identity authentication. The AccessKey secret is displayed only upon creation and cannot be retrieved later. Store it in a secure location. For more information, see Create an AccessKey.
   Notes (Optional)	The notes for the data source.

6. Click Test Connection to test the network connectivity and the database connection.

   Important

   If you have not created the oms_test_topic topic, the connection test fails.

7. After the connection test is successful, click OK.

Create a group

Before you create a RocketMQ data source, you must create a group named defaultGroup to pass the connection test.

1. Go to the details page of the RocketMQ instance.

   1. Log on to the Message Queue for Apache RocketMQ console.

   2. In the navigation pane on the left, click Instance List.

   3. On the Instance List page, click the name of the target instance to go to the Instance Details page.

2. In the navigation pane on the left, click Group Management.

3. On the Group Management page, click Create Group and configure the parameters.

   The parameters for creating a group vary depending on the RocketMQ instance version. For more information, see the V4.0 instance documentation or the V5.0 instance documentation.

   Important

   When you create the group, you must set the Group ID to defaultGroup.

4. After you complete the configuration, click OK.

5. Create the oms_test_topic topic.

   1. On the details page of the target instance, click Topic Management in the navigation pane on the left.

   2. On the Topic Management page, click Create Topic.

   3. In the Create Topic dialog box, configure the parameters.

      Parameter	Description
      Name	oms_test_topic.
      Billing Method	This parameter is displayed only when you create a Topic for a RocketMQ 4.x instance, and it supports only Pay-as-you-go.
      Message Type	RocketMQ 4.x instances support Normal Message, Transactional Message, Partitionally Ordered Message, Globally Ordered Message, and Scheduled And Delayed Message. RocketMQ 5.x instances support Normal Messages, Ordered Messages, Scheduled And Delayed Messages, and Transactional Messages.
      Description	The maximum length is 128 characters.

   4. After you complete the configuration, click OK.