Data not delivered to OSS after task creation

更新时间:
复制 MD 格式

Problem description

After you create a data delivery task for a data table by using the Tablestore console or an SDK, no data is found in the destination bucket in Object Storage Service (OSS).

Important

A new data delivery task takes up to one minute to initialize. After creating the task, wait at least a minute before checking for data in OSS.

Possible cause

This occurs when the number of columns in a row does not match the definition in the delivery schema, or when a source column's data type is inconsistent with the destination's type.

Solution

Note

The following steps demonstrate the process by using the Tablestore console.

Verify that the column count and data types in the delivery schema match the source data table. To do this, perform the following steps:

  1. Navigate to the Instance Details page.

    1. Log on to the Tablestore console.

    2. On the Overview page, select a region and then click the instance name.

  2. Check the schema configuration of the data delivery task.

    Note

    You can also call the DescribeDeliveryTask API operation to query the task's description and confirm its configuration.

    1. On the Deliver Data to OSS tab, click View Details in the Schema column for the target data delivery task.

    2. In the Details dialog box, view the schema configuration.

      The Schema Configuration section contains a field mapping table with the following columns: Order, Source Table Field, Destination Field Name, and Destination Field Type. Verify that the field mappings are correct. For example, check that the id field is mapped to the destination field id (UTF8), Col_Keyword is mapped to Col_Keyword (UTF8), and Col_Long is mapped to Col_Long (INT64). You can also view other settings such as Delivery Type (Full & Incremental) and Delivery File Format (Parquet).

  3. Check the data in a row of the source table.

    1. On the Instance Details page, go to the Tables tab and click the name of the data table.

    2. On the Query Data tab, click Details for a specific row.

    3. In the Details dialog box, review the row's details.

      The data is displayed in JSON format. The primaryKeys array contains information about primary keys, such as the id field with its type and value. The columns object contains information about attribute columns, such as Col_Keyword and Col_Long with their corresponding values and timestamps. Click Copy in the lower-right corner of the dialog box to copy the JSON content.

  4. Compare the row's column count and data types with those in the delivery schema's configuration.