OSS Vectors

更新时间:
复制 MD 格式

OSS Vectors is the vector storage and retrieval feature of Alibaba Cloud Object Storage Service (OSS). It uses a dedicated vector bucket type to store, query, and manage vector data. As a low-cost, large-scale, and easy-to-use solution, OSS Vectors enables vector storage and querying for AI applications, such as multi-modal retrieval, knowledge bases, retrieval-augmented generation (RAG), and AI agents. You can write vector data generated by any third-party service to a vector bucket. OSS Vectors also supports unified governance for both large-scale raw data and vector data. For example, you can configure the same Bucket Policy for both standard and vector buckets, or export logs in a unified format for auditing.

Key concepts

  • Vector bucket: A new bucket type that serves as a cloud resource for managing large-scale vector data.

  • Vector index: You can create vector indexes in a vector bucket. A vector index is an index table for storing vector data. You can create multiple vector indexes in a single vector bucket to organize data for different business needs. When you initiate a retrieval query, the query returns results based on the similarity of the vector data within the specified vector index.

  • Vector data: High-dimensional numerical arrays generated from unstructured data, such as images, videos, and documents, using vector embedding models. These arrays represent the content features of the data. Vector retrieval returns results based on the similarity between these vectors. You can use any vectorization service, such as ECS, PAI, or Model Studio, to generate vectors and then write them to a specified vector index by using the OSS API, SDKs, or the ossutil tool. When writing data, you can also attach metadata for subsequent scalar filtering.

Benefits

  • Low cost: Vector data has become essential infrastructure for various AI applications and is growing exponentially. OSS Vectors features a simple, transparent billing model that charges for only two items: vector data storage and the amount of data scanned during retrieval. This can reduce costs by more than 90% compared with traditional methods.

  • Large scale: OSS Vectors is architected to store and manage massive volumes of vector data. It is built on a serverless framework that automatically handles scaling, eliminating the need for capacity planning.

  • Easy to use: OSS Vectors provides a comprehensive set of APIs, SDKs, and the ossutil command-line tool. You can also manage vector data in the OSS console with operations such as retrieval, insertion, and bulk insertion.

  • Unified management: You can manage vector buckets and standard buckets that store raw data in a consistent manner. For example, you can apply the same Bucket Policy for access control or configure a common log export path for auditing.

  • Semantic retrieval: You can use the QueryVectors operation to query vector data in an index and receive results sorted by similarity. OSS Vectors also supports filtering based on scalar metadata. You can attach metadata when writing vector data to a vector bucket for post-filtering. When you create a vector index, you can also define non-filterable metadata. This type of metadata cannot be used for filtering but is returned with the retrieval results to provide descriptive information for the vector.

Use cases

Build low-cost RAG applications

As AI services expand, the exponential growth of vector data increases the pressure on storage and retrieval costs. For multi-modal retrieval scenarios like knowledge bases, AI assistants, and medical image retrieval, users are becoming more tolerant of retrieval latencies in the range of tens to hundreds of milliseconds. In these cases, using OSS Vectors as the storage foundation for your RAG applications can meet business requirements at an extremely low cost.

Build AI agents with tiered retrieval

Different AI agents have varying retrieval performance needs. You can centralize all your vector data in a low-cost vector bucket. For business scenarios that demand high performance and low latency, you can synchronize hot data to other products such as Tablestore for high-performance retrieval. This allows you to build an AI agent application architecture with tiered retrieval.

Build a unified AI content platform

AI applications generate massive amounts of unstructured content (such as user-generated content, internal documents, and AI-generated content) and their corresponding vectors, which can lead to fragmented storage and retrieval systems. By storing raw data in standard OSS buckets and vector data in vector buckets, you can build an efficient AI data management platform for use cases like AIGC data management. A single set of APIs and SDKs allows you to manage both raw files and vector indexes, simplifying the creation of a unified AI content platform.

Enterprise features

Endpoint access

OSS Vectors provides separate public and internal endpoints that are isolated from standard OSS buckets.

  • Public endpoint: $bucketname-$uid.regionID.oss-vectors.aliyuncs.com

  • Internal endpoint: $bucketname-$uid.regionID-internal.oss-vectors.aliyuncs.com

Note: You must use a third-level domain for all operations except ListVectorBuckets.

Secure transfer

HTTPS encrypts all data in transit.

Access control

  • Bucket Policy: Supports resource-based authorization policies that allow you to control permissions at the vector bucket level or for one or more vector indexes.

  • RAM Policy: Supports identity-based RAM authorization policies for fine-grained permission control over vector buckets, vector indexes, and data operations. These policies also support cross-account access authorization.

Logging

  • Access log export: Supports exporting access logs to a specified bucket in real time or near-real time.

  • Unified log format: The log format is fully compatible with standard OSS logs. It includes an additional BucketARN field to uniquely identify the vector bucket resource, which simplifies unified log analysis.

Quotas and limits

OSS Vectors has certain quotas and limits. When designing and implementing your vector storage and retrieval solution, plan your number of buckets, index scale, metadata structure, and API call strategy based on the following limits. To request an increase for any of the following quotas, contact Technical Support.

  • A single Alibaba Cloud account can create a maximum of 100 vector buckets in a region.

  • A single vector bucket can contain a maximum of 100 vector indexes.

  • A single vector index can store a maximum of 2 billion rows of vector data.

  • Vector dimensions: 1 to 4,096.

  • TopK range for vector retrieval requests: 1 to 500 by default.

  • Total size of a single vector array: 1 KB to 500 KB.

  • Maximum total size of metadata (filterable and non-filterable) for a single vector: 200 KB.

  • Maximum size of a single filterable metadata field for a single vector: 2 KB.

  • Maximum number of metadata fields (filterable and non-filterable) for a single vector: 100.

  • Scalar metadata supports four data types: String, Number, Boolean, and List.

  • When you use metadata to filter vectors:

    • The cumulative length of filterable metadata in a single filter instruction cannot exceed 20 KB.

    • The number of filterable metadata items in a single filter instruction cannot exceed 1,024.

    • Filter conditions support a maximum of 8 nested levels.

  • When you use the QueryVectors or ListVectors operation for scalar filtering, the following operators are supported:

    • Equality: $eq, $ne

    • Range: $gt, $gte, $lt, $lte

    • Inclusion: $in, $nin

    • Existence: $exists

    • Logical: $and, $or

  • The PutVectorIndex operation is limited to 5 calls per second.

  • The PutVectors operation has a QPS (Queries Per Second) limit of 1,000. A single concurrent request can write up to 500 entries per batch. The total throughput across all concurrent requests cannot exceed 2,500 entries per second. For example, if each concurrent request writes 100 entries in a batch, the maximum supported write QPS is 25 (2,500 / 100).

  • The QPS limit for the QueryVectors operation is 100.

    • Note: Retrieval QPS depends on factors such as the number of vectors in a single index, vector dimensions, the TopK value, and the scalar metadata conditions in the query. In a typical setup with 10 million rows of 1,024-dimensional vectors and a TopK value of 100, the query QPS can usually reach 100. As the index size or the TopK value increases, the actual retrieval QPS may decrease. OSS Vectors does not guarantee that the QPS will reach 100. Test with your workload to confirm actual performance.

  • The ListVectorIndexes operation returns a maximum of 500 indexes per page. You can use pagination to retrieve the next batch of indexes.

  • The maximum concurrency for the ListVectorIndexes operation is 16.

Billing

OSS Vectors officially started commercial billing on June 10, 2026 (UTC+8). Please monitor your bills. For more information about the billing method, see Vector billing items.