CPFS overview
This topic introduces the editions of Cloud Parallel File Storage (CPFS), compares them, and explains how to get started with CPFS.
What is CPFS
Cloud Parallel File Storage (CPFS) is a fully managed and scalable parallel file system from Alibaba Cloud, designed for high-performance computing (HPC) workloads. CPFS provides a unified namespace that allows hundreds or thousands of machines to access data concurrently. It delivers tens of GB/s in throughput and millions of IOPS while maintaining sub-millisecond latency.
CPFS editions
CPFS offers the following editions:
CPFS General-purpose Edition: Ideal for HPC workloads that demand high throughput, high IOPS, and support for massive files. Common use cases include AI training, autonomous driving, genomics, media rendering, EDA simulation, oil and gas exploration, and meteorological analysis.
CPFS for Lingjun: Optimized for intelligent computing scenarios such as AIGC and autonomous driving.
Currently, CPFS for Lingjun is compatible only with PAI-Lingjun intelligent computing resources, PAI general computing resources, PAI-Lingjun intelligent computing resources (single-tenant), and Container Compute Service (ACS). It cannot be accessed from ECS instances.
How to choose: If you use PAI or ACS and need extreme performance, choose CPFS for Lingjun. If you need to mount the file system directly on an ECS instance or use the NFS v3 protocol, choose CPFS General-purpose Edition.
Edition comparison
CPFS for Lingjun and CPFS General-purpose Edition have different target customers, use cases, features, and limits, as detailed in the following table.
Category | Comparison criteria | CPFS for Lingjun (invitational preview) | CPFS General-purpose Edition |
Positioning | Target customers | Intelligent computing workloads | HPC workloads |
Product features | Ultra-high throughput and IOPS with an end-to-end RDMA network | High throughput and IOPS | |
Purchase method | Requires whitelisting for purchase. | Available for direct purchase. | |
Purchase | Available specifications |
|
|
Usage | Protocol | POSIX | Interoperability between POSIX and NFS v3 protocols |
Client | Linux | Linux | |
Region |
|
| |
Capacity specifications |
To create a file system of up to 20 PiB, submit a ticket. |
| |
Performance | Throughput |
The maximum throughput can be increased to 2 TB/s. To request this, submit a ticket. |
|
IOPS |
The maximum IOPS can be increased to 30,000,000. To request this, submit a ticket. |
| |
Average latency for a single 4 KB read | 0.25 ms |
| |
Average latency for a single 4 KB write | 0.6 ms |
| |
Elasticity | Elastic scale-out | Supported | Supported |
Elastic scale-in | Not supported | Not supported | |
Scaling method | Manual | Manual | |
Scaling step size | 10 TiB |
| |
Security | ACL-based access control | Not supported | Supported |
Server-side encryption | Not supported | Supported | |
Encryption in transit | Not supported | Supported | |
Stability | Subdirectory mounting | Not supported | Supported |
Dataflow | Supported | Supported | |
Backup | Supported | Supported | |
Locally redundant storage | Supported | Supported | |
Zone-redundant storage | Not supported | Supported only for the 100 MB/s/TiB baseline | |
Cost | Billing method | Pay-as-you-go |
|
Get started with CPFS
Task | CPFS for Lingjun (invitational preview) | CPFS General-purpose Edition | |
Learn about CPFS | |||
View specifications | |||
Create a CPFS file system | |||
Mount a CPFS file system | |||
Use CPFS | Query file system details | ||
Scale out a file system | |||
Protocol service | Not supported | ||
Dataflow | |||
Monitor performance and configure alerts | |||
Migrate data to CPFS | Not supported | ||
Access control | Not supported | ||
View audit logs | Not supported | ||
Back up CPFS data | |||
Zone-redundant storage | Not supported | ||
API reference | |||