Overview of OSS management tools

更新时间:
复制 MD 格式

OSS provides management tools for uploading files, generating signed URLs, migrating data, and mounting buckets. Third-party tools and community plugins further extend OSS capabilities.

Official tools

Command-line tools

Manage OSS through a terminal or automated scripts.

Tool

Description

ossutil 2.0 (Recommended)

The latest OSS CLI tool.

  • Supports multi-level commands (high-level and API-level) for bucket and object management, including concurrent uploads, resumable uploads, and directory transfers.

  • Supports external credentials, OIDC credentials, and automatic role name retrieval for Instance RAM Role credentials.

  • Supports the --output-format option to output results as JSON, YAML, or XML instead of the default raw format.

ossutil 1.0

The command-line management tool for OSS.

  • Manages buckets and objects.

  • Supports concurrent file uploads and resumable uploads.

  • Supports directory uploads and downloads.

Alibaba Cloud CLI

A unified CLI for managing Alibaba Cloud resources, including OSS data management through standardized commands. For specific operations, see Manage OSS data with Alibaba Cloud CLI in Cloud Shell.

osscmd (deprecated)

This CLI has been unavailable since July 31, 2019. Its features are now part of ossutil.

  • Provided a complete set of commands for managing buckets and objects.

  • Supported Windows and Linux platforms.

Limitations:

  • Compatible with Python 2.5–2.7 only.

  • Lacks support for Infrequent Access (IA), Archive, Cold Archive, Deep Cold Archive, cross-region replication (CRR), or mirroring-based back-to-origin.

Graphical management tools

Browse and manage objects through a graphical interface.

Tool

Description

ossbrowser 2.0 (recommended)

The latest graphical management tool for OSS.

  • Supports most features of the legacy ossbrowser.

  • Adds sign-in methods such as QR code scanning with the Alibaba Cloud app, Alipay, or DingTalk.

  • Supports bucket favorites.

  • Supports in-browser file editing.

  • Redesigned UI for streamlined file management and transfers.

ossbrowser

A graphical management tool.

  • Windows Explorer-like file browsing.

  • Supports direct file browsing.

  • Supports directory uploads and downloads.

  • Supports concurrent uploads and resumable uploads.

  • Supports graphical policy authorization for RAM users.

  • Supports Windows, Linux, and Mac platforms.

Limitations:

  • Slower transfers than ossutil.

  • Move and copy limited to objects under 5 GB.

  • Maximum single file upload: 48.8 TB.

Data migration and synchronization tools

Migrate or synchronize data from other sources to OSS.

Tool

Description

Data Online Migration (Recommended)

A no-code, visual online migration service. Securely migrate large datasets from various sources to OSS with minimal configuration.

Supports AWS S3, Tencent Cloud COS, Huawei Cloud OBS, Volcengine TOS, Google Cloud GCS, Microsoft Azure Blob, and self-hosted S3-compatible storage. Submit and monitor migration jobs online without setting up a migration environment.

Offline migration (Data Transport)

A data migration service that uses customized physical Data Transport devices to migrate terabyte- to petabyte-scale local data to the cloud, improving transfer efficiency and addressing data security challenges.

Suited for data center cloud migrations and enterprise-scale archiving of files and historical image data. Physical media transport overcomes public network bandwidth limitations.

ossimport

A data synchronization tool for OSS.

  • Synchronizes files from third-party data sources to OSS.

  • Supports distributed deployment across multiple servers for batch migration.

  • Handles terabyte-scale and larger migrations.

  • Supports Windows and Linux platforms.

  • Requires Java 7.

File system mounting tools

Mount a bucket as a local directory to manage objects as local files.

Tool

Description

ossfs 2.0 (Recommended)

A re-architected version for compute-intensive applications. Delivers major performance upgrades with some POSIX semantic limitations, and is the primary version for future development. Use ossfs 2.0 for AI training, inference, or autonomous driving simulation when the OSS SDK or OSS Connector for AI/ML is impractical.

  • Basic POSIX compatibility focused on server-side OSS read/write capabilities.

  • High-performance sequential I/O for large objects through end-to-end optimizations.

  • Efficient concurrent loading of small objects through optimized metadata management.

Limitations:

The following limitations apply when mounting a bucket with ossfs 2.0:

  • Permission requirements: The AccessKey must have full permissions for the target bucket or prefix-related resources. Otherwise, the mount may fail or functions may not work correctly.

  • Storage class limitations: Mounting buckets of the Archive, Cold Archive, or Deep Cold Archive storage class is not supported.

  • Object name limitations: Object names cannot exceed 255 characters (Linux limit). Longer names are not visible at the mount point.

  • Write limitations: Random writes are not supported. Writes create non-appendable objects by default. The default part size is 8 MiB, limiting maximum file size to 78.125 GiB. Configure the shard size with the upload_buffer_size mount option.

  • Rename operations (non-atomic)

    • Files: Copies the file, then deletes the remote source.

    • Directories: Copies all files, then batch-deletes the sources. Default limit: 2 million descendant files, configurable via the rename_dir_limit mount option.

  • Concurrent write consistency: Data consistency is not guaranteed when multiple clients write to the same file simultaneously.

  • POSIX API compatibility: Partially compatible. For more information, see POSIX API support.

ossfs 1.0

A bucket mounting tool for Linux. Mounts an OSS bucket to the local file system, enabling local file operations on OSS objects.

  • Supports most POSIX features: file reads/writes, directories, links, permissions, UID/GID, and extended attributes.

  • Supports multipart uploads for large files.

  • Supports MD5 validation to ensure data integrity.

Limits:

The following limits apply when mounting a bucket with ossfs 1.0:

  • Not suitable for high-concurrency read and write scenarios.

    Note
    • Both reads and writes require disk caching, making disk performance the bottleneck in high-concurrency scenarios.

    • Concurrent read and write requests contend for bandwidth.

  • Does not support hard links.

  • Does not support mounting Archive Storage, Cold Archive, or Deep Cold Archive buckets.

  • Editing an uploaded file causes the file to be re-uploaded.

  • Metadata operations such as list directory are slow due to remote OSS server access.

  • Renaming files or folders may fail and cause data inconsistency.

  • If multiple clients mount the same bucket, you must coordinate access to prevent concurrent writes to the same object.

Note

Prefer Cloud Storage Gateway to mount buckets.

AI tools

Access and store OSS data efficiently in AI workflows.

Tool

Description

OSS Connector for AI/ML

A Python library for efficient OSS data access in PyTorch training.

  • Supports map-style datasets for random access during training.

  • Supports iterable-style datasets for sequential stream access.

  • Supports OssCheckpoint objects to load training checkpoints directly to OSS.

Limits:

  • Operating system: Linux x86-64

  • glibc: >=2.17

  • Python: 3.8–3.12

  • PyTorch: >=2.0

  • OSS Checkpoint requires Linux kernel userfaultfd support.

FTP tools

Tool

Description

ossftp

An FTP-based object management tool.

  • Works with FTP clients such as FileZilla, WinSCP, and FlashFXP.

  • Acts as an FTP server that maps file operations to OSS API calls.

  • Based on Python 2.7 and later.

  • Supports Windows, Linux, and macOS platforms.

Development and authorization tools

Integrate with development workflows and manage fine-grained permissions.

Tool

Description

Signature tool

The OSS console provides the following signature tools.

  • Header signature

    Generates and verifies request signatures from specified parameters. Header signature.

  • PostObject Policy signature

    Generates and verifies request signatures for HTML form uploads. PostObject Policy signature.

  • URL signature

    Generates signed URLs for temporary object access with configurable expiration. URL signature.

Important

The signature tool currently supports only V1 signatures.

RAM Policy Editor

An automated generator for OSS authorization policies.

  • Generates policies based on your requirements, usable as RAM custom policies.

  • Supports Chrome, Firefox, and Safari browsers.

Third-party tools and plugins

Community-developed tools and plugins that integrate OSS with popular development tools and frameworks.

Tool

Description

Big Data Tools

A JetBrains IDE plugin for OSS integration in big data workflows.

  • Provides a UI for browsing remote file systems, including OSS.

  • Offers file operations similar to a file manager (copy, move, rename, delete, and download files).

  • Allows you to preview files. For CSV files, you can switch between text and table views.

  • Displays file metadata such as modification time.

  • Allows you to preview binary files, such as Parquet.

  • Allows you to open buckets and folders in multiple tabs.

Connect JetBrains IDEs to OSS using Big Data Tools.

Hacklog Remote Attachment

A WordPress plugin that stores attachments and media on OSS instead of the local server, improving load speed and reducing host storage. How to store remote attachments on OSS for WordPress.

FileZilla

An FTP client for uploading local files to OSS, reducing local storage burden. How to upload local site files to OSS using FileZilla.