Object storage service paths

Updated at:

Ganos supports file import from Alibaba Cloud Object Storage Service (OSS), MinIO, and Hadoop Distributed File System (HDFS).

OSS path

Use the following path format:

oss://<access_id>:<secrect_key>@[<Endpoint>]/<bucket>/path_to/file

If you omit Endpoint, the system finds the matching endpoint automatically. In that case, the path must start with a forward slash (/).

Endpoint is the OSS regional endpoint. To keep your data accessible, deploy the database and OSS in the same region, and use an internal network address. For more information, see Use an endpoint that supports IPv6 to access OSS.

MinIO path

Use the following path format:

mio://<id>:<key>@<host>[:<port>]/<bucket>/path_to/file

If you omit port, the HTTPS port is used.

To keep data import accessible and fast, deploy the database and your self-managed MinIO in the same region and the same virtual private cloud (VPC). Use an internal network address.

HDFS path

Use the following path format:

HDFS://<user_name>@<host>:<port>/path_to/file

Where:

  • If you omit user_name, hadoop is used automatically.

  • host is the Remote Procedure Call (RPC) access address and port in your HDFS configuration file.

    To keep data import accessible and fast, deploy the database and HDFS in the same region and the same VPC. Use an internal network address.

Examples

OSS

OSS://my_id:my_secret@oss-cn-hangzhou-internal.aliyuncs.com/my_bucket/my_folder/my_file

MinIO

MIO://my_id:my_secret@250.0.0.1:8080/my_bucket/my_folder/my_file

HDFS

  • Without a secret:

HDFS://my_id@250.0.0.1:8081/my_folder/my_file
  • With a secret:

HDFS://my_id:my_secret@250.0.0.1:8081/my_folder/my_file