Enable OSS-HDFS for a new or existing bucket.
Prerequisites
OSS-HDFS is available in these regions: China (Hangzhou), China (Shanghai), China (Qingdao), China (Beijing), China (Ulanqab), China (Shenzhen), China (Guangzhou), China (Zhangjiakou), China (Hong Kong), Japan (Tokyo), Singapore, Germany (Frankfurt), US (Silicon Valley), US (Virginia), Indonesia (Jakarta), and Thailand (Bangkok). Buckets without a specified region do not support OSS-HDFS.
Billing
-
Metadata management fees
Metadata management is currently free of charge.
-
Data usage fees
OSS-HDFS stores data blocks in OSS and follows standard OSS billing (Billing overview).
Limitations
-
Once enabled, OSS-HDFS cannot be disabled.
-
OSS-HDFS is accessible only through a VPC in the same region as the bucket.
-
OSS-HDFS is not supported for Archive, Cold Archive, or Deep Cold Archive buckets.
-
Do not rename or delete the OSS-HDFS data directory
.dlsdata/or its contents outside of OSS-HDFS. This may cause service disruption or data loss. -
To delete an OSS-HDFS-enabled bucket, delete the OSS-HDFS metadata first, then the OSS data. Otherwise, you cannot delete the bucket.
Enable OSS-HDFS
Enabling OSS-HDFS automatically creates the AliyunOSSDlsDefaultRole role with the AliyunOSSDlsRolePolicy policy. Do not disable, modify, or delete this role or policy — doing so blocks access to the .dlsdata/ data directory and its contents.
For a new bucket
When you create a bucket for the first time with an Alibaba Cloud account or an administrative RAM user, complete role authorization before enabling OSS-HDFS. Create a bucket.
For an existing bucket
To enable OSS-HDFS for an existing bucket with an Alibaba Cloud account or an administrative RAM user:
-
Complete RAM authorization.
Log on to the OSS console.
-
In the left-side navigation pane, click Buckets, then click the target bucket.
-
In the left-side navigation pane, choose .
-
On the OSS-HDFS tab, click Authorize. On first use, you are prompted to complete RAM authorization, which creates the
AliyunOSSDlsDefaultRolerole with theAliyunOSSDlsRolePolicypolicy. Click Authorize.
-
Enable OSS-HDFS.
-
On the OSS-HDFS tab, click Enable OSS HDFS . If RAM authorization completed is displayed, click Enable OSS-HDFS at the bottom of the page.
-
In the dialog box, click OK.
Standard OSS features remain available. To access OSS-HDFS, use the endpoint in the Port section on the bucket's Overview page, for example,
cn-hangzhou.oss-dls.aliyuncs.com.
-
Next steps
After you enable OSS-HDFS, grant RAM users access from EMR or non-EMR clusters. Grant permissions to a RAM user to access OSS-HDFS.