Manage MaxCompute resources

更新时间:
复制 MD 格式

Use the MaxCompute Resources pane to view resources in the MaxCompute compute engine, check their change history, and add resource files to a workflow in DataStudio.

Limits

Only resources up to 500 MB that you upload using the MaxCompute client (odpscmd) can be loaded into a DataStudio workflow. You can then visually manage and use these resources in DataStudio.

View resources

  1. Go to the DataStudio page.

    Log on to the DataWorks console. In the target region, click Data Development and O&M > Data Development in the left-side navigation pane. Select a workspace from the drop-down list and click Go to Data Development.

  2. In the navigation pane on the left, expand MaxCompute and click MaxCompute Resources.

    No.

    Icon

    Description

    切换

    By default, the pane displays resources in the Production environment. To view resources that are committed but not yet published, click the 切换环境 icon to switch environments.

    On the right side of the MaxCompute Resources panel, click Development Environment or Production Environment to switch and view the resource list for the corresponding environment.

    Note

    Workspaces in basic mode have only a production environment.

    1

    Click to filter the list by resource type.

    Note

    Supported resource types include Jar, Archive, File, and Python.

    排序

    Click to change the sort order. By default, resources are sorted by update time in descending order.

  3. Click a resource to view its details, such as Resource Name, Resource Type, and Resource Size.

    • The resources listed in the MaxCompute Resources pane do not always match the resources in the Data Studio pane.

      • A resource in the Data Studio pane appears in the development or production environment on the MaxCompute Resources pane only after you select Upload as ODPS Resource and then Submission or Deploy it.

      • Resource files uploaded through non-DataWorks channels, such as the MaxCompute client or MaxCompute Studio, appear in the MaxCompute Resources pane but not in the Data Studio pane. Updates to the resource list in the MaxCompute Resources pane may be delayed. To find the resource immediately, use commands. For more information, see Appendix 1: Use commands to manage resources.

    • Resources from the MaxCompute Resources pane behave differently than resources in the Data Studio pane.

      Use cases

      DataStudio

      MaxCompute resources

      Use in an ODPS SQL node

      Yes, but the resource must also be uploaded to MaxCompute.

      Yes

      Use in an ODPS MR node

      Yes, but the resource must also be uploaded to MaxCompute.

      No

      Use in a Shell node

      Yes

      No

      Use in an ad hoc query

      Yes, but the resource must also be uploaded to MaxCompute.

      Yes

      Create a function in a workflow

      Yes, but the resource must also be uploaded to MaxCompute.

      No

Add a resource to DataStudio

This diagram provides an overview of the process for adding a resource to DataStudio.数据开发

  1. Find the resource you need and click Add to Data Analytics.

    This operation syncs a resource file from the MaxCompute Resources pane to a workflow in Data Studio.

  2. In the Create Resource dialog box, enter a Resource Name, select a Location, click Click Upload, and then select the file to upload.

    During the upload process, you can perform the following operations:

    • Rename the resource.

    • Select a different path to change the workflow where the resource is located.

    During the upload process, you cannot perform the following operations:

    • Change the resource type.

    • Change the Upload as ODPS Resource selection.

    • Re-upload the file.

  3. After completing the configuration, click Create.

    Note
    • After creating the resource, you must manually save, commit, and publish it, following the same procedure as for other workflow resources. For more information, see Create and use MaxCompute resources.

    • When you commit and publish the resource, it is also uploaded to the MaxCompute development and production environments, and the corresponding file in the MaxCompute Resources pane is updated.

    • Resource names must be unique within a MaxCompute project. If a resource with the same name already exists in the workspace, adding it will overwrite the original. If the original resource is in a different workflow, it is moved to the new workflow.

View change history

To view a resource's change history, click View Change History.