PAI-PPU official images-Platform For AI(PAI)-阿里云帮助中心

Image overview

PAI-PPU provides official images to simplify AI development on PAI-PPU instance types, such as ml.gp7vf.16.40xlarge and ml.gp7vf.16.46xlarge. These images integrate the PPU SDK, EIC SDK, and PAI optimization engines to provide an out-of-the-box experience and optimal performance.

Release notes

Usage notes

PAI-PPU training images are supported only within the PAI platform, including modules such as DSW, DLC, and EAS.
PAI-PPU inference images are supported only in PAI-EAS.
Each image requires a PPU driver version that matches the PPU SDK version within the image. For details, see the PAI-PPU image and driver compatibility.
Starting from version 1.5.2, the images use the aiext-pypi pip source by default. This source is restricted to authorized accounts. Ensure that your main account UID is on the allowlist and that you start DSW or DLC instances using a RAM role. The following figures show how to start DSW and DLC instances with a RAM role (you can use either the default PAI role or any custom role).
Note
- To add your main account to the allowlist, contact your account manager (PASA).
- Sub-accounts do not need to be added to the allowlist.

Obtain images

Obtain from the PAI console

In the PAI console, navigate to AI Asset Management > Images to view the list of official images. You can filter by Chip Type to find the PAI-PPU official images.
When you create an instance in a PAI service, such as a DSW instance, you can select an official image. Use the Chip Type filter to quickly find PAI-PPU official images.

Use inference images from Model Gallery

In Model Gallery, on the deployment page, select the Single-GP7V Instance deployment method to use PAI-PPU series inference images.

FAQ

Q: How to check component versions in the image?

A: Use the following commands to check the component versions:

PPU SDK version:
```
cat /usr/local/PPU_SDK/release.yaml
```
EIC SDK version:
```
dpkg -l | grep eic
```
Operating system version:
```
cat /etc/issue
```
CUDA version:
```
nvcc --version
```
Python version:
```
python --version
```

PyTorch version:

python -c "import torch; print(torch.__version__)"

vLLM version:
```
pip list | grep vllm
```
SGLang version:
```
pip list | grep sglang
```

Q: How to check the pip source in the image?

A: Run the following command to check the current pip source:

pip config list

In the output, check the :env:.index-url field. For example:

:env:.index-url='https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/ubuntu_cu128/simple/'

The built-in pip source in an official image must start with aiext-pypi, as shown in the preceding figure.

Q: How to restore the original pip source?

A: If you accidentally modify the built-in pip source of an official image, follow these steps to restore it.

Step 1: Install the authentication plugin

pip install aiext-pypi-plugin -i http://mirrors.cloud.aliyuncs.com/aiext-pypi/aiext-pypi-plugin/simple --trusted-host mirrors.cloud.aliyuncs.com

Step 2: Change the pip source

For versions 1.5.3 and earlier (OS-dependent format)
```
export PIP_INDEX_URL=https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/ubuntu_<cuda-version>/simple/
```
Example:

https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/ubuntu_cu128/simple/

https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/ubuntu_cu129/simple/
For versions 1.6.0 and later (OS-free format)
```
export PIP_INDEX_URL=https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/<cuda-version>/simple/
```
Example:

https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/cu128/simple/

https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/cu129/simple/

For versions 1.7.0 and later (OS/CUDA-free format)

export PIP_INDEX_URL=https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/pypi_index/simple/

Appendix

PAI-PPU image and driver compatibility

Image version	Compatible driver
PAI-PPU-2.1.0	2.1.0
PAI-PPU-2.0.0	2.0.0
PAI-PPU-1.7.0	1.6.1
PAI-PPU-V1.6.1_hotfix2	1.5.5
PAI-PPU-1.6.1	1.6.0
PAI-PPU-1.6.0	1.6.0
PAI-PPU-1.5.4	1.5.3
PAI-PPU-1.5.3	1.5.3
PAI-PPU-1.5.2	1.5.2
PAI-PPU-1.5.1	1.5.1
PAI-PPU-1.4.3	1.4.3
PAI-PPU-1.4.2	1.4.2
PAI-PPU-1.4.1	1.4.1
PAI-PPU-1.4.0	1.4.0
PAI-PPU-1.3.2	1.3.2