PPU-V2.0.0 PIP包清单
更新说明：
从PIP List 1.6.x 开始我们提供OS Free PIP软件包，即使用Ubuntu和其他Base OS（包括但不限于AliOS等）的AI容器镜像都可以使用相同的安装指令进行安装。从PIP List 1.7.x开始引入了不区分CUDA Version的OS/CUDA Free PIP软件包。
从PIP List 1.6.x 开始，PIP List不再细化小版本增量文件方式更新，比如：所有1.7.x的更新都会收录在“1.7.x”这单个文件中，预计会按周增量添加新的PIP软件包，欢迎查看本文档最新版本。
PPU PIP服务提供了两种使用方式，具体可以参考在ACS上使用PPU PIP服务和在PAI中使用PPU PIP源，用户可以按需使用：
“PTG提供的PPU PIP服务”：支持通过公网+显式鉴权方式使用PTG提供的PPU PIP服务。
“阿里云提供的PPU PIP服务”：支持通过VPC+免鉴权方式使用阿里云提供的PPU PIP服务（推荐的使用方式）。
pip install命令中的-i <IndexURL>选项为可选，具体请参考您使用的云产品提供的指导文档。<IndexURL>根据使用的PPU PIP服务而不同，您可按需选择。如下整理了部分<IndexURL>：
# 1.1 PTG提供的PPU PIP服务的Index URL格式（<=v1.5.3）：
https://art-pub.eng.t-head.cn/artifactory/api/pypi/ptgai-pypi_ppu_ubuntu_<cuda-version>_index/simple/
## PTG提供的PPU PIP服务的Index URL具体实例（部分）：
https://art-pub.eng.t-head.cn/artifactory/api/pypi/ptgai-pypi_ppu_ubuntu_cu128_index/simple/
https://art-pub.eng.t-head.cn/artifactory/api/pypi/ptgai-pypi_ppu_ubuntu_cu129_index/simple/
# 1.2 PTG提供的PPU PIP服务的Index URL格式：
## 1.2.1 PTG提供的PPU PIP服务的Index URL格式(OS Free模式，v1.6.x引入)：
https://art-pub.eng.t-head.cn/artifactory/api/pypi/<cuda-version>_index/simple/
### PTG提供的PPU PIP服务的Index URL具体实例（OS Free模式，部分）：
https://art-pub.eng.t-head.cn/artifactory/api/pypi/cu128_index/simple/
https://art-pub.eng.t-head.cn/artifactory/api/pypi/cu129_index/simple/
## 1.2.2 PTG提供的PPU PIP服务的Index URL格式（OS/CUDA Free模式，v1.7.x引入）：
### v1.7.x与v1.6.x 相比不用指明cuda version，统一Index URL（只有这一个）：
https://art-pub.eng.t-head.cn/artifactory/api/pypi/pypi_index/simple/
# 相应地，以上1.1、1.2.1和1.2.2有相对应的“阿里云提供的PPU PIP服务”的Index URL格式 #
# 2.1 阿里云提供的PPU PIP服务的Index URL格式（<=v1.5.3）：
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/ubuntu_<cuda-version>/simple/
## 阿里云提供的PPU PIP服务的Index URL具体实例（部分）：
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/ubuntu_cu128/simple/
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/ubuntu_cu129/simple/
# 2.2 阿里云提供的PPU PIP服务的Index URL格式：
## 2.2.1 阿里云提供的PPU PIP服务的Index URL格式(OS Free模式，v1.6.x引入)：
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/<cuda-version>/simple/
### 阿里云提供的PPU PIP服务的Index URL具体实例（OS Free模式，部分）：
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/cu128/simple/
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/cu129/simple/
## 2.2.2 阿里云提供的PPU PIP服务的Index URL格式（OS/CUDA Free模式，v1.7.x引入）：
### v1.7.x与v1.6.x 相比不用指明cuda version，统一Index URL(只有这一个)
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/pypi_index/simple/v2.0.x PIP为增量发布，缺少的包请参考并直接使用PPU-V1.7.0 PIP包清单中的内容。
item | version | os | cuda | framework | python | type | cmd line (OS Free) |
acext | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
acext | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
acext | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
acext | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.12 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
acext | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.8.0 | 3.12 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
acext | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
apex | 25.9 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install apex==25.9 (-i <IndexURL>) |
bitsandbytes | 0.49.1 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install bitsandbytes==0.49.1 (-i <IndexURL>) |
deep_ep | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install deep_ep==1.0.0 (-i <IndexURL>) |
deep_ep | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install deep_ep==1.0.0 (-i <IndexURL>) |
deep_ep | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install deep_ep==1.0.0 (-i <IndexURL>) |
deep_gemm | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install deep_gemm==1.0.0 (-i <IndexURL>) |
deep_gemm | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install deep_gemm==1.0.0 (-i <IndexURL>) |
fairscale | 0.4.13 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | ce | pip install fairscale==0.4.13 (-i <IndexURL>) |
fairscale | 0.4.13 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | ce | pip install fairscale==0.4.13 (-i <IndexURL>) |
fairscale | 0.4.13 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | ce | pip install fairscale==0.4.13 (-i <IndexURL>) |
fbgemm_gpu | 1.4.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install fbgemm_gpu==1.4.0 (-i <IndexURL>) |
flash_attn | 2.7.4.post1 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flash_attn==2.7.4.post1 (-i <IndexURL>) |
flash_attn | 2.7.4.post1 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install flash_attn==2.7.4.post1 (-i <IndexURL>) |
flash_attn | 2.7.4.post1 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install flash_attn==2.7.4.post1 (-i <IndexURL>) |
flash_attn | 2.7.4.post1 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flash_attn==2.7.4.post1 (-i <IndexURL>) |
flash_attn | 2.8.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flash_attn==2.8.2 (-i <IndexURL>) |
flash_attn | 2.8.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install flash_attn==2.8.2 (-i <IndexURL>) |
flash_attn | 2.8.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install flash_attn==2.8.2 (-i <IndexURL>) |
flash_attn | 2.8.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flash_attn==2.8.2 (-i <IndexURL>) |
flash_attn_3 | 2.8.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flash_attn_3==2.8.2 (-i <IndexURL>) |
flash_attn_3 | 2.8.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install flash_attn_3==2.8.2 (-i <IndexURL>) |
flash_attn_3 | 2.8.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install flash_attn_3==2.8.2 (-i <IndexURL>) |
flash_attn_3 | 2.8.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flash_attn_3==2.8.2 (-i <IndexURL>) |
flash_mla | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flash_mla==1.0.0 (-i <IndexURL>) |
flash_mla | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flash_mla==1.0.0 (-i <IndexURL>) |
flash_mla | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install flash_mla==1.0.0 (-i <IndexURL>) |
flash_mla | 1.0.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install flash_mla==1.0.0 (-i <IndexURL>) |
flashinfer_python | 0.4.0rc3 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flashinfer_python==0.4.0rc3 (-i <IndexURL>) |
flashinfer_python | 0.4.0rc3 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install flashinfer_python==0.4.0rc3 (-i <IndexURL>) |
flashinfer_python | 0.4.0rc3 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install flashinfer_python==0.4.0rc3 (-i <IndexURL>) |
flashinfer_python | 0.5.3 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flashinfer_python==0.5.3 (-i <IndexURL>) |
flashinfer_python | 0.5.3 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flashinfer_python==0.5.3 (-i <IndexURL>) |
flashinfer_python | 0.6.1 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flashinfer_python==0.6.1 (-i <IndexURL>) |
flashinfer_python | 0.6.3 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flashinfer_python==0.6.3 (-i <IndexURL>) |
grouped_gemm | 0.1.6 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install grouped_gemm==0.1.6 (-i <IndexURL>) |
grouped_gemm | 0.1.6 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install grouped_gemm==0.1.6 (-i <IndexURL>) |
grouped_gemm | 0.1.6 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install grouped_gemm==0.1.6 (-i <IndexURL>) |
grouped_gemm | 1.1.4 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install grouped_gemm==1.1.4 (-i <IndexURL>) |
grouped_gemm | 1.1.4 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install grouped_gemm==1.1.4 (-i <IndexURL>) |
grouped_gemm | 1.1.4 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install grouped_gemm==1.1.4 (-i <IndexURL>) |
grouped_gemm | 1.1.4 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install grouped_gemm==1.1.4 (-i <IndexURL>) |
holmes_compiler | 0.7.0 | Ubuntu 22.04 | cuda 11.8 | 3.10 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_compiler | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_compiler | 0.7.0 | Ubuntu 20.04 | cuda 11.4 | 3.8 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_compiler | 0.7.0 | Ubuntu 20.04 | cuda 11.6 | 3.8 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_compiler | 0.7.0 | Ubuntu 22.04 | cuda 12.2 | 3.10 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_compiler | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_frontend | 0.7.0 | Ubuntu 22.04 | cuda 11.8 | torch 2.1.0 | 3.10 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.2.0 | 3.10 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.4.0 | 3.10 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 22.04 | cuda 12.8 | torch 2.8.0 | 3.10 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_runtime | 0.7.0 | Ubuntu 22.04 | cuda 11.8 | 3.10 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime | 0.7.0 | Ubuntu 20.04 | cuda 11.4 | 3.8 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime | 0.7.0 | Ubuntu 20.04 | cuda 11.6 | 3.8 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime | 0.7.0 | Ubuntu 22.04 | cuda 12.2 | 3.10 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 11.8 | torch 2.1.0 | 3.10 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.2.0 | 3.10 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.4.0 | 3.10 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 12.8 | torch 2.8.0 | 3.10 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_tools_tf | 0.7.0 | Ubuntu 20.04 | cuda 11.8 | 3.8 | oe | pip install holmes_tools_tf==0.7.0 (-i <IndexURL>) | |
holmes_tools_tf | 0.7.0 | Ubuntu 20.04 | cuda 11.6 | 3.8 | oe | pip install holmes_tools_tf==0.7.0 (-i <IndexURL>) | |
holmes_tools_tf | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install holmes_tools_tf==0.7.0 (-i <IndexURL>) | |
holmes_tools_tf | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install holmes_tools_tf==0.7.0 (-i <IndexURL>) | |
holmes_tools_torch | 0.7.0 | Ubuntu 20.04 | cuda 11.6 | 3.8 | oe | pip install holmes_tools_torch==0.7.0 (-i <IndexURL>) | |
holmes_tools_torch | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install holmes_tools_torch==0.7.0 (-i <IndexURL>) | |
jax | 0.4.34 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install jax==0.4.34 (-i <IndexURL>) | |
jax | 0.4.34 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install jax==0.4.34 (-i <IndexURL>) | |
jax | 0.4.34 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax==0.4.34 (-i <IndexURL>) | |
jax | 0.4.34 | Ubuntu 22.04 | cuda 12.8 | 3.10 | oe | pip install jax==0.4.34 (-i <IndexURL>) | |
jax | 0.7.2 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax==0.7.2 (-i <IndexURL>) | |
jax | 0.7.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install jax==0.7.2 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.4.34 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install jax_cuda12_pjrt==0.4.34 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.4.34 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install jax_cuda12_pjrt==0.4.34 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.4.34 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax_cuda12_pjrt==0.4.34 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.4.34 | Ubuntu 22.04 | cuda 12.8 | 3.10 | oe | pip install jax_cuda12_pjrt==0.4.34 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.7.2 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax_cuda12_pjrt==0.7.2 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.7.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install jax_cuda12_pjrt==0.7.2 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.4.34 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install jax_cuda12_plugin==0.4.34 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.4.34 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install jax_cuda12_plugin==0.4.34 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.4.34 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax_cuda12_plugin==0.4.34 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.4.34 | Ubuntu 22.04 | cuda 12.8 | 3.10 | oe | pip install jax_cuda12_plugin==0.4.34 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.7.2 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax_cuda12_plugin==0.7.2 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.7.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install jax_cuda12_plugin==0.7.2 (-i <IndexURL>) | |
jaxlib | 0.4.34 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install jaxlib==0.4.34 (-i <IndexURL>) | |
jaxlib | 0.4.34 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install jaxlib==0.4.34 (-i <IndexURL>) | |
jaxlib | 0.4.34 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jaxlib==0.4.34 (-i <IndexURL>) | |
jaxlib | 0.4.34 | Ubuntu 22.04 | cuda 12.8 | 3.10 | oe | pip install jaxlib==0.4.34 (-i <IndexURL>) | |
jaxlib | 0.7.2 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jaxlib==0.7.2 (-i <IndexURL>) | |
jaxlib | 0.7.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install jaxlib==0.7.2 (-i <IndexURL>) | |
mmcv | 2.1.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install mmcv==2.1.0 (-i <IndexURL>) |
mmcv | 2.1.0 | Ubuntu 24.04 | cuda 12.6 | torch 2.9.0 | 3.12 | ce | pip install mmcv==2.1.0 (-i <IndexURL>) |
mmcv | 2.2.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install mmcv==2.2.0 (-i <IndexURL>) |
mmcv | 2.2.0 | Ubuntu 24.04 | cuda 12.6 | torch 2.9.0 | 3.12 | ce | pip install mmcv==2.2.0 (-i <IndexURL>) |
mmdet3d | 1.4.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install mmdet3d==1.4.0 (-i <IndexURL>) |
mmdet3d | 1.4.0 | Ubuntu 24.04 | cuda 12.6 | torch 2.9.0 | 3.12 | ce | pip install mmdet3d==1.4.0 (-i <IndexURL>) |
mmsegmentation | 1.2.2 | Ubuntu 24.04 | cuda 12.6 | 3.12 | ce | pip install mmsegmentation==1.2.2 (-i <IndexURL>) | |
numba | 0.59.0 | Ubuntu 24.04 | cuda 12.6 | 3.12 | ce | pip install numba==0.59.0 (-i <IndexURL>) | |
numba | 0.63.1 | Ubuntu 24.04 | cuda 12.9 | 3.12 | ce | pip install numba==0.63.1 (-i <IndexURL>) | |
nvshmem4py_cu12 | 0.1.2 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install nvshmem4py_cu12==0.1.2 (-i <IndexURL>) | |
nvshmem4py_cu12 | 0.1.2 | Ubuntu 24.04 | cuda 12.6 | 3.12 | oe | pip install nvshmem4py_cu12==0.1.2 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install onnxruntime_gpu==1.23.0 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.0 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install onnxruntime_gpu==1.23.0 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.0 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install onnxruntime_gpu==1.23.0 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install onnxruntime_gpu==1.23.2 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.2 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install onnxruntime_gpu==1.23.2 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.2 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install onnxruntime_gpu==1.23.2 (-i <IndexURL>) | |
open3d | 0.19.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install open3d==0.19.0 (-i <IndexURL>) |
open3d | 0.19.0 | Ubuntu 24.04 | cuda 12.6 | torch 2.9.0 | 3.12 | ce | pip install open3d==0.19.0 (-i <IndexURL>) |
PyNvVideoCodec | 2.0.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install PyNvVideoCodec==2.0.2 (-i <IndexURL>) | |
PyNvVideoCodec | 2.0.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install PyNvVideoCodec==2.0.2 (-i <IndexURL>) | |
PyNvVideoCodec | 2.0.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | 3.10 | oe | pip install PyNvVideoCodec==2.0.2 (-i <IndexURL>) | |
qlean | 0.1.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install qlean==0.1.0 (-i <IndexURL>) | |
sailshmem | 2.0.0 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install sailshmem==2.0.0 (-i <IndexURL>) | |
sailshmem | 2.0.0 | Ubuntu 24.04 | cuda 12.6 | 3.12 | oe | pip install sailshmem==2.0.0 (-i <IndexURL>) | |
sgl_kernel | 0.1.7 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sgl_kernel==0.1.7 (-i <IndexURL>) |
sgl_kernel | 0.1.7 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sgl_kernel==0.1.7 (-i <IndexURL>) |
sgl_kernel | 0.3.14.post1 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sgl_kernel==0.3.14.post1 (-i <IndexURL>) |
sgl_kernel | 0.3.16.post5 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sgl_kernel==0.3.16.post5 (-i <IndexURL>) |
sgl_kernel | 0.3.18.post2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sgl_kernel==0.3.18.post2 (-i <IndexURL>) |
sgl_kernel | 0.3.20 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sgl_kernel==0.3.20 (-i <IndexURL>) |
sgl_kernel | 0.3.21 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sgl_kernel==0.3.21 (-i <IndexURL>) |
sgl_kernel | 0.3.9.post2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sgl_kernel==0.3.9.post2 (-i <IndexURL>) |
sgl_kernel | 0.3.9.post2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sgl_kernel==0.3.9.post2 (-i <IndexURL>) |
sgl_kernel | 0.3.9.post2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sgl_kernel==0.3.9.post2 (-i <IndexURL>) |
sglang | 0.4.7 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sglang==0.4.7 (-i <IndexURL>) |
sglang | 0.4.7 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sglang==0.4.7 (-i <IndexURL>) |
sglang | 0.5.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang==0.5.2 (-i <IndexURL>) |
sglang | 0.5.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sglang==0.5.2 (-i <IndexURL>) |
sglang | 0.5.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sglang==0.5.2 (-i <IndexURL>) |
sglang | 0.5.3 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang==0.5.3 (-i <IndexURL>) |
sglang | 0.5.5 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang==0.5.5 (-i <IndexURL>) |
sglang | 0.5.6 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang==0.5.6 (-i <IndexURL>) |
sglang | 0.5.7 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sglang==0.5.7 (-i <IndexURL>) |
sglang | 0.5.8 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sglang==0.5.8 (-i <IndexURL>) |
sglang | 0.5.9 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sglang==0.5.9 (-i <IndexURL>) |
sglang_router | 0.1.4 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sglang_router==0.1.4 (-i <IndexURL>) |
sglang_router | 0.1.4 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sglang_router==0.1.4 (-i <IndexURL>) |
sglang_router | 0.1.9 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang_router==0.1.9 (-i <IndexURL>) |
sglang_router | 0.1.9 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sglang_router==0.1.9 (-i <IndexURL>) |
sglang_router | 0.1.9 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sglang_router==0.1.9 (-i <IndexURL>) |
sglang_router | 0.2.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang_router==0.2.2 (-i <IndexURL>) |
sglang_router | 0.2.3 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang_router==0.2.3 (-i <IndexURL>) |
sglang_router | 0.3.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sglang_router==0.3.0 (-i <IndexURL>) |
sglang_router | 0.3.2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sglang_router==0.3.2 (-i <IndexURL>) |
tensorflow_gpu | 0.7.0 | Ubuntu 20.04 | cuda 11.6 | 3.8 | oe | pip install tensorflow_gpu==0.7.0 (-i <IndexURL>) | |
tensorrt | 0.8.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install tensorrt==0.8.0 (-i <IndexURL>) |
tensorrt | 10.13.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install tensorrt==10.13.2 (-i <IndexURL>) | |
tensorrt | 10.13.2 | Ubuntu 22.04 | cuda 11.8 | 3.10 | oe | pip install tensorrt==10.13.2 (-i <IndexURL>) | |
tensorrt_llm | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install tensorrt_llm==0.7.0 (-i <IndexURL>) |
tensorrt_llm | 0.8.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install tensorrt_llm==0.8.0 (-i <IndexURL>) |
torch | 2.6.0 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install torch==2.6.0 (-i <IndexURL>) | |
torch | 2.7.0 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install torch==2.7.0 (-i <IndexURL>) | |
torch | 2.8.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install torch==2.8.0 (-i <IndexURL>) | |
torch | 2.9.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install torch==2.9.0 (-i <IndexURL>) | |
torch | 2.9.0 | Ubuntu 24.04 | cuda 12.6 | 3.12 | oe | pip install torch==2.9.0 (-i <IndexURL>) | |
torch_memory_saver | 0.0.8 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install torch_memory_saver==0.0.8 (-i <IndexURL>) |
torch_memory_saver | 0.0.8 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install torch_memory_saver==0.0.8 (-i <IndexURL>) |
torch_memory_saver | 0.0.8 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install torch_memory_saver==0.0.8 (-i <IndexURL>) |
torch_memory_saver | 0.0.9 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install torch_memory_saver==0.0.9 (-i <IndexURL>) |
torch_memory_saver | 0.0.9 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install torch_memory_saver==0.0.9 (-i <IndexURL>) |
torch_memory_saver | 0.0.9rc2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install torch_memory_saver==0.0.9rc2 (-i <IndexURL>) |
torch_memory_saver | 0.0.9rc2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install torch_memory_saver==0.0.9rc2 (-i <IndexURL>) |
torch_memory_saver | 0.0.9rc2 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install torch_memory_saver==0.0.9rc2 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.2.0 | 3.10 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.4.0 | 3.10 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 22.04 | cuda 12.8 | torch 2.8.0 | 3.10 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torchaudio | 2.9.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install torchaudio==2.9.0 (-i <IndexURL>) |
torchcodec | 0.9.1 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install torchcodec==0.9.1 (-i <IndexURL>) |
torchrec | 1.4.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install torchrec==1.4.0 (-i <IndexURL>) |
torchvision | 0.24.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install torchvision==0.24.0 (-i <IndexURL>) |
transformer_engine | 2.10 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install transformer_engine==2.10 (-i <IndexURL>) |
transformer_engine | 2.8 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install transformer_engine==2.8 (-i <IndexURL>) |
transformer_engine | 2.8 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install transformer_engine==2.8 (-i <IndexURL>) |
transformer_engine | 2.8 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install transformer_engine==2.8 (-i <IndexURL>) |
triton | 3.3.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install triton==3.3.0 (-i <IndexURL>) | |
triton | 3.3.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install triton==3.3.0 (-i <IndexURL>) | |
triton | 3.3.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | 3.10 | oe | pip install triton==3.3.0 (-i <IndexURL>) | |
triton | 3.4.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install triton==3.4.0 (-i <IndexURL>) | |
triton | 3.4.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install triton==3.4.0 (-i <IndexURL>) | |
triton | 3.4.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | 3.10 | oe | pip install triton==3.4.0 (-i <IndexURL>) | |
triton | 3.4.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda12.4 | torch 2.8.0 | 3.10 | oe | pip install triton==3.4.0 (-i <IndexURL>) |
triton | 3.5.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install triton==3.5.0 (-i <IndexURL>) | |
vllm | 0.11.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install vllm==0.11.0 (-i <IndexURL>) |
vllm | 0.11.1 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install vllm==0.11.1 (-i <IndexURL>) |
vllm | 0.12.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install vllm==0.12.0 (-i <IndexURL>) |
vllm | 0.13.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.13.0 (-i <IndexURL>) |
vllm | 0.14.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.14.0 (-i <IndexURL>) |
vllm | 0.15.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.15.0 (-i <IndexURL>) |
vllm | 0.16.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.16.0 (-i <IndexURL>) |
warp_lang | 1.10.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install warp_lang==1.10.0 (-i <IndexURL>) | |
warp_lang | 1.10.0 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install warp_lang==1.10.0 (-i <IndexURL>) | |
xformers | 0.0.30 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install xformers==0.0.30 (-i <IndexURL>) |
xformers | 0.0.30 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install xformers==0.0.30 (-i <IndexURL>) |
xformers | 0.0.30 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install xformers==0.0.30 (-i <IndexURL>) |
xformers | 0.0.30 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install xformers==0.0.30 (-i <IndexURL>) |
torch | 2.1.2 | Ubuntu 20.04 | cuda12.1 | 3.8 | oe | pip install torch==2.1.2 (-i <IndexURL>) | |
torchvision | 0.16.2 | Ubuntu 20.04 | cuda12.1 | torch2.1.2 | 3.8 | ce | pip install torchvision==0.16.2 (-i <IndexURL>) |
torchaudio | 2.1.2 | Ubuntu 20.04 | cuda12.1 | torch2.1.2 | 3.8 | ce | pip install torchaudio==2.1.2 (-i <IndexURL>) |
flash_attn | 2.5.7 | Ubuntu 22.04 | cuda 11.8 | torch 2.1.0 | 3.10 | oe | pip install flash_attn==2.5.7 (-i <IndexURL>) |
vllm | 0.17.1 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.17.1 (-i <IndexURL>) |
flashinfer_python | 0.6.4 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flashinfer_python==0.6.4 (-i <IndexURL>) |
vllm | 0.18.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.18.0 (-i <IndexURL>) |
torchao | 0.9.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install torchao==0.9.0 (-i <IndexURL>) |
torch_memory_saver | 0.0.9 | Ubuntu 22.04、Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install torch_memory_saver==0.0.9 (-i <IndexURL>) |