PPU-V2.0.0 PIP package manifest
Update notes:
Starting from PIP List 1.6.x, we offer OS-free PIP packages. You can use the same installation instructions for AI container images on any base operating system (OS), such as Ubuntu and AliOS. Starting from PIP List 1.7.x, we also offer OS-free and CUDA-free PIP packages that are not tied to a specific CUDA version.
Starting from PIP List 1.6.x, we no longer provide incremental update files for minor versions. For example, all updates for 1.7.x are now consolidated into a single "1.7.x" file. New PIP packages are added to this file weekly. For the latest information, see the most recent version of this document.
You can use the PPU PIP service in two ways. Choose the method that meets your requirements. For more information, see Use the PPU PIP service on ACS and Use the PPU PIP source in PAI.
PPU PIP service provided by PTG: This service is used over the public network and requires explicit authentication.
PPU PIP service provided by Alibaba Cloud: This service is used over a VPC and does not require authentication. (Recommended)
The
pip installcommand's-i <IndexURL>option is optional. For more information, see the documentation for the cloud product that you use.The
<IndexURL>varies depending on the PPU PIP service that you use. The following are example<IndexURL>values:
# 1.1 Index URL format for the PPU PIP service provided by PTG (<=v1.5.3):
https://art-pub.eng.t-head.cn/artifactory/api/pypi/ptgai-pypi_ppu_ubuntu_<cuda-version>_index/simple/
## Examples of the Index URL for the PPU PIP service provided by PTG (partial list):
https://art-pub.eng.t-head.cn/artifactory/api/pypi/ptgai-pypi_ppu_ubuntu_cu128_index/simple/
https://art-pub.eng.t-head.cn/artifactory/api/pypi/ptgai-pypi_ppu_ubuntu_cu129_index/simple/
# 1.2 Index URL format for the PPU PIP service provided by PTG:
## 1.2.1 Index URL format for the PPU PIP service provided by PTG (OS-free mode, introduced in v1.6.x):
https://art-pub.eng.t-head.cn/artifactory/api/pypi/<cuda-version>_index/simple/
### Examples of the Index URL for the PPU PIP service provided by PTG (OS-free mode, partial list):
https://art-pub.eng.t-head.cn/artifactory/api/pypi/cu128_index/simple/
https://art-pub.eng.t-head.cn/artifactory/api/pypi/cu129_index/simple/
## 1.2.2 Index URL format for the PPU PIP service provided by PTG (OS/CUDA-free mode, introduced in v1.7.x):
### Unlike v1.6.x, v1.7.x does not require a CUDA version and uses a single Index URL (this is the only one):
https://art-pub.eng.t-head.cn/artifactory/api/pypi/pypi_index/simple/
# Correspondingly, sections 1.1, 1.2.1, and 1.2.2 have matching Index URL formats for the "PPU PIP service provided by Alibaba Cloud". #
# 2.1 Index URL format for the PPU PIP service provided by Alibaba Cloud (<=v1.5.3):
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/ubuntu_<cuda-version>/simple/
## Examples of the Index URL for the PPU PIP service provided by Alibaba Cloud (partial list):
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/ubuntu_cu128/simple/
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/ubuntu_cu129/simple/
# 2.2 Index URL format for the PPU PIP service provided by Alibaba Cloud:
## 2.2.1 Index URL format for the PPU PIP service provided by Alibaba Cloud (OS-free mode, introduced in v1.6.x):
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/<cuda-version>/simple/
### Examples of the Index URL for the PPU PIP service provided by Alibaba Cloud (OS-free mode, partial list):
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/cu128/simple/
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/cu129/simple/
## 2.2.2 Index URL format for the PPU PIP service provided by Alibaba Cloud (OS/CUDA-free mode, introduced in v1.7.x):
### Unlike v1.6.x, v1.7.x does not require a CUDA version and uses a single Index URL (this is the only one):
https://aiext-pypi.mirrors.aliyuncs.com/pg1-pip/pypi_index/simple/The v2.0.x PIP packages are released incrementally. For any missing packages, you can use the packages listed in the PPU-V1.7.0 PIP package manifest.
item | version | os | cuda | framework | python | type | cmd line (OS-free) |
acext | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
acext | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
acext | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
acext | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.12 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
acext | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.8.0 | 3.12 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
acext | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install acext==1.0.0 (-i <IndexURL>) |
apex | 25.9 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install apex==25.9 (-i <IndexURL>) |
bitsandbytes | 0.49.1 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install bitsandbytes==0.49.1 (-i <IndexURL>) |
deep_ep | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install deep_ep==1.0.0 (-i <IndexURL>) |
deep_ep | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install deep_ep==1.0.0 (-i <IndexURL>) |
deep_ep | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install deep_ep==1.0.0 (-i <IndexURL>) |
deep_gemm | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install deep_gemm==1.0.0 (-i <IndexURL>) |
deep_gemm | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install deep_gemm==1.0.0 (-i <IndexURL>) |
fairscale | 0.4.13 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | ce | pip install fairscale==0.4.13 (-i <IndexURL>) |
fairscale | 0.4.13 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | ce | pip install fairscale==0.4.13 (-i <IndexURL>) |
fairscale | 0.4.13 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | ce | pip install fairscale==0.4.13 (-i <IndexURL>) |
fbgemm_gpu | 1.4.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install fbgemm_gpu==1.4.0 (-i <IndexURL>) |
flash_attn | 2.7.4.post1 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flash_attn==2.7.4.post1 (-i <IndexURL>) |
flash_attn | 2.7.4.post1 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install flash_attn==2.7.4.post1 (-i <IndexURL>) |
flash_attn | 2.7.4.post1 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install flash_attn==2.7.4.post1 (-i <IndexURL>) |
flash_attn | 2.7.4.post1 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flash_attn==2.7.4.post1 (-i <IndexURL>) |
flash_attn | 2.8.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flash_attn==2.8.2 (-i <IndexURL>) |
flash_attn | 2.8.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install flash_attn==2.8.2 (-i <IndexURL>) |
flash_attn | 2.8.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install flash_attn==2.8.2 (-i <IndexURL>) |
flash_attn | 2.8.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flash_attn==2.8.2 (-i <IndexURL>) |
flash_attn_3 | 2.8.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flash_attn_3==2.8.2 (-i <IndexURL>) |
flash_attn_3 | 2.8.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install flash_attn_3==2.8.2 (-i <IndexURL>) |
flash_attn_3 | 2.8.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install flash_attn_3==2.8.2 (-i <IndexURL>) |
flash_attn_3 | 2.8.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flash_attn_3==2.8.2 (-i <IndexURL>) |
flash_mla | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flash_mla==1.0.0 (-i <IndexURL>) |
flash_mla | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flash_mla==1.0.0 (-i <IndexURL>) |
flash_mla | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install flash_mla==1.0.0 (-i <IndexURL>) |
flash_mla | 1.0.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install flash_mla==1.0.0 (-i <IndexURL>) |
flashinfer_python | 0.4.0rc3 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flashinfer_python==0.4.0rc3 (-i <IndexURL>) |
flashinfer_python | 0.4.0rc3 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install flashinfer_python==0.4.0rc3 (-i <IndexURL>) |
flashinfer_python | 0.4.0rc3 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install flashinfer_python==0.4.0rc3 (-i <IndexURL>) |
flashinfer_python | 0.5.3 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install flashinfer_python==0.5.3 (-i <IndexURL>) |
flashinfer_python | 0.5.3 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flashinfer_python==0.5.3 (-i <IndexURL>) |
flashinfer_python | 0.6.1 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flashinfer_python==0.6.1 (-i <IndexURL>) |
flashinfer_python | 0.6.3 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flashinfer_python==0.6.3 (-i <IndexURL>) |
grouped_gemm | 0.1.6 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install grouped_gemm==0.1.6 (-i <IndexURL>) |
grouped_gemm | 0.1.6 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install grouped_gemm==0.1.6 (-i <IndexURL>) |
grouped_gemm | 0.1.6 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install grouped_gemm==0.1.6 (-i <IndexURL>) |
grouped_gemm | 1.1.4 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install grouped_gemm==1.1.4 (-i <IndexURL>) |
grouped_gemm | 1.1.4 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install grouped_gemm==1.1.4 (-i <IndexURL>) |
grouped_gemm | 1.1.4 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install grouped_gemm==1.1.4 (-i <IndexURL>) |
grouped_gemm | 1.1.4 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install grouped_gemm==1.1.4 (-i <IndexURL>) |
holmes_compiler | 0.7.0 | Ubuntu 22.04 | cuda 11.8 | 3.10 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_compiler | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_compiler | 0.7.0 | Ubuntu 20.04 | cuda 11.4 | 3.8 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_compiler | 0.7.0 | Ubuntu 20.04 | cuda 11.6 | 3.8 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_compiler | 0.7.0 | Ubuntu 22.04 | cuda 12.2 | 3.10 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_compiler | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install holmes_compiler==0.7.0 (-i <IndexURL>) | |
holmes_frontend | 0.7.0 | Ubuntu 22.04 | cuda 11.8 | torch 2.1.0 | 3.10 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.2.0 | 3.10 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.4.0 | 3.10 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 22.04 | cuda 12.8 | torch 2.8.0 | 3.10 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_frontend | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install holmes_frontend==0.7.0 (-i <IndexURL>) |
holmes_runtime | 0.7.0 | Ubuntu 22.04 | cuda 11.8 | 3.10 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime | 0.7.0 | Ubuntu 20.04 | cuda 11.4 | 3.8 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime | 0.7.0 | Ubuntu 20.04 | cuda 11.6 | 3.8 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime | 0.7.0 | Ubuntu 22.04 | cuda 12.2 | 3.10 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install holmes_runtime==0.7.0 (-i <IndexURL>) | |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 11.8 | torch 2.1.0 | 3.10 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.2.0 | 3.10 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.4.0 | 3.10 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 12.8 | torch 2.8.0 | 3.10 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 22.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_runtime_fa | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install holmes_runtime_fa==0.7.0 (-i <IndexURL>) |
holmes_tools_tf | 0.7.0 | Ubuntu 20.04 | cuda 11.8 | 3.8 | oe | pip install holmes_tools_tf==0.7.0 (-i <IndexURL>) | |
holmes_tools_tf | 0.7.0 | Ubuntu 20.04 | cuda 11.6 | 3.8 | oe | pip install holmes_tools_tf==0.7.0 (-i <IndexURL>) | |
holmes_tools_tf | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install holmes_tools_tf==0.7.0 (-i <IndexURL>) | |
holmes_tools_tf | 0.7.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install holmes_tools_tf==0.7.0 (-i <IndexURL>) | |
holmes_tools_torch | 0.7.0 | Ubuntu 20.04 | cuda 11.6 | 3.8 | oe | pip install holmes_tools_torch==0.7.0 (-i <IndexURL>) | |
holmes_tools_torch | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install holmes_tools_torch==0.7.0 (-i <IndexURL>) | |
jax | 0.4.34 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install jax==0.4.34 (-i <IndexURL>) | |
jax | 0.4.34 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install jax==0.4.34 (-i <IndexURL>) | |
jax | 0.4.34 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax==0.4.34 (-i <IndexURL>) | |
jax | 0.4.34 | Ubuntu 22.04 | cuda 12.8 | 3.10 | oe | pip install jax==0.4.34 (-i <IndexURL>) | |
jax | 0.7.2 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax==0.7.2 (-i <IndexURL>) | |
jax | 0.7.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install jax==0.7.2 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.4.34 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install jax_cuda12_pjrt==0.4.34 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.4.34 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install jax_cuda12_pjrt==0.4.34 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.4.34 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax_cuda12_pjrt==0.4.34 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.4.34 | Ubuntu 22.04 | cuda 12.8 | 3.10 | oe | pip install jax_cuda12_pjrt==0.4.34 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.7.2 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax_cuda12_pjrt==0.7.2 (-i <IndexURL>) | |
jax_cuda12_pjrt | 0.7.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install jax_cuda12_pjrt==0.7.2 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.4.34 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install jax_cuda12_plugin==0.4.34 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.4.34 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install jax_cuda12_plugin==0.4.34 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.4.34 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax_cuda12_plugin==0.4.34 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.4.34 | Ubuntu 22.04 | cuda 12.8 | 3.10 | oe | pip install jax_cuda12_plugin==0.4.34 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.7.2 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jax_cuda12_plugin==0.7.2 (-i <IndexURL>) | |
jax_cuda12_plugin | 0.7.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install jax_cuda12_plugin==0.7.2 (-i <IndexURL>) | |
jaxlib | 0.4.34 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install jaxlib==0.4.34 (-i <IndexURL>) | |
jaxlib | 0.4.34 | Ubuntu 22.04 | cuda 12.3 | 3.10 | oe | pip install jaxlib==0.4.34 (-i <IndexURL>) | |
jaxlib | 0.4.34 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jaxlib==0.4.34 (-i <IndexURL>) | |
jaxlib | 0.4.34 | Ubuntu 22.04 | cuda 12.8 | 3.10 | oe | pip install jaxlib==0.4.34 (-i <IndexURL>) | |
jaxlib | 0.7.2 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install jaxlib==0.7.2 (-i <IndexURL>) | |
jaxlib | 0.7.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install jaxlib==0.7.2 (-i <IndexURL>) | |
mmcv | 2.1.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install mmcv==2.1.0 (-i <IndexURL>) |
mmcv | 2.1.0 | Ubuntu 24.04 | cuda 12.6 | torch 2.9.0 | 3.12 | ce | pip install mmcv==2.1.0 (-i <IndexURL>) |
mmcv | 2.2.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install mmcv==2.2.0 (-i <IndexURL>) |
mmcv | 2.2.0 | Ubuntu 24.04 | cuda 12.6 | torch 2.9.0 | 3.12 | ce | pip install mmcv==2.2.0 (-i <IndexURL>) |
mmdet3d | 1.4.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install mmdet3d==1.4.0 (-i <IndexURL>) |
mmdet3d | 1.4.0 | Ubuntu 24.04 | cuda 12.6 | torch 2.9.0 | 3.12 | ce | pip install mmdet3d==1.4.0 (-i <IndexURL>) |
mmsegmentation | 1.2.2 | Ubuntu 24.04 | cuda 12.6 | 3.12 | ce | pip install mmsegmentation==1.2.2 (-i <IndexURL>) | |
numba | 0.59.0 | Ubuntu 24.04 | cuda 12.6 | 3.12 | ce | pip install numba==0.59.0 (-i <IndexURL>) | |
numba | 0.63.1 | Ubuntu 24.04 | cuda 12.9 | 3.12 | ce | pip install numba==0.63.1 (-i <IndexURL>) | |
nvshmem4py_cu12 | 0.1.2 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install nvshmem4py_cu12==0.1.2 (-i <IndexURL>) | |
nvshmem4py_cu12 | 0.1.2 | Ubuntu 24.04 | cuda 12.6 | 3.12 | oe | pip install nvshmem4py_cu12==0.1.2 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install onnxruntime_gpu==1.23.0 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.0 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install onnxruntime_gpu==1.23.0 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.0 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install onnxruntime_gpu==1.23.0 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install onnxruntime_gpu==1.23.2 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.2 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install onnxruntime_gpu==1.23.2 (-i <IndexURL>) | |
onnxruntime_gpu | 1.23.2 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install onnxruntime_gpu==1.23.2 (-i <IndexURL>) | |
open3d | 0.19.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install open3d==0.19.0 (-i <IndexURL>) |
open3d | 0.19.0 | Ubuntu 24.04 | cuda 12.6 | torch 2.9.0 | 3.12 | ce | pip install open3d==0.19.0 (-i <IndexURL>) |
PyNvVideoCodec | 2.0.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install PyNvVideoCodec==2.0.2 (-i <IndexURL>) | |
PyNvVideoCodec | 2.0.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install PyNvVideoCodec==2.0.2 (-i <IndexURL>) | |
PyNvVideoCodec | 2.0.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | 3.10 | oe | pip install PyNvVideoCodec==2.0.2 (-i <IndexURL>) | |
qlean | 0.1.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install qlean==0.1.0 (-i <IndexURL>) | |
sailshmem | 2.0.0 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install sailshmem==2.0.0 (-i <IndexURL>) | |
sailshmem | 2.0.0 | Ubuntu 24.04 | cuda 12.6 | 3.12 | oe | pip install sailshmem==2.0.0 (-i <IndexURL>) | |
sgl_kernel | 0.1.7 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sgl_kernel==0.1.7 (-i <IndexURL>) |
sgl_kernel | 0.1.7 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sgl_kernel==0.1.7 (-i <IndexURL>) |
sgl_kernel | 0.3.14.post1 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sgl_kernel==0.3.14.post1 (-i <IndexURL>) |
sgl_kernel | 0.3.16.post5 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sgl_kernel==0.3.16.post5 (-i <IndexURL>) |
sgl_kernel | 0.3.18.post2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sgl_kernel==0.3.18.post2 (-i <IndexURL>) |
sgl_kernel | 0.3.20 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sgl_kernel==0.3.20 (-i <IndexURL>) |
sgl_kernel | 0.3.21 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sgl_kernel==0.3.21 (-i <IndexURL>) |
sgl_kernel | 0.3.9.post2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sgl_kernel==0.3.9.post2 (-i <IndexURL>) |
sgl_kernel | 0.3.9.post2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sgl_kernel==0.3.9.post2 (-i <IndexURL>) |
sgl_kernel | 0.3.9.post2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sgl_kernel==0.3.9.post2 (-i <IndexURL>) |
sglang | 0.4.7 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sglang==0.4.7 (-i <IndexURL>) |
sglang | 0.4.7 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sglang==0.4.7 (-i <IndexURL>) |
sglang | 0.5.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang==0.5.2 (-i <IndexURL>) |
sglang | 0.5.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sglang==0.5.2 (-i <IndexURL>) |
sglang | 0.5.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sglang==0.5.2 (-i <IndexURL>) |
sglang | 0.5.3 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang==0.5.3 (-i <IndexURL>) |
sglang | 0.5.5 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang==0.5.5 (-i <IndexURL>) |
sglang | 0.5.6 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang==0.5.6 (-i <IndexURL>) |
sglang | 0.5.7 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sglang==0.5.7 (-i <IndexURL>) |
sglang | 0.5.8 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sglang==0.5.8 (-i <IndexURL>) |
sglang | 0.5.9 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sglang==0.5.9 (-i <IndexURL>) |
sglang_router | 0.1.4 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sglang_router==0.1.4 (-i <IndexURL>) |
sglang_router | 0.1.4 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sglang_router==0.1.4 (-i <IndexURL>) |
sglang_router | 0.1.9 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang_router==0.1.9 (-i <IndexURL>) |
sglang_router | 0.1.9 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install sglang_router==0.1.9 (-i <IndexURL>) |
sglang_router | 0.1.9 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install sglang_router==0.1.9 (-i <IndexURL>) |
sglang_router | 0.2.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang_router==0.2.2 (-i <IndexURL>) |
sglang_router | 0.2.3 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install sglang_router==0.2.3 (-i <IndexURL>) |
sglang_router | 0.3.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sglang_router==0.3.0 (-i <IndexURL>) |
sglang_router | 0.3.2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install sglang_router==0.3.2 (-i <IndexURL>) |
tensorflow_gpu | 0.7.0 | Ubuntu 20.04 | cuda 11.6 | 3.8 | oe | pip install tensorflow_gpu==0.7.0 (-i <IndexURL>) | |
tensorrt | 0.8.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install tensorrt==0.8.0 (-i <IndexURL>) |
tensorrt | 10.13.2 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install tensorrt==10.13.2 (-i <IndexURL>) | |
tensorrt | 10.13.2 | Ubuntu 22.04 | cuda 11.8 | 3.10 | oe | pip install tensorrt==10.13.2 (-i <IndexURL>) | |
tensorrt_llm | 0.7.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install tensorrt_llm==0.7.0 (-i <IndexURL>) |
tensorrt_llm | 0.8.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install tensorrt_llm==0.8.0 (-i <IndexURL>) |
torch | 2.6.0 | Ubuntu 22.04 | cuda 12.6 | 3.10 | oe | pip install torch==2.6.0 (-i <IndexURL>) | |
torch | 2.7.0 | Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install torch==2.7.0 (-i <IndexURL>) | |
torch | 2.8.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install torch==2.8.0 (-i <IndexURL>) | |
torch | 2.9.0 | Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install torch==2.9.0 (-i <IndexURL>) | |
torch | 2.9.0 | Ubuntu 24.04 | cuda 12.6 | 3.12 | oe | pip install torch==2.9.0 (-i <IndexURL>) | |
torch_memory_saver | 0.0.8 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install torch_memory_saver==0.0.8 (-i <IndexURL>) |
torch_memory_saver | 0.0.8 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install torch_memory_saver==0.0.8 (-i <IndexURL>) |
torch_memory_saver | 0.0.8 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install torch_memory_saver==0.0.8 (-i <IndexURL>) |
torch_memory_saver | 0.0.9 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install torch_memory_saver==0.0.9 (-i <IndexURL>) |
torch_memory_saver | 0.0.9 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install torch_memory_saver==0.0.9 (-i <IndexURL>) |
torch_memory_saver | 0.0.9rc2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install torch_memory_saver==0.0.9rc2 (-i <IndexURL>) |
torch_memory_saver | 0.0.9rc2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install torch_memory_saver==0.0.9rc2 (-i <IndexURL>) |
torch_memory_saver | 0.0.9rc2 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install torch_memory_saver==0.0.9rc2 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.2.0 | 3.10 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.4.0 | 3.10 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 22.04 | cuda 12.3 | torch 2.6.0 | 3.10 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 22.04 | cuda 12.8 | torch 2.8.0 | 3.10 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torch_tensorrt | 2.10.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install torch_tensorrt==2.10.0 (-i <IndexURL>) |
torchaudio | 2.9.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install torchaudio==2.9.0 (-i <IndexURL>) |
torchcodec | 0.9.1 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install torchcodec==0.9.1 (-i <IndexURL>) |
torchrec | 1.4.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install torchrec==1.4.0 (-i <IndexURL>) |
torchvision | 0.24.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install torchvision==0.24.0 (-i <IndexURL>) |
transformer_engine | 2.10 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install transformer_engine==2.10 (-i <IndexURL>) |
transformer_engine | 2.8 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install transformer_engine==2.8 (-i <IndexURL>) |
transformer_engine | 2.8 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install transformer_engine==2.8 (-i <IndexURL>) |
transformer_engine | 2.8 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install transformer_engine==2.8 (-i <IndexURL>) |
triton | 3.3.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install triton==3.3.0 (-i <IndexURL>) | |
triton | 3.3.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install triton==3.3.0 (-i <IndexURL>) | |
triton | 3.3.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | 3.10 | oe | pip install triton==3.3.0 (-i <IndexURL>) | |
triton | 3.4.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install triton==3.4.0 (-i <IndexURL>) | |
triton | 3.4.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install triton==3.4.0 (-i <IndexURL>) | |
triton | 3.4.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | 3.10 | oe | pip install triton==3.4.0 (-i <IndexURL>) | |
triton | 3.4.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda12.4 | torch 2.8.0 | 3.10 | oe | pip install triton==3.4.0 (-i <IndexURL>) |
triton | 3.5.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install triton==3.5.0 (-i <IndexURL>) | |
vllm | 0.11.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install vllm==0.11.0 (-i <IndexURL>) |
vllm | 0.11.1 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install vllm==0.11.1 (-i <IndexURL>) |
vllm | 0.12.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install vllm==0.12.0 (-i <IndexURL>) |
vllm | 0.13.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.13.0 (-i <IndexURL>) |
vllm | 0.14.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.14.0 (-i <IndexURL>) |
vllm | 0.15.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.15.0 (-i <IndexURL>) |
vllm | 0.16.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.16.0 (-i <IndexURL>) |
warp_lang | 1.10.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | 3.12 | oe | pip install warp_lang==1.10.0 (-i <IndexURL>) | |
warp_lang | 1.10.0 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | 3.12 | oe | pip install warp_lang==1.10.0 (-i <IndexURL>) | |
xformers | 0.0.30 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.8.0 | 3.12 | oe | pip install xformers==0.0.30 (-i <IndexURL>) |
xformers | 0.0.30 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.8 | torch 2.7.0 | 3.12 | oe | pip install xformers==0.0.30 (-i <IndexURL>) |
xformers | 0.0.30 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.6 | torch 2.6.0 | 3.10 | oe | pip install xformers==0.0.30 (-i <IndexURL>) |
xformers | 0.0.30 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install xformers==0.0.30 (-i <IndexURL>) |
torch | 2.1.2 | Ubuntu 20.04 | cuda12.1 | 3.8 | oe | pip install torch==2.1.2 (-i <IndexURL>) | |
torchvision | 0.16.2 | Ubuntu 20.04 | cuda12.1 | torch2.1.2 | 3.8 | ce | pip install torchvision==0.16.2 (-i <IndexURL>) |
torchaudio | 2.1.2 | Ubuntu 20.04 | cuda12.1 | torch2.1.2 | 3.8 | ce | pip install torchaudio==2.1.2 (-i <IndexURL>) |
flash_attn | 2.5.7 | Ubuntu 22.04 | cuda 11.8 | torch 2.1.0 | 3.10 | oe | pip install flash_attn==2.5.7 (-i <IndexURL>) |
vllm | 0.17.1 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.17.1 (-i <IndexURL>) |
flashinfer_python | 0.6.4 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install flashinfer_python==0.6.4 (-i <IndexURL>) |
vllm | 0.18.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install vllm==0.18.0 (-i <IndexURL>) |
torchao | 0.9.0 | Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | ce | pip install torchao==0.9.0 (-i <IndexURL>) |
torch_memory_saver | 0.0.9 | Ubuntu 22.04, Ubuntu 24.04 | cuda 12.9 | torch 2.9.0 | 3.12 | oe | pip install torch_memory_saver==0.0.9 (-i <IndexURL>) |