[Component upgrade] shared GPU scheduling component upgrade notice

Updated at:

If the cGPU isolation module version is less than 1.5.13, residual processes may cause rare kernel crashes.

Impact scope

Your cluster is affected if it meets either of the following conditions:

Affected shared GPU scheduling component versions

Cluster type

Component name

Affected component versions

  • ACK managed cluster Pro edition

  • ACK Edge cluster Pro edition

ack-ai-installer

≤ 1.10.1

ACK dedicated cluster

ack-cgpu

≤ 1.6.0

Affected existing GPU nodes

Existing GPU nodes are affected if their cGPU version is less than 1.5.13. To check a node’s cGPU version, perform the following steps:

  1. Log on to the node.

    1. Log on to the ACK console. In the left navigation pane, click Clusters.

    2. On the Clusters page, click the name of your cluster. In the left navigation pane, click Nodes > Node Pools.

    3. On the Node Pools page, click the node pool name. Then, access node management and log on to the target GPU node.

      ContainerOS does not support direct user logon by default. This prevents untraceable operations and eliminates SSH access to reduce security risks. If you must log on to a ContainerOS instance for O&M tasks, see O&M ContainerOS nodes.
  2. Run the following command to obtain the cGPU version:

    cat /proc/cgpu_km/version

    Example output:

    1.5.12

Solutions

Upgrade the shared GPU scheduling component

Cluster type

Component name

Upgrade method

  • ACK managed cluster Pro edition

  • ACK Edge cluster Pro edition

ack-ai-installer

Upgrade the shared GPU scheduling component

ACK dedicated cluster

ack-cgpu

Upgrade the node cGPU version