Skip to main content

AMD GPU Support

CloudRift supports AMD Instinct GPUs (MI300X/MI350X) for both Docker containers and virtual machines.

Docker Containers

AMD GPUs are automatically detected via PCI scanning on nodes. The ROCm runtime is integrated for Docker container workloads, allowing containers to access AMD GPU resources without additional configuration.

For datacenter setup details, see the Docker setup guide.

Virtual Machines

AMD SR-IOV (GIM) GPU passthrough enables multi-GPU virtual function (VF) assignment, allowing AMD Instinct GPUs to be shared across multiple VMs.

For datacenter setup details, see the VM setup guide.

ROCm VM Images

Pre-built ROCm VM images are available with the following configuration:

  • OS: Ubuntu Noble
  • ROCm version: 7.2
  • Kernel: HWE kernel

These images are automatically distributed to nodes with AMD GPUs during image synchronization.