[AI Network Architecture] In an AI cluster using NVIDIA GPUs, which configuration parameter in the NicClusterPolicy custom resource is crucial for…

The RDMA Shared Device Plugin is a critical component managed by the NVIDIA Network Operator through the NicClusterPolicy custom resource. Its function is to discover and expose RDMA-capable network devices on cluster nodes to the Kubernetes scheduler. This allows containerized applications, such as distributed AI training workloads, to request and gain access to these high-speed networking resources. By enabling this plugin, pods can leverage GPUDirect RDMA, facilitating direct, low-latency, high-bandwidth data transfers between GPUs across different nodes, which is essential for scaling AI model training efficiently.

B. Secondary Network: A secondary network provides a separate network interface for data-intensive traffic, but it does not, by itself, enable the underlying RDMA protocol required for high-speed communication.

C. OFED Driver: The OFED driver is a foundational software stack installed on the host to enable RDMA functionality on the hardware, but the device plugin is the specific mechanism that makes this functionality accessible to pods.

D. NV IPAM: NV IPAM is an IP Address Management CNI plugin. It is responsible for allocating IP addresses to pods, a function unrelated to enabling the RDMA data path for GPU communication.

---

1. NVIDIA Network Operator Documentation, "RDMA and GPUDirect": This official documentation explicitly states, "To enable RDMA for pods, Network Operator deploys a shared device plugin for RDMA." It further shows a NicClusterPolicy manifest where spec.rdma.sharedDevicePlugin is set to true to deploy the plugin. This directly links the plugin to enabling RDMA for workloads.

Source: NVIDIA Cloud Native Technologies Documentation. Section: Network Operator -> Feature Deep Dive -> RDMA and GPUDirect.

2. NVIDIA Network Operator Documentation, "NIC Cluster Policy CRD": The Custom Resource Definition for NicClusterPolicy details the available configuration parameters. The rdma.sharedDevicePlugin field is defined as the controller for deploying the RDMA shared device plugin daemonset, confirming its role as a direct configuration parameter for this purpose.

Source: NVIDIA Cloud Native Technologies Documentation. Section: Network Operator -> CRD Reference -> NicClusterPolicy.

3. Kubernetes Official Documentation, "Device Plugins": This document explains the device plugin framework in Kubernetes, which is the underlying technology used by the RDMA Shared Device Plugin. It clarifies that device plugins are necessary for pods to access specialized hardware resources like high-performance network interfaces, which are not managed by the built-in Kubernetes resource types.

Source: Kubernetes Documentation. Section: Concepts -> Extend Kubernetes -> Device Plugins.