William Zhao

Principal Software Engineer

William Zhao

William Zhao joined Red Hat in 2021. William Zhao is a Principal Software Engineer working on enabling Data Processing Units (DPUs) and SmartNICs within the Red Hat ecosystem including OpenShift. He is currently an individual contributor in the Network Hardware Enablement (NHE) team.

William Zhao's contributions

Red Hat OpenShift feature image
Article

How DRA can improve the performance of distributed LLM inference workloads with RDMA and SR-IOV

David Whyte-Gray +3

This article explains how dynamic resource allocation (DRA) improves the performance of distributed LLM inference workloads by aligning GPU and network interface topologies. Traditional Kubernetes device plugins often assign GPUs and SR-IOV virtual functions (VFs) that are not on the same PCIe root, causing suboptimal RDMA bandwidth and increased latency for disaggregated architectures like llm-d.