Naina Singh
Naina Singh leads AI Inference Product Strategy at Red Hat, where she works with enterprises running LLM inference in production. She focuses on the operational and economic decisions that determine whether inference runs profitably at scale. She holds two patents and an MBA from UNC Kenan-Flagler.
Naina Singh's contributions
Article
Benchmarking tiered KV cache offloading on H100 GPUs in OpenShift AI 3.5
Ramesh Doddaiah
+6
Optimize long-context AI inference with Red Hat AI 3.5 KV cache offloading, which boosts throughput by 5.8x and cuts TTFT from 60s to 10s on NVIDIA H100 GPUs.
Article
Create your first serverless function with Red Hat OpenShift Serverless Functions
Naina Singh
Get started with using Red Hat OpenShift Serverless Functions to create serverless functions that respond to HTTP and CloudEvents requests.
Article
Benchmarking tiered KV cache offloading on H100 GPUs in OpenShift AI 3.5
Ramesh Doddaiah
+6
Optimize long-context AI inference with Red Hat AI 3.5 KV cache offloading, which boosts throughput by 5.8x and cuts TTFT from 60s to 10s on NVIDIA H100 GPUs.
Article
Create your first serverless function with Red Hat OpenShift Serverless Functions
Naina Singh
Get started with using Red Hat OpenShift Serverless Functions to create serverless functions that respond to HTTP and CloudEvents requests.