Boaz Ben Shabat's contributions
Article
How I massively improved my AI inference performance without buying new hardware
Optimize LLM inference performance with a 71% latency reduction on NVIDIA H200 GPUs. Learn how to cut TTFT from 995ms to 287ms with smarter request routing.
Learning path
RoCE multi-node AI training on Red Hat OpenShift
Learn how to run distributed AI training on Red Hat OpenShift using RoCE with
Article
How I massively improved my AI inference performance without buying new hardware
Optimize LLM inference performance with a 71% latency reduction on NVIDIA H200 GPUs. Learn how to cut TTFT from 995ms to 287ms with smarter request routing.
Learning path
RoCE multi-node AI training on Red Hat OpenShift
Learn how to run distributed AI training on Red Hat OpenShift using RoCE with
