Trevor Royer

Learn how to optimize self-hosted LLM cost per token. Cut GPU spending and maximize real-world throughput with autoscaling, right-sizing, and vLLM tuning.

Confidently deploy LLMs with Red Hat support: Learn how to determine if your model is supported by Red Hat's vLLM community.

Optimize vLLM performance with practical tuning tips. Learn how to use GuideLLM for benchmarking, adjust GPU ratios, and maximize KV cache to improve throughput.

Implement cost-effective LLM serving on OpenShift AI with this step-by-step guide to configuring KServe's Serverless mode for vLLM autoscaling.

Learning the naming conventions of large language models (LLMs) helps users select the right model for their needs.

Learn how to build a ModelCar container image and deploy it with OpenShift AI.

This article discusses how to validate GitOps manifests to improve the reliability and confidence of changes before merging.

Learn about deploying Helm charts with three popular patterns for Argo CD on Red Hat OpenShift. Plus, discover the advantages and disadvantages of each pattern.