Artificial intelligence

Red Hat Enterprise Linux AI
Product Sub Page

Download Red Hat Enterprise Linux AI

Develop, deploy, and run large language models (LLMs) in individual server environments. The solution includes Red Hat AI Inference Server, delivering fast, cost-effective hybrid cloud inference by maximizing throughput, minimizing latency, and reducing compute costs.

Featured image for Red Hat OpenShift AI.
Article

Protecting your models made easy with Authorino

JooHo Lee

This article demonstrates how to register the SKlearn runtime as a Custom ServingRuntime, deploy the iris model on KServe with OpenDataHub, and apply authentication using Authorino to protect the model endpoints.

Featured image for AI/ML
Article

How to install KServe using Open Data Hub

JooHo Lee

Learn a simplified method for installing KServe, a highly scalable and standards-based model inference platform on Kubernetes for scalable AI. 

Featured image for Deploy Llama 3 8B with vLLM blog.
Article

Deploy Llama 3 8B with vLLM

Mark Kurtz

Llama 3's advancements, particularly at 8 billion parameters, make AI more accessible and efficient.