Red Hat Enterprise Linux AI

Develop, deploy, and run large language models (LLMs) in individual server environments. The solution includes Red Hat AI Inference Server, delivering fast, cost-effective hybrid cloud inference by maximizing throughput, minimizing latency, and reducing compute costs.

Download RHEL AI

RHEL AI 3d cube

Getting Started with RHEL AI

Discover how RHEL AI can help fine-tune large language models (LLMs), enabling the creation of custom models that incorporate new knowledge and skills from foundational models.

Building your RHEL AI environment

Creating accounts, initializing RHEL AI, downloading models, add serving/chat customizations.

Installing RHEL AI

Instructions for installing RHEL AI on machines with the bootable container image.

Creating Skills and Knowledge YAML files

Guidelines on creating skills and knowledge YAML files.

CLI Reference

RHEL AI command line interface(CLI) reference.

Generating a custom LLM using RHEL AI

Using SDG, training, and evaluation to create a custom LLM.

Learning Exercises

Learning Path

RHELAI featured image

RHEL AI: Try LLMs the easy way

Learn how Red Hat Enterprise Linux AI provides a security-focused, low-cost...

Learning Path

RHEL AI Image

Download, serve and interact with LLMs on RHEL AI

In this course, you’ll explore how to configure your RHEL AI machine,...

Report a website issue

Your name

Your e-mail address

Subject

Message

Type of request/issue

Problem Page URL

Country/Territory

Red Hat Account Number