Red Hat Enterprise Linux AI

Seamlessly develop, deploy, and run open source Granite generative AI models to power your enterprise applications.

Introducing an accessible open source AI platform

RHEL AI simplifies deployment across hybrid infrastructure environments by integrating enterprise-ready versions of InstructLab and Granite language models, along with a bootable image of Red Hat Enterprise Linux. This forms a foundation model platform for bringing open source-licensed gen AI models into the enterprise, lowering costs and removing barriers to testing and experimentation. The platform supports tools like vLLM, DeepSpeed, and PyTorch, and leverages containerization with Podman, RHEL Image mode, and scalable deployments using Kubernetes and OpenShift. 

Users can join a growing community of AI contributors through InstructLab, enhancing large language models with additional skills and data cost-effectively.

Red Hat Enterprise Linux

What’s included in RHEL AI

Open source Granite language and code models

Fully supported and indemnified by Red Hat for enterprise use.

Learn More  

A supported, life-cycled distribution of InstructLab

A scalable, cost-effective solution for enhancing LLM capabilities and making knowledge and skills contributions accessible.

Learn More  


Cloud-native scalability

Red Hat Enterprise Linux image mode lets you manage your AI platform as a container image, streamlining your approach to scaling.

Optimized bootable model runtime instances

Granite models and InstructLab tooling packages as bootable RHEL images via RHEL image mode, including Pytorch and required runtime libraries and hardware accelerators for NVIDIA, Intel, and AMD.

Red Hat Enterprise Linux AI allows portability across hybrid cloud environments and provides an onramp to AI at scale with Red Hat OpenShift AI, and to additional capabilities with IBM

Explore related resources

Red Hat OpenShift Data Science

Red Hat OpenShift AI

A cloud service that gives data scientists and developers a powerful AI/ML...

Red Hat Enterprise Linux icon

Image mode for Red Hat Enterprise Linux

Red Hat Enterprise Linux (RHEL) image mode offers a deployment method. It...

Red Hat Enterprise Linux

Red Hat Enterprise Linux

A stable, proven foundation that’s versatile enough for rolling out new...

Featured image for InstructLab.
May 07, 2024

InstructLab: Advancing generative AI through open source

Alina Ryan

Introducing InstructLab, an open source project for enhancing large language...