Podman AI Lab

Build, manage, and deploy containers and Kubernetes locally with desktop applications for Mac, Windows, and Linux.

Podman Desktop

Run Large Language Models locally and build AI applications with Podman AI Lab

The Podman AI Lab is a Red Hat extension that simplifies getting started and developing with AI in a local environment. It provides key open-source technologies for starting to build on AI.

A curated catalog of recipes help you navigate the jungle of AI use cases and AI models. You can also import your models to run them locally.

Playground environments allow users to experiment easily with the models, configuring their settings and system prompts to validate the use case and interactions.

Podman AI Lab is the easiest way to work with LLMs ( Large Language Models ) on your local developer workstation.

Podman AI Lab

Key features of Podman AI Lab

Recipes catalog

Get inspired by use cases and learn how to integrate AI in an optimal way. All recipes are Kubernetes ready.

Models catalog

Leverage a curated list of open-source large language models that are available out of the box, or import your own models.

Run Models Locally

Run models locally with an inference server. Get OpenAI-compatible endpoints, use code snippets and start infusing AI in your application.

Playground Environments

Evaluate and select the best large language model for their specific use case by experimenting with different models, configuring their settings and system prompts, testing and validating their prompt workflows, and comparing their behaviour using the dedicated UI in Podman AI Lab.

Install Podman AI Lab extension

Add an AI Lab extension to your Podman Desktop and explore AI catalog to start building your AI applications. Follow these steps to get started:

  1. Open Podman Desktop on your laptop. Download and install if not already installed.
  2.  Browse through the Extensions catalog of Podman Desktop and access the Red Hat extension pack.
podman_ai_prod_page_figure_1
  1. You can also access Podman Desktop dashboard to access the Red Hat extension pack.
podman_prod_page_figure_2

Latest articles

Article
Article
Dec 09, 2024

Develop SQL Server databases on RHEL with Podman Desktop

Louis Imershein

Discover how Podman Desktop makes it easy to create, deploy, and manage SQL...

Featured image for Podman Desktop.
Article
Nov 27, 2024

Get started with bootable containers and image mode for RHEL

Cedric Clyburn

Learn how to use and build bootable containers for disk image operating...

Featured image for AI/ML
Article
Nov 22, 2024

How RamaLama makes working with AI models boring

Daniel Walsh

The RamaLama project simplifies AI model management for developers by using...

Feature image for Podman Desktop.
Article
Sep 30, 2024

How to use RHEL as a WSL Podman machine

Jeff Maury

Learn how you can run RHEL on Windows as a Windows Subsystem for Linux...