Python

Colorful abstract coding elements displayed over a dark gray background.
Article

New features in Python 3.14

Louis Imershein +1

This post discusses the headline features in Python 3.14 and how Red Hat supports the interpreter across various platforms, including Red Hat Enterprise Linux 10.2 and Red Hat Enterprise Linux 9.8. It provides details on the delivery mechanisms for Fedora, CentOS Stream, Red Hat Enterprise Linux, Red Hat Universal Base Image (UBI), Red Hat Hardened Images, and Red Hat OpenShift.

Get started with vLLM feature share
Learning path

Get started with vLLM

Cedric Clyburn +1

Learn how to compress, serve, and benchmark LLMs with vLLM.

Featured image for: micropipenv: Installing Python dependencies in containerized applications.
Article

Build more secure, optimized AI supply chains with Fromager

Lalatendu Mohanty

Learn how Fromager, an open source project, helps protect Python dependencies by rebuilding entire dependency trees from source, providing network-isolated builds, and managing dependencies as a verifiable map. Discover how Fromager ensures supply chain verifiability, ABI compatibility, and customization.

Featured image for agentic AI
Article

Distributed tracing for agentic workflows with OpenTelemetry

Fabio Massimo Ercoli

Learn how to set up distributed tracing for an agentic workflow based on lessons learned while developing the it-self-service-agent AI quickstart. This post covers configuring OpenTelemetry to track requests end-to-end across application workloads, MCP servers, and Llama Stack.

Jupyter Notebooks on Red Hat OpenShift AI share/feature image
Article

Accelerated expert-parallel distributed tuning in Red Hat OpenShift AI

Karel Suta +4

Discover how to optimize training of MoE models with fms-hf-tuning, an open source tuning library for PyTorch FSDP and Hugging Face libraries. Learn about preprocessing data, throughput and memory efficiency features, distributed training, and expert parallelism. Improve your AI and agentic applications on domain-specific enterprise tasks.

Featured image for agentic AI
Article

Automate AI agents with the Responses API in Llama Stack

Michael Dawson

Learn how the Responses API in Llama Stack automates complex tool calling while maintaining granular control over conversation flow for AI agents. Discover the benefits and implementation details.

Red Hat AI
Article

Estimate GPU memory for LLM fine-tuning with Red Hat AI

Mohib Azam

Learn how to estimate memory requirements for your LLM fine-tuning experiments using Red Hat Training Hub's memory_estimator.py API. This guide covers the memory components, adjusting training setups for specific GPU specifications, and using the memory estimator in your code. Streamline your model fine-tuning process with runtime estimates and automated hyperparameter suggestions.

ai-ml
Article

Optimize PyTorch training with the autograd engine

Vishal Goyal

Understand the PyTorch autograd engine internals to debug gradient flows. Learn about computational graphs, saved tensors, and performance optimization techniques.