Manage LLM evaluation workloads at scale with EvalHub and Kueue
Learn how to optimize EvalHub's benchmark evaluations by using Kueue for fair resource sharing, priority-based job scheduling, and automatic queueing.
Learn how to optimize EvalHub's benchmark evaluations by using Kueue for fair resource sharing, priority-based job scheduling, and automatic queueing.
Learn how to resolve the observability challenges inherent in high-churn CI/CD environments on Red Hat OpenShift Pipelines.
Learn how to automate application migration using MigIQ, a platform that combines graph analysis, automated planning, and parallel execution.
Look inside Red Hat AI Inference on Amazon EKS to understand its core architectural components and Kubernetes resources.
Learn how to onboard a custom evaluation framework into EvalHub using one class, one method, and a container image. This guide covers the contract, data structures, and a complete minimal adapter.
Learn how to implement true gang autoscaling on OpenShift using Red Hat build of Kueue and ProvisionRequest API. This approach ensures efficient and reliable scheduling of high-performance workloads like AI/ML training, HPC simulations, or large data processing.
Learn how the Krkn scenario generator, an AI-assisted chaos engineering tool for Kubernetes, addresses the challenge of translating desired chaos tests.
Learn how to read an existing system collection, understand its threshold logic, and build your own collection that encodes your actual measurement strategy with thresholds that mean something.
A deep dive into the confidential containers solution on OpenShift bare metal, integrating TEEs into cloud-native platforms to provide hardware-backed workload isolation.
Learn how to deploy Hermes Agent, a self-improving AI agent with a learning loop, on OpenShift AI with GPU-accelerated vLLM model serving.
Prevent OOM crashes in controller-runtime operators. Learn how to filter your Kubernetes informer cache to stop ConfigMap-driven denial-of-service attacks.
Discover how NVIDIA confidential computing and OpenShift sandboxed containers work together to secure GPU workloads through hardware-based isolation and attestation.
Learn how to prevent GPU waste and financial loss by implementing just-in-time (JIT) checkpointing with Kubeflow Training SDK on OpenShift AI.
Learn about a new feature in Red Hat OpenShift GitOps operator 1.20.2 that simplifies the management of trusted TLS certificates for Argo CD.
How to use a split disk configuration to solve disk space management issues, specifically in OpenShift clusters running large AI/ML workloads.
Learn practical troubleshooting steps for common debugging scenarios in OpenShift 4.20's image mode. Understand the three stages of the process, MachineOSConfig creation, MachineOSBuild creation and execution, and application of the new image to nodes. Discover what to watch for in each stage to keep your clusters running smoothly.
Learn how Red Hat AI 3.4 uses EvalHub to orchestrate AI evaluations on Kubernetes. Scale frameworks like Garak and LightEval with built-in MLflow tracking.
Tekton is now a CNCF incubating project, aligning with the Kubernetes ecosystem to foster deeper collaboration and integration for cloud-native CI/CD.
Learn how the ObservabilityInstaller one-click installation simplifies the deployment of a production-ready distributed tracing stack on OpenShift.
Discover how OpenStack Services on OpenShift distributed zones isolate storage to separate failure domains for business resiliency and continuity.
Deploy multiple Red Hat OpenStack Services on OpenShift clusters using hosted control planes (HCPs) to achieve scalable isolation and efficiency.
Learn how Kagenti ADK, an open source toolkit, handles the complexities of managing production AI agents. It aligns with the Linux Foundation's Agent2Agent (A2A) protocol and provides a set of runtime services for easier deployment and operation.
Discover a three-cluster architecture for deploying hosted control planes with OpenShift Virtualization, suitable for large enterprises requiring maximum isolation and independent scaling.
Learn how to use Zabbix integrated with Prometheus/Thanos in the OpenShift Virtualization cluster using low level discovery (LLD) to automate VM discovery.
Learn how migrating the controller deployment strategy in OpenShift Pipelines 1.20 from leader election to StatefulSet-based sharding improved performance.