Red Hat Developer Blog
Here's our most recent blog content. Explore our featured monthly resource as well as our most recently published items. Don't miss the chance to learn more about our contributors.
View all blogs & articles

4-bit and 8-bit quantized LLMs excel in long-context tasks, retaining over...

Sparse fine-tuning in combination with sparsity-aware inference software,...

Mar 21, 2023
Compress large language models (LLMs) with SparseGPT to make your machine...