Red Hat AI

featured image for SparseGPT.
Article

SparseGPT: Remove 100 billion parameters for free

Robert Shaw +1

Compress large language models (LLMs) with SparseGPT to make your machine learning inference fast and efficient. Prune in one-shot with minimal accuracy loss.