Helen Zhao

Speculators standardizes speculative decoding for large language models, with a unified Hugging Face format, vLLM integration, and more.

LLM Compressor 0.7.0 brings Hadamard transforms for better accuracy, mixed-precision FP4/FP8, and calibration-free block quantization for efficient compression.