Fynn Schmitt-Ulms

Speculators v0.5.0 introduces DFlash support, enabling single-pass draft token generation with block diffusion for more efficient speculative decoding workflows. The release also adds unified online and offline training through vLLM’s native hidden states extraction system, improving training flexibility, version stability, and production readiness.

Speculators standardizes speculative decoding for large language models, with a unified Hugging Face format, vLLM integration, and more.

Explore the evolving LLM post-training datasets, the various formats, and transformation process from structured datasets into token sequences.