P-EAGLE: Faster LLM inference with Parallel Speculative Decoding in vLLM

In this post, we explain how P-EAGLE works, how we integrated it into vLLM starting from v0.16.0 (PR#32887), and how to serve it with our pre-trained checkpoints.