Off-by-One Vulnerability in vLLM by vllm-project
CVE-2026-115916
What is CVE-2026-115916?
The vLLM inference and serving engine for large language models contains an off-by-one vulnerability in its handling of tokenized prompts. Specifically, prior to version 0.32.0, the implementation computes the maximum token ID with an incorrectly set upper bound. This flaw allows a pre-tokenized prompt ID that matches the vocabulary size to bypass validation checks. In scenarios involving a tensor-parallel size of one and an exact multiple-of-64 vocabulary, this issue leads to VocabParallelEmbedding.forward failing to properly mask this value before it is utilized by F.embedding. Consequently, this can trigger a CUDA device-side assertion, resulting in the termination of the engine. This vulnerability has been addressed in version 0.32.0.
Affected Version(s)
vllm < 0.32.0
