CVE-2026-44223

vLLM: extract_hidden_states speculative decoding crashes server on any request with penalty parameters

State
Published
Severity
6.5 Medium
Published
May 12, 2026
Updated
Jun 22, 2026
Reserved
May 5, 2026

Read the record on cve.org

Description

vLLM is an inference and serving engine for large language models (LLMs). From 0.18.0 to before 0.20.0, the extract_hidden_states speculative decoding proposer in vLLM returns a tensor with an incorrect shape after the first decode step, causing a RuntimeError that crashes the EngineCore process. The crash is triggered when any request in the batch uses sampling penalty parameters (repetition_penalty, frequency_penalty, or presence_penalty). A single request with a penalty parameter (e.g., "repetition_penalty": 1.1) is sufficient to crash the server. This vulnerability is fixed in 0.20.0.

Scores

CVSSScoreVectorSource
3.16.5 MediumCVSS:3.1/AV:N/AC:L/PR:L/UI:N/S:U/C:N/I:N/A:HGitHub_M

Weaknesses

  • CWE-131 Incorrect Calculation of Buffer Size
  • CWE-704 Incorrect Type Conversion or Cast

Affected Products

ProductVersions
vllmvllm-project
  • >= 0.18.0, < 0.20.0Affected

References

Every record here comes from the CVE Program’s CVE List. © 1999–2026 The MITRE Corporation. CVE is a registered trademark of The MITRE Corporation. The records are reproduced under the CVE Program terms of use.