Ecosyste.ms: Advisories

An open API service providing security vulnerability metadata for many open source software ecosystems.

Security Advisories: GSA_kwCzR0hTQS13YzM2LTk2OTQtZjlyZs4AA_mw

vLLM Denial of Service via the best_of parameter

A vulnerability was found in the ilab model serve component, where improper handling of the best_of parameter in the vllm JSON web API can lead to a Denial of Service (DoS). The API used for LLM-based sentence or chat completion accepts a best_of parameter to return the best completion from several options. When this parameter is set to a large value, the API does not handle timeouts or resource exhaustion properly, allowing an attacker to cause a DoS by consuming excessive system resources. This leads to the API becoming unresponsive, preventing legitimate users from accessing the service.

Permalink: https://github.com/advisories/GHSA-wc36-9694-f9rf
JSON: https://advisories.ecosyste.ms/api/v1/advisories/GSA_kwCzR0hTQS13YzM2LTk2OTQtZjlyZs4AA_mw
Source: GitHub Advisory Database
Origin: Unspecified
Severity: Moderate
Classification: General
Published: about 1 month ago
Updated: about 1 month ago


CVSS Score: 6.2
CVSS vector: CVSS:3.1/AV:L/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H

Identifiers: GHSA-wc36-9694-f9rf, CVE-2024-8939
References: Repository: https://github.com/vllm-project/vllm
Blast Radius: 4.3

Affected Packages

pypi:vllm
Dependent packages: 46
Dependent repositories: 5
Downloads: 625,856 last month
Affected Version Ranges: <= 0.5.0.post1
No known fixed version
All affected versions: