What’s Vulnerable › Vulnerabilities

CVE-2024-58400: llama.cpp before b3701 Out-of-Bounds Read in llama_decode via Token IDs

Description

llama.cpp before b3701 contains an out-of-bounds read vulnerability in llama_decode_internal and llama_encode_internal that allows remote unauthenticated attackers to read memory by supplying unvalidated token IDs. Attackers can send integer-array prompts to the llama-server /completion endpoint with IDs outside 0 to n_vocab to read embedding memory out of bounds or crash the process.

Affected products

How to fix

Upgrade to a fixed version: ggml-org llama.cpp b3701. Check the vendor advisory for mitigations.

References

Get alerted when CVE-2024-58400 or the next vulnerability affects your stack