Domain-Camouflaged Injection Attacks Evade Detection in Multi-Agent LLM Systems
38 points by sbulaev
by dwa3592
1 subcomments
Why weren't these attacks tested on the frontier models? The models they tested these on can also be fooled by poems and rhymes.
by simonw
1 subcomments
It concerns me that anyone with anything important to protect might trust what this paper calls "Injection detectors deployed to protect LLM agents" - Llama Guard and the like.
There are unlimited combinations of tokens that can be used to attack an LLM system. The idea that some kind of "detector" can catch them all just feels inherently absurd to me.
by buppermint
0 subcomment
The paper title is a bit misleading. The tested detectors and models here are small and rather dated (Llama 3.1 8B and Gemini Flash 2.0 - these are basically in the level of a modern 1B model), and the actual paper says this only shows vulnerability in small model systems.
Hacker News