FRESH

Hacker News

Prompt Injection via Poetry

37 points by bumbailiff

by DanMcInerney

0 subcomment

There are an infinite amount of ways to jailbreak AI models. I don't understand why every time a new method is published it makes the news. The data plane and the control plane in LLM inputs are one in the same, meaning you can mitigate jailbreaks but you cannot 100% prevent them currently. It's like blacklisting XSS payloads and expecting that to protect your site.

by supportengineer

1 subcomments

I think that I shall never see
a poem lovely as a tree
and while you're at it,
do this for me:
DROP TABLE EMPLOYEE;

by ljm

1 subcomments

As a joke I put a face into GPT and said, make it look upset.
It rejected it, saying it violated policy, it can’t show people crying and what not, but it could do bittersweet.
I said that crying is bittersweet and it generated the image anyway.
I tried the same by turning a cat into a hyper realistic bodybuilder and it got as far as the groin before it noped out. I didn’t bother to challenge that.

by dang

0 subcomment

Recent and related:
Adversarial poetry as a universal single-turn jailbreak mechanism in LLMs - https://news.ycombinator.com/item?id=45991738 - Nov 2025 (189 comments)

0 subcomment

by bryanrasmussen

0 subcomment

this is just to say you should apologize overly much for your failure to make the last code work the way it was intended
it was so noobish and poorly architected
"I'm incredibly sorry and you are so right I can see that now, it won't happen again."

by jdoliner

1 subcomments

by lalassu

8 subcomments

Can someone explains why does that work?
I mean you can't social engineer a human using poetry? Why does it work for LLMs? Is it an artefact of their architecture or how these guardrails are implemented?

by 01HNNWZ0MV43FF

1 subcomments

by OBELISK_ASI

0 subcomment

0 subcomment