logoalt Hacker News

zahlman • today at 2:40 PM • 2 replies • view on HN

So to be clear, you can't prompt-inject these?

... How did they get into the training data?


Replies

mmastrac • today at 2:56 PM

They are a special token that you can't just type out in text. It _renders_ as text, but cannot be input into the system as text. The model understands the difference between the textual toolcall token and the "special" one that's really just a spicy number.

➕ show 2 replies
Muromec • today at 4:57 PM

It can happen that you would be able to inject them if there is a bug, same way sql injections work.

You have all the same pieces -- untrusted input on the left and the thing that accepts a stream of tokens on the right. In the middle could be anything, especially when vibecoded.