logoalt Hacker News

shikon7yesterday at 11:24 PM3 repliesview on HN

Strawberries are a well known weakness of LLMs, as they have a hard time to count the numbers of "r"s in them. Maybe that's why, because they fear that weakness could be exploited somehow.


Replies

HDBaseTtoday at 1:08 AM

Strawberries aren't the weakness, the weakness is the tokenization of a prompt. Any word with multiple duplicate characters is going to be troublesome for LLMs.

show 1 reply
skeledrewyesterday at 11:30 PM

Probably need to be taught by someone of Latino origin. Learning to roll them "r"s could help.

show 1 reply
verdvermtoday at 12:07 AM

I always thought this should be easier by telling it to write each letter one a new line, then count, any token separator ought to suffice, so much so you'd think they'd have trained in this strategy given tokens make individual letters opaque