logoalt Hacker News

GodelNumbering • today at 4:15 PM • 1 reply • view on HN

The previous gen pro used to have this weird tick where if you ask it a reasonably open ended question, it would number things in the response and assign each one some weird label starting with 'The...'

e.g.

    X: The Parameters
    Y: The "System"
    Z: The "Ongoing Grind"
The first two prompts I tested in AI Studio does the same, unfortunately.

Another quite unpleasant tick was that if you specify a peculiar term in your prompt as a conversational shortcut, it would keep repeating that throughout the conversation. e.g. "...What is a bitter lesson pilled way to do this?", then you'd see it will quote "bitter lesson pilled" at like 7 places in its response. This one seems to have eased off a little.


Replies

Corence • today at 4:22 PM

I feel like this is a quirk of LMSYS-style optimization where humans in SxS preference evals will pick based on formatting more than actual content.