logoalt Hacker News

AmazingTurtlelast Sunday at 8:08 AM1 replyview on HN

He presented an empty prompt to gpt OSS and let it run many times. Through temperature, the results vary quite a lot. He sampled the results.

Feeding an empty prompt to a model can be quite revealing on what data it was trained on


Replies

YeGoblynQueennelast Sunday at 10:00 AM

Not an empty prompt but a one-token prompt:

>> i sample tokens based on average frequency and prompt with 1 token

https://x.com/iamgrigorev/status/1953919577076683131