logoalt Hacker News

tecleandor • today at 9:33 PM • 2 replies • view on HN

GPT-2 124M is terrible...

  > what is 2+2?
Answer:

  > 3+3? 4+4? 5+6? 7+8?
  > Reply ~18000 0 ~10 min 2 By : 1-1: I'm a beginner. 3x2 is my best option, but if you're not sure about the other options then just go for it and try again

Replies

krackers • today at 9:36 PM

It's not instruct tuned looks like? It's closer to a base model rather than a chatbot.

➕ show 1 reply
logicallee • today at 10:05 PM

GPT-2 is an interesting one because it is a February 2019 model. (You can see some information about it below the card if you click on the card.)

That was 2-3 years before the big "ChatGPT moment" (the highly coherent ChatGPT research preview was released in November 2022, I think it was ChatGPT 3.5). Back in 2019 the models really were not producing very coherent output. Now you can see it for yourself right in your browser :) Everything has come a really long way since then!

➕ show 1 reply