logoalt Hacker News

EagnaIonatyesterday at 5:08 PM1 replyview on HN

It scales fine if done correctly.

Even with the weights the extra context allows it to move to the correct space.

Much the same as humans there are terms that are meaningless without knowing the context.


Replies

kangyesterday at 8:57 PM

Would it be possible to make GPT3 from GPT2 just by prompting? It doesn't work/scale

show 1 reply