logoalt Hacker News

wavemodeyesterday at 10:24 PM1 replyview on HN

OpenAI themselves must not have a "reasonable definition of L", then. Their own papers and press releases refer to GPT-2 (from 2019) as a "large language model".

https://openai.com/index/better-language-models/


Replies

danielmarkbruceyesterday at 10:51 PM

Yes, and 1.5 billion parameters meets no reasonable current definition of large. It would be considered a tiny language model. OpenAI themselves refer to their small/fast models as small models all over their documentation.

show 1 reply