logoalt Hacker News

soVeryTiredtoday at 11:40 AM2 repliesview on HN

Out of interest, would you call BERT an LLM? It’s pre trained but not particularly large.


Replies

stymaartoday at 11:45 AM

AFAIK, the “large” qualifier came when transformers allowed to scale the size of language models compared to the recurrent models that where in fashion before. And although BERT isn't large by today's standard, it was large enough for the time.

evilmathkidtoday at 12:19 PM

idk the definition is fuzzy. thats why people use the "modern" qualifier to talk about decoder-only style and this is also not clean since you now have reasoning models which are separate