logoalt Hacker News

26d0today at 3:03 PM1 replyview on HN

The point I think is interesting is that this is just 7B. The current SOTA 7B LLMs are barely usable for quite simple coding.


Replies

becquereltoday at 6:53 PM

Text is in a sense way harder to do than images because of radical nonlocality. A word at the start of one paragraph can directly influence the meaning of a word five paragraphs away. Whereas images typically represent the real world, or at least a spatial domain, which gives you a lot of structure 'for free'. If you are drawing a human, you can make a reasonable guess where their hands go in relation to their face. If someone hands you the first half of an essay, finishing it is not trivial.