alt Hacker NewsNice. This demolishes the "LLMs can reason" (but not enough to avoid this sort of basic error) and "humans make mistakes too" (not like this) talking points from the LLM promoters.
Replies
I don‘t think any of these pro-AI talking points are in good faith.
I think these talking points are there to hype up the technology or otherwise excuse the mis-allignment (i.e. consumer hostility).
> This demolishes the "LLMs can reason"
This is completely silly. If you don’t think LLMs can reason, you’ve either never used them to do tasks that require reasoning, or you don’t understand enough to recognize what’s involved in the responses you get.
In this case it’s clearly the latter, because you’re confusing image generation models with LLMs. There are very big differences between the two. No-one is claiming that image generation models are capable of reasoning.
There's a lot of space between:
- LLM's can reason
- everything an LLM does is the result of reasoning
This demolishes only the latter point, which as far as I know has no supporters.