The fact that LLMs can play chess at any level is a strong indication we are in AGI.
Can they if they frequently make illegal moves?
No it isn't. Computers could play chess long before LLMs, better than LLMs can in fact. That didn't make them AGI.
Can they if they frequently make illegal moves?