They literally cannot. They can detect the user’s intent to do math, and then use a different tool to do math, hopefully with the correct inputs. The LLM is not suited to giving deterministic answers to math problems.

That is a conflation of LLMs (which have clear limitations) and complex harnesses of which an LLM is one component.

I think it is clear that future AI may incorporate an LLM as a component but the current concept of LLMs are a transitional form that will give way to more capable composite models.

They can do math but not arithmetic, which I assume is what the commenter meant