This seems like a solution looking for a problem. https://tiller.com/ works great and lets you do whatever calculations you want in a spreadsheet - and, bonus, it's never going to hallucinate.

I don't quite understand the desire to have these verbose summaries that you have to read from LLMs. You'll notice anomalies if you just categorize each of your expenses every so often (easy with Tiller).