we've got a legacy code base that LLMs aren't very handy in anyway

So do I. What I'm finding is that they are now.

I've spent the last week tracking down bugs using Fable that have gone undiagnosed for several years. And this is a damned obscure legacy code base that runs on a proprietary 8051 variant. Guaranteed to be nothing like it in-distribution.