That sounds like a useful extension to use local LLMs, I guess equivalents exist, or the licensing on this is such that it could get forked.