This is similar to something I was playing around with last month-- basically just a CLI for accessing the foundational models.

https://github.com/ehamiter/afm

It's really handy for quick things like "what's the capital of country x" but for coding, I feel that it is severely limited. With such a small context it's (currently) not great for complicated things.