Was interested... but then realized it needs an NVIDIA api key?
I've not tried running it but while it defaults to NVIDIA hosted endpoints but the readme suggests you can host those yourself if you want.
You can self-host the LLMs involved, API key is only if you're using nvidia-hosted
I've not tried running it but while it defaults to NVIDIA hosted endpoints but the readme suggests you can host those yourself if you want.