alt Hacker NewsThat's just not a good use of my Claude plan. If you can make it so a self-hosted Lllama or Qwen 7B can query it, then that's something.
Replies
mcintyre1994 • today at 10:56 AM
I think that’s just a matter of their capabilities, rather than anything specific to this?
It's ultimately just a prompt, self-hosted models can use the system the same way, they just might struggle to write good SQL+vector queries to answer your questions. The prompt also works well with Codex, which has a lot of usage.