logoalt Hacker News

ceroxylontoday at 12:58 AM1 replyview on HN

>The gateway adds under 1 ms for BYOK requests

Amazing! Really brilliant idea, thank you for sharing this project. There is so much ground to cover in the LLM gateway / routing / reporting world, and this is a great start. The Tinker implementation is my favorite part, fine tuning is much better than a sea of context files.


Replies

kfallah15today at 1:21 AM

Thanks! We are going to add continual RL via Tinker soon too