alt Hacker NewsShow HN: Jevgpt – reinventing the wheel with another wheel
Felt extra autistic today and made jev an autoregressive chatbot by classifier small token vocabularies.
https://github.com/giga-james/jevgpt
had some trouble getting it to explore enough token options so i did a small spec decoding pass to expand token vocab (jev as drafter and verifier lol)
it aint much and it aint honest work either
This is amazing. I don't think I fully understand how it works, but the core of having Jev (or some classifier), generate the words/tokens it's going to output by picking/classifying the words/tokens, is very cool
Where do you see the biggest potential improvement gains?