logoalt Hacker News

soerxpsoyesterday at 10:31 PM1 replyview on HN

I would think it's possible to make it so that the 4B model only needs to be called during an initial phase, and then the same queries it constructed can just be re-used with values replaced, unless you're generating a lot of unique on-the-fly query shapes.


Replies

setryesterday at 11:54 PM

With query hints finally being added it’d probably be doable as an extension