logoalt Hacker News

ttoinou • today at 10:20 PM • 1 reply • view on HN

I’m already able to use 1M context windows with the same machine than you and same model. Strange

Replies

vlowther • today at 11:07 PM

Yeah, most of what I did was to add fused TQ support to leave more memory free for other nefarious purposes.