Interesting setup, thx for sharing. How many tokens/sec do you get with 27b? Are you using MT... | alt Hacker News

alt Hacker News

hbbio • today at 5:04 AM • 0 replies • view on HN

Interesting setup, thx for sharing.

How many tokens/sec do you get with 27b? Are you using MTP?