alt
Hacker News
rubiquity
•
today at 3:46 PM
•
0 replies
•
view on HN
At 8-bit quantization (q8_0) I get 20 tokens per second on a Radeon R9700.
alt Hacker News