logoalt Hacker News

Tepix • today at 12:42 PM • 0 replies • view on HN

This 100%

Reddit is flooded with these breathless headlines “xyz tokens/s on my light switch”. It’s always quantizations below 4 bits per weight. Mostly useless.