logoalt Hacker News

skohan • yesterday at 8:38 PM • 0 replies • view on HN

Memory size is a bottleneck, but I have found that speed is very important for getting actual work done. Running a big model is great, but if you're getting 10t/s you're going to be spending a lot of time waiting.