logoalt Hacker News

zozbot234today at 12:21 PM0 repliesview on HN

Unusable for anything like realtime response, yes. Might be usable and even quite sensible to power less-than-realtime uses on much cheaper inference platforms, as long as the slow storage bandwidth doesn't overly bottleneck compute.