alt Hacker News> If someone buys one of these $8000 GPUs to run GLM-4.7, they're going to be immensely disappointed. This is my point.
Absolutely, same if they get a $10K Mac/Apple computer, immense disappointment ahead.
Best is of course to start looking at models that fit within 96GB, but that'd make too much sense.
$10k is > 4 years of a $200/mo sub to models which are currently far better, continue to get upgraded frequently, and have improved tremendously in the last year alone.
This almost feels like a retro computing kind of hobby than anything aimed at genuine productivity.