logoalt Hacker News

selfhoster11last Saturday at 2:03 AM1 replyview on HN

Local LLMs are becoming more popular and easier to run, and Chinese corporations are releasing extremely good models of all sizes under MIT or similar terms in many cases. There amount of VRAM is the main limiter, and it would help with gaming too.


Replies

alganetlast Saturday at 2:15 AM

Gaming needs no additional VRAM.

From a market perspective, LLMs sell GPUs. Doesn't even matter if they work or not.

From the geopolitical tensions perspective, they're the perfect excuse to create infrastructure for a global analogue of the Great Firewall (something that the Chinese are pioneers of, and catching up to the plan).

From the software engineering perspective, LLMs are a nuissance, a distraction. They harm everyone.

show 1 reply