logoalt Hacker News

roger_today at 1:14 PM3 repliesview on HN

Seeing a lot of these “run 1TB models with 1GB RAM” projects recently. Most seem vibe coded and probably won’t be maintained.

Hoping a winner emerges with some real momentum behind it.


Replies

hiramwentoday at 1:22 PM

You don't really need a maintainer when codex or claude code can set it up for you; thats how I got Trellis2 working on windows and tiny VRAM despite Microsoft recommending you have 24GB VRAM and Linux. Models are pretty disposable now.

show 2 replies
akietoday at 1:58 PM

No no, don't just say "vibe coded", say "Fable and $500 of credits"

show 2 replies
classifiedtoday at 1:28 PM

How a patchwork of Python modules constitutes an API(?) or whatever(?) and how to use it (does anyone?), is beyond me. There is nothing that I would call documentation, let alone concrete usage examples. I know more amusing ways to waste my time. When I want to play with models, I use llama.cpp.