logoalt Hacker News

monster_truckyesterday at 7:22 PM2 repliesview on HN

I'd throw a 7900xtx in an AM4 rig with 128gb of ddr4 (which is what I've been using for the past two years)

Fuck nvidia


Replies

clusterhacksyesterday at 8:02 PM

You know, I haven't even been thinking about those AMD gpus for local llms and it is clearly a blind spot for me.

How is it? I'd guess a bunch of the MoE models actually run well?

show 1 reply
androiddrewyesterday at 7:31 PM

Get a Radeon AI Pro r9700! 32GB of RAM