logoalt Hacker News

Devastatoday at 1:47 PM1 replyview on HN

If I were to get one of these, realistically what is the most advanced AI model I could run locally?


Replies

Zyloklototoday at 2:12 PM

GLM 5.3 in ~q4 quantiziation with 4bits