alt Hacker NewsI’ve a 128GB m3 max MacBook Pro. Running the gpt oss model on it via lmstudio once the context gets large enough the fans spin to 100 and it’s unbearable.
Replies
embedding-shape • yesterday at 6:01 PM
Yeah, Apple hardware don't seem ideal for LLMs that are large, give it a go with a dedicated GPU if you're inclined and you'll see a big difference :)
➕ show 1 reply
Laptops are fundamentally a poor form factor for high performance computing.