alt Hacker NewsWhat are the other specs and how's your setup look? You need a minimum of 24GB of RAM for it to run 16GB or less models.
Replies
SV_BubbleTime • yesterday at 3:00 PM
This is typically true.
And while it is stupid slow, you can run models of hard drive or swap space. You wouldn’t do it normally, but it can be done to check an answer in one model versus another.
Hamuko • yesterday at 3:10 PM
48 GB MacBook Pro. All of the models I've tried have been slow and also offered terrible results.
➕ show 1 reply
Tokens per second is abysmal no matter how much ram you have