alt Hacker NewsHere's my report running several different models on a dual Xeon with 256 GB of DDR4 and no GPU.
https://gist.github.com/hparadiz/f3596d00a62d8ebb2dadcc46ee5...
Replies
neomindryan • today at 5:05 PM
Thank you for sharing!
Here's my report running several different models on a dual Xeon with 256 GB of DDR4 and no GPU.
https://gist.github.com/hparadiz/f3596d00a62d8ebb2dadcc46ee5...
Thank you for sharing!
Have you tried with a single CPU to get rid of the NUMA penalty? I understand this likely means halving the memory but I am interested in how much of a difference it makes