I tried it on my 6GB GPU and got 0.67 tokens per second. Need more than 6GB to run it well.