logoalt Hacker News

vlovich123today at 2:54 PM4 repliesview on HN

341 is two orders of magnitude faster than your 1 tok/s so it doesn’t seem like their stuff is all that obvious. I also have no baseline for training to know if 341tok/s is slow but it seems speedy for a 3090.


Replies

bastawhiztoday at 2:56 PM

OP said 1k, not 1

SubiculumCodetoday at 3:48 PM

:) Coffee is good

rolandrtoday at 2:57 PM

1k tok/s = 1000 tok/s...

thrawa8387336today at 4:06 PM

OOM is log10