logoalt Hacker News

amarshallyesterday at 8:25 PM0 repliesview on HN

If you are running on 4090 and get 5 t/s, then you exceeded your VRAM and are offloading to the CPU (or there is some other serious perf. issue)