logoalt Hacker News

solarkraftlast Sunday at 7:27 PM0 repliesview on HN

Are there benchmarks that effectively measure this? This is essential information when speccing out an inference system/model size/quantization type.