logoalt Hacker News

hikarudotoday at 5:58 PM0 repliesview on HN

Why? The inference server isn't a harness, it's tokens in, tokens out. That's different from a harness.