Isn't there something to be said for owning your own hardware though?
Not if it's 5-10x slower than a remote inference server. Mac prefill latency is exhausting.
alt Hacker News
Not if it's 5-10x slower than a remote inference server. Mac prefill latency is exhausting.