alt Hacker NewsRunning small models locally beats wrestling with API latencies and rate limits. The compute trade-off is 100% worth the privacy and DX gains.
Running small models locally beats wrestling with API latencies and rate limits. The compute trade-off is 100% worth the privacy and DX gains.