logoalt Hacker News

thomastilltoday at 8:52 PM2 repliesview on HN

Congrats! Happy to see someone seriously pursuing this direction.


Replies

msdztoday at 8:58 PM

Same. Models that are fast (and thus by extension, in some direction, efficient) but not local/self-hosted IMO fill a niche for quick and cheap (and acceptable quality, of course) inference in business contexts.