Congrats! Happy to see someone seriously pursuing this direction.
Same. Models that are fast (and thus by extension, in some direction, efficient) but not local/self-hosted IMO fill a niche for quick and cheap (and acceptable quality, of course) inference in business contexts.
Same. Models that are fast (and thus by extension, in some direction, efficient) but not local/self-hosted IMO fill a niche for quick and cheap (and acceptable quality, of course) inference in business contexts.