Not just building GPU infrastructure to serve inference at scale, but also constraining GPU infrastructure and pricing it out of reach for individuals who wish to pursue open models.
I'm not sure what entirely to do about it, but the fact that some providers still release open models is hopeful to me.
alt Hacker News
Not just building GPU infrastructure to serve inference at scale, but also constraining GPU infrastructure and pricing it out of reach for individuals who wish to pursue open models.
I'm not sure what entirely to do about it, but the fact that some providers still release open models is hopeful to me.