Given the rate of progress, it's hard to argue why this couldn't be a reality.
If in the future Taalas-type chips with baked in frontier models are commonplace, this should be quite different price-wise from what we have now.
It's a bit dizzying to imagine that LLMs might even be able operate at speeds of chatjimmy.ai, but we already have working tech that does exactly this (albeit with less intelligence/capabilities).
alt Hacker News
Given the rate of progress, it's hard to argue why this couldn't be a reality.
If in the future Taalas-type chips with baked in frontier models are commonplace, this should be quite different price-wise from what we have now.
It's a bit dizzying to imagine that LLMs might even be able operate at speeds of chatjimmy.ai, but we already have working tech that does exactly this (albeit with less intelligence/capabilities).