alt Hacker NewsA 10M window would require dozens of GPUs (or TPUs) dedicated to each query. That is something that Google could afford internally but wouldn't be able to scale to an external product.
A 10M window would require dozens of GPUs (or TPUs) dedicated to each query. That is something that Google could afford internally but wouldn't be able to scale to an external product.
More like one huge waferscaler such as Cerebras.