In the past Google et al would hire engineers based on how well they could optimize the infrastructure.
Maybe soon companies will look at how engineers can optimize the token efficiency of AI.
That assumes Tokens will remain a meaningful expense. I’m not sure developers will find uses for ever more tokens nearly as quickly as the prices fall.
That assumes Tokens will remain a meaningful expense. I’m not sure developers will find uses for ever more tokens nearly as quickly as the prices fall.