alt Hacker NewsAmazon is not "meaningfully in inference"? Bedrock seems to have a ton of enterprise customers, some of which would never trust the AI labs themselves with their data but will trust Amazon.
Replies
appplication • today at 1:52 AM
Relative to their other compute or other players inference, not as significantly. Though yes, they certainly have some share.
A lot of this companies are also in parallel evaluating running Chinese models inhouse to be independent of the good will and profit margins of externals.
This is where Oracles "datacenters for rent to run your own Chinese models" strategy will benefit. The LLM SaaS game is a lost one thanks to China.