alt Hacker News> We exclusively use 1M internally, so we're dogfooding it all day
That is so out of touch. Customers do not exclusively use 1M. This is like a fronted developer shipping tons of unused Mb and being oblivious because they are on fast internet themselves.
They should ideally have automated tests with the option models and smaller context window to check there are no regressions.