logoalt Hacker News

dacoxyesterday at 9:58 PM2 repliesview on HN

the 1.5 and 2.0 flash models were absolute beasts. They were very cheap, and _very_ fast. We contemplated moving some of our fine tuned workloads to them because we would have gotten very substantial total latency reductions for our workloads.

However, they are aggressively deprecating them (OpenAI is as well), and replacing with newer models. These newer models are all reasoning models, and importantly, only bear the flash name. They are not fast. And they are very expensive!


Replies

imhoguyyesterday at 10:52 PM

I test workloads with multiple closed and at least one open model now. Good to have a backup on 503s or credits run out.

bjordyesterday at 10:38 PM

have you experimented at all with the deepseek flash models?