logoalt Hacker News

ac29 • today at 2:21 PM • 2 replies • view on HN

Yeah, I spent the last week with Deepseek Flash 4.1-1017, Kimi 3, and GLM 5.3 (and 5.3-flash). None of them were literally useless but also none of them were capable of making progress on the main project I am working on where Opus, Sol, and even Gemini Flash have all done very good work. Benchmarks might have you believe open models are only barely behind the big US labs in intelligence, but it feels much worse in practice.


Replies

joshheitzman • today at 5:49 PM

As a counter-example, I use Deepseek v4.1 Flash to make progress on multiple projects (Python, C++, CUDA) every single day.

jacquesm • today at 2:26 PM

Interesting! If you are at liberty to disclose, what problem space are you working in, what harness do you use?