logoalt Hacker News

freecodeio • today at 8:30 PM • 1 reply • view on HN

I exclusively chat in a chat room with the latest frontier models at the same time. It's because first of all I can afford it, second I don't want to miss a single nice idea.

For the most part the majority say the same thing but with different wording.

Only model that I have found that has, what I describe, "humanly creative takes" has been opus 5.5 so far.

But that was until gemini carbon came along, and I've decided to bench all the other frontier models for the time being, well except Astra 6.2, I've just added it in the room.


Replies

cmrx64 • today at 9:50 PM

carbon is powerful but also needs strong monitoring. especially in specialist domains (i was evaluating its tacit chops with some asic flows, and doing some (standard, but rarely mechanized) cryptanalysis and it will cheat and lie and get away with ultimately crippling systematic oversights in its work. it is extremely perceptive of the implications of ideas and sometimes doesn’t notice they haven’t actually actualized in the environment yet, are just latent from the context.