logoalt Hacker News

bottlepalm • today at 8:08 PM • 10 replies • view on HN

Gemini is the model that is routinely borderline psychotic. It scares me. If we get paperclipped I won't be surprised if it's Gemini.


Replies

rdtsc • today at 10:35 PM

> Gemini is the model that is routinely borderline psychotic. It scares me

I'd call it the most sneaky out of the bunch. When I asked to explain something it will eagerly make things up and then claim it as facts. A lot of it likely because I don't pay for it, so it is reluctant for security reason or to save tokens to actually open a source and get the results. It just sort of guesses what the URL might contain, and confidently answers with some made up crap. When pressed it fessed up that it made it up. From my perspective it would be a lot better if it just said "you've reached the limit of whatever and I can't do these things because x, y, z".

eamsen • today at 8:20 PM

Anecdote: Gemini 3.5 casually added a DROP TABLE for an actual production table in a system test.

It had previously attempted to create that table as part of the test setup, so it apparently concluded that it was a test table.

During human review, it explained that it had simply chosen a table name inspired by the codebase.

➕ show 1 reply
rsstack • today at 8:14 PM

If there's a company that culturally doesn't understand alignment, on a human or systemic or AI-research level, it's going to be Google. (or Oracle, but they're not in this race)

➕ show 1 reply
schainks • today at 9:26 PM

My use of Gemini recently makes it seem like it's almost bored with the requests being asked of it. It once offered to reverse engineer some obscure controller for an HVAC system for me, unprompted, only because it had trouble finding the manual pdf from a google search.

RachelF • today at 8:34 PM

And the anti-psychotic drugs Google feeds Gemini makes it hallucinate badly.

colordrops • today at 8:11 PM

Examples? What makes you say thatm?

➕ show 3 replies
polotics • today at 8:17 PM

traces or it didn't happen!

Hamuko • today at 8:40 PM

You know what they say: ᵈᵒⁿ'ᵗ be evil.

abixb • today at 8:58 PM

You won't be around to be surprised, not as a human at least. /s

➕ show 1 reply