logoalt Hacker News

bee_ridertoday at 3:49 PM1 replyview on HN

Mistral displays some “thinking” text (in their basic online chat interface) in the thinking mode, do we know if those are the real tokens?

It’s quite interesting to read. I can’t imagine using a model like this without the ability to peek inside and see if it is getting stuck.


Replies

transcriptasetoday at 4:46 PM

I wonder if they put all 80k tokens of the GDPR in its system prompt.

show 1 reply