logoalt Hacker News

jiehongtoday at 12:49 PM4 repliesview on HN

Sounds nice!

But, the web ui chat version of flash has very poor language following abilities in my experience:

You may ask it something in English, and get a thinking chain in Chinese with an answer in Chinese, or an English thinking chain and an English answer. Using the retry button on the same question has a 50/50 chance of any of those results.

Sometimes, asking something in English, but where information are mostly in another language may make the answer in the language where data has been found. The other day, I asked something about a local German thing, in English, and I got an answer in German instead. It’s as if all the language data stirred it away from the language of the user’s question.


Replies

apexalphatoday at 1:10 PM

I have the same issue, sometimes.

I initially thought it was a trick, that using Chinese chars is somehow more info dense and it saves tokens to 'think' in Chinese.

But later on it became more erratic. I still wonder if token reduction would work that way.

el_iotoday at 12:58 PM

I'm also totally not sure why it do that, but I guess because they're searching from China and web results comeback in Chinese so the model start using that.

swiftcodertoday at 12:51 PM

I've hit this too, but you can just add "in English" to steer it

epolanskitoday at 12:59 PM

I've occasionally got chinese characters in anthropic/openai's responses too, locally on codex/claude.

Hasn't happened in a while, last time was when I was testing fable 5 in june.

show 1 reply