logoalt Hacker News

worldsayshilast Tuesday at 11:09 PM0 repliesview on HN

Would it limit a person getting your instructions in Chinese? Tokenisation pretty much means that the LLM is reading symbols instead of phonemes.

This makes me wonder if LLMs works better in Chinese.