They don't have an internal representation that isn't English. The embeddings arithmetic meme is a lie promulgated by disingenuous people.