logoalt Hacker News

edude03yesterday at 8:45 PM1 replyview on HN

Googles machine translation team wrote the Attention is all you need paper that introduced transformers specifically to solve the problem that you can just model language by mapping one word to another. I'd be floored if they weren't using the tech they invented for intended purpose


Replies

numpad0today at 3:53 AM

Yeah. LLMs, machine translations, CJK keyboards, they are all the same technology; faster cars to each others, not cars vs horse drawn carriages. It'll be surprising if they didn't directly apply any applicable learnings back to Google Translate.