> a GPU which costs as much as a car must read its entire VRAM just to output a word sounds incredibly wasteful

Kind of how I feel about Bitcoin at this point. The coins take so incredibly long to mine if you aren't in a pool that it could cost hundreds of dollars in electricity to own a fraction of the coin months later.