Not that far away, you can run a useful model on flagship phones today, something around GPT 3.5's level.

So we're probably only a few years out from today's SOTA models on our phones.