The bottleneck is not only the model latency, Although it would help.

When you compile an ios app, or wait for some query result, search slack or wait for Github CI to finish, it all introduces significant wait between agent turns.

Models getting faster would help but would not eliminate the problem.