I've been using windowed multi-tasking environments since 1986. Never been a problem for me (SunOS -> Solaris -> Linux). I rely very, very, very much on focus-follows-mouse.