What you're saying is probably correct for some percent of readers, but I'm not sure how big the effect actually is. Personally, I listen to books that I never would have sat down to read in the first place, and the time it takes up isn't competing with reading (doing chores, driving, etc.).