I never liked it either.

Panning by swiping feels so natural. That it breaks on a trackpad feels like a major oversight.