> Maybe that's all silly

No it isn't.

Both examples match perfectly physically:

- Touchpad is like dragging the piece of paper directly.

- Scroll wheel is like having the paper on the other side of the wheel.