That’s because standard RGB is linear while human perception is closer to logarithmic.

Because there are so many off white colors in wall paint.

You mean all the low-saturation colors you see around the diagonal?

Vagaries of monitor technology and a lack of calibration/the difficulty of calibrating for lighter colours.