You’d be quite surprised, I think. Fine tuning a model on one axis can have drastic impacts on another that as a human we would expect to be completely unrelated.

Yet empirically it does

It's all a bunch of weights isn't it? Why wouldn't fiddling with some parts of the weights have cascading effects?