> But I guess it's about why so we associate those with spiky shapes, though surely it's because they represent sharp immediate changes in frequency?

Sure, but it's a very abstract connection between objects being sharp in vision and frequencies changing sharply in hearing. There's no guarantee any given organism would make the connection.