I have experienced similar degradation with vectors at scale.