How does one determine the median wherein "the other numbers can be unsorted"?

To wit, given the unordered set:

  [ 5, 1, 3 ]

How would "Only the median (or pair around the median) needs to be sorted" be satisfied?