No, memory is not limited to facts. There's just no visualization to go along with the recollection of faces etc. You can absolutely still recognize people correctly when looking at them.