You could lightly sand it before using it as mold, would lessen that issue.
Or a little bit of alcohol vapor smoothing if you print the mold with ASA
Or a little bit of alcohol vapor smoothing if you print the mold with ASA