The tension between an energy-efficient building and a well-ventilated one is real, but energy-recovery ventilation (ERV or HRV) is a thing and apparently works pretty well. Some kinds use counter-flow heat exchangers, some use an oscillating flow over a thermal mass (sometimes also a sorbent to keep moisture in or out).