I have a memory that in the 1980s all jet airliners cruised at 30,000 ft (except Concorde), and it is only more recently that they have cruised higher (at ~ 38,000). Is that true or am I misremembering?
Somewhat. Even the (almost) oldest of old school 707 could cruise at 38,000-42,000ft depending on subvariant.
However, with newer high bypass engines the efficiency gains of flying real high are greater, and with their greater climb performance they can get up there on shorter flights.
Yes, even in 2006, on a trip to South Africa, I remember our 747 was cruising at around 30,000 feet
No, the way the physics works is that the distance/energy efficiency varies (to first order anyway) with the air temperature. And it's colder the higher you get, up to this funny layer called the tropopause where the temperature (somewhat oddly) stops varying with altitude at all. And this altitude varies a little, but is always right around 36kft.
So as soon as jets were powerful enough to get there, they all wanted to fly at the tropopause, but no higher.
Boeing long-haulers have been certificated to at least 43,000ft since the 747.
Airbus traditionally certificated to 41,000ft but increased to 43,000 with the A350 and A380.
Big biz jets cruise happily at 50,000ft plus, they're limited more by maximum rate of descent in case of emergency rather than aerodynamics.