alt Hacker News.. which confirms all of my stereotypes. Looks like the AWS engineer who reported it used a m8g.24xlarge instance with 384 GB of RAM, but somehow didn't know or care to enable huge pages. And once enabling them, the performance regression disappears.
Because such settings aren’t obvious to those not familiar with them. LLMs should make discoverability easier though