Seems like GPUs and RAM/NAND are the problem, and that's a common problem for arm64 and x86
my Arm/Android set-top box of choice for, ahem, streaming subscriptions, is up 50% in price despite no changes to the design since I bought it 2 years ago. And that's on aliexpress where margins are limited.
I don't know the hardware inside the data center, and it might not be a "AI" data center to begin with. NAND is a big problem, but DDR4 memory is not AFAICS, and if you need CPU power for serving stuff, getting it is easy.
If you need high performance or AI operations... GLHF!