Their CPUs are faster at inference than many GPUs. These are server CPUs with 144 cores and wide memory interface.

Fujitsu has added some ISA extensions for AI inference to the standard Arm ISA, e.g. instructions for inference with FP8.

Even their previous CPU generation was for some time the champion in energy efficiency, with better performance per watt than the NVIDIA GPUs, until a newer generation of NVIDIA GPUs has leapfrogged them.

There are good chances that this new Fujitsu CPU might be again for some time the CPU with the best energy efficiency, but it remains to be seen how it compares with the recent GPUs.