In x86 that would be the SIMD rsqrtps [0]. So absolutely possible to do at the hardware level.
[0] https://www.felixcloutier.com/x86/rsqrtps