Yes, and unlike NixOS they dont calculate build hashes for the sake of making binary caches. So truly, you have to build from source, even if your recipe is exactly the same as everyone else's. I've never really understood this zealotry around compiling things myself, and boy are there some big (slow to compile) programs out there these days.
For one thing you can, in theory, optimise for the CPU you have instead of some generic target that has to run acceptably everywhere.
[dead]
There are binary packages in gentoo, but you can't take advantage of USE flags.