My understanding is that nix-direnv caches the environment, so after you first evaluate it, it’s pretty much instant.

I haven’t timed it, but it’s not perceptible imo.