2006's NSA is not 2026's NSA
it is easy to point to ghosts in the corner. Random fearmongering is not a technical argument though. There have been no technical arguments to justify the random fearmongering. Pointing to prior behavior in a way that is inconsistent with the current situation is especially annoying fearmongering.
The NSA isn't DJB's oppositiom here. It's the majority of the international community of cryptography experts.