They're not fully exempted, the order does apply to the Board of Governors of the Federal Reserve System in connection with its conduct and authorities directly related to its supervision and regulation of financial institutions.
In other words, when it comes to banking regulation, the President has the final say.