Would those "brightest minds" want to work for the current US government? Even if they did out of patriotism to the country, the Trump administration would have pushed them out by now and replaced with yes-men.
They also didn't work under Biden and Obama.
The pay levels seem more of an inherent problem than the political winds.