The Federalist Papers is not "the founders". It's Alexander Hamilton and James Madison. There were numerous factions running around the Constitutional Convention, and they negotiated the final document together.
I don't understand why the Federalist Papers gets cited as if it were part of the Constitution. It is not a definitive source of anything except the opinion of those two (three, with Jay) men.
The Federalist Papers reflects the views of the majority faction of those who wrote the constitution. You can get the minority opinion in the Anti-Federalist papers.
But find me any contemporaneous document that suggests the framers thought power should be exercise by unelected bureaucrats insulated from oversight by elected officials.