Why the few closed-source components on the system? You mention the bus, USB PHY etc -- are those things harder to design than the CPU core?
They are likely licensed IP.
They are likely licensed IP.