> No, it really is. I can just as easily say that a system is simpler when it's composite parts are isolated

No, a system can not be simpler because you moved A' to B and introduced C (complexity - an added network, gateway, communication layer) for no reason besides to make the entire system simpler.

It is not simpler! You did nothing besides introduce C (complexity)!