Could windows be using binaries optimised for that specific processor? "Simply" running apt-build world would possibly fix it if that's the case.