The idea that slavery is a free lunch that is only banned on moral grounds is wrong.

Slavery is bad economics. If you want your economy to grow, paying workers is not bad. Economic growth isn't zero sum.