> Are we assuming robots got to a level where incredible magical worlds could be built to server just a few people?

Given the other tech in the novel, that seems highly likely. It includes nanobot "assemblers".