Astute observation; no canal, but there is a river outflow to a bay, whereby a ship could have carried stones from the quarry, albeit a long way around a peninsula; it is possible that was a more effective way to get them close, and then use horse and cart to get them the last bit of distance.

Thinking about the logistics of such a feat at that time is wild to me for just the construction of a private residence.