People aren't allowed to enjoy something because other people don't enjoy it? Other people are experiencing something they didn't choose, so nobody should be allowed to choose it?
I think they're suggesting that those who romanticize it actually just have never truly experienced it, and will not appreciate it if they do.
Whoever can enjoy what ever. There is some danger in romanticize things. Romanticizing shows the good in something but leaves out the difficulties. Some may very well enjoy an extremely remote and isolated lifestyle but it is not a Disney cruise of Hollywood movie.