Swiss can have their policy, who said they can't have it? It's just that they can't make EU have the Swiss policy. If Switzerland wants to be a 3rd party country, they can do that and negotiate visa regime, import/export controls etc with EU like everyone else who is not part of EU or don't have a deal. They can be like UK or Turkey for example, or be have entirely different relationship.
Swiss can never be like the UK or Turkey if it reneges on the deal it has now. The other two have leverage, Swiss do not.