If an observer cannot distinguish between an illusion and reality, it becomes their reality, not necessarily the reality or those of others who can.
It becomes a problem when sufficient number of people suffer from this, or those in important decision making places.
What is the reality other than just an agreed upon collection of individual realities?