In my youth I experimented with hallucinogenic drugs. Having shared hallucinations are very easy. It often just requires that someone give you an idea of a hallucination, or someone tells you what they see, and your brain will make you see it as well.

Maybe people know these things make you see small people, and then they are primed to do so.