There's some variety of little people myth in most cultures. There's also giant myths in most and there's no mushroom for that.

I think those kinds of myths are just natural progressions of exaggerations and oral storytelling