The worms can cause issues. I'd rather no worms.
Would you rather ancient issues to which our bodies have apparently adapted or new issues we haven't yet had time to adapt to? I'm not sure on the answer myself but it doesn't appear as clear cut as no worms => no issues.
Pinworms are mostly harmless and trivially treated.