(1) is certainly correct, they're poorly understood when it comes to interactions and they almost never have much clinical evidence for claims (thus they say "support"). There are also heavy metal contaminants in all sorts of things, certainly stuff bad for babies.
Just to make clear that while (2) is at least an exaggeration unless you really stretch the issues with GRAS components not being adequately safety tested, it's certainly true that evidence of benefit is thin.
Personally I'd love to see the FDA actually regulate supplements, including actually testing additives for safety rather than falling back on GRAS sketchiness.
But we can't even test food for parasites and bacteria so I guess it falls to the consumer to somehow get enough information to make an informed decision.