If you produce them verbatim or in significant enough portions, yes.

> I'm trained on protected works.

That someone, at some point, paid for.

I'd like to understand why I can't use a song in one of my videos without permission/payment, but an AI company can train models using that song without having either.

I'm not anti-AI. I'd just like to see companies play by the rules everyone else has to follow.