False advertising does not have first amendment protection, surely. And requiring potentially misleading AI images to be labelled surely doesn’t infringe.

I am not a lawyer, but this seems unlikely. Federal law prohibits "false advertisement" which is understood to include misleading advertisements. Regulators can and do restrict certain types of commercial speech, and this kind of restriction has survived First Amendment challenge.

[dead]