For food in addition to the false advertising it's just going to be the uncanny valley: there's thousands of years of evolutionary motivation to try and assess if food is safe. Any amount of "wrongness" will put people right off.
There's some hot take incoming about highly processed foods, but the reality is that's still designed and made by humans, for humans, and so passes all those initial hurdles like "is this poison or a trap?"
An image model doesn't even have that grounding.