> They can't deny based on who or what the business is alone

They absolutely can and do this. Ask to put an adult entertainment store next to a school/church. Ask to put a liquor store next to a school/church. The city will say no.