Where I am it's often not warm and dry enough through summer for chillies and tomatoes. If there are a few cooler, wetter weeks then they do poorly.
Potatoes are a bit better in that respect.
But in poor weather conditions, blight can easily set in on the potatoes and tomatoes. Which makes it a lot less worthwhile.