Not being from Toronto, never in a million years would I even think of that as a visitor.
How many visitors do you think would go to a restaurant intending to order a (hamburger) beef patty? The potential for confusion is overstated.
Sorry, but you're just uncultured if you don't know what Jamaican patties are.
This is like saying "never in a million years would I think 'butter chicken' is a red, spicy Indian curry instead of chicken roasted in butter".
I grew up in another country where Jamaican patties were popular and ordering a 'beef patty' would never get you a burger patty unless you were in a burger joint. Same as in Toronto; asking for patty (or beef patty) will 99% of the time get you a Jamaican patty.