Maybe it's because of logistics. At least from an European point of view.
All of those you mentioned can be grown in Europe, except bananas that are shipped from South America and arrive in good condition despite the long travel. Many other tropical fruits may be too fragile or expensive to transport at scale.
I remember reading an article about banana import and it's a surprisingly complex process involving a lot of R&D to get to where we are today.