Its only a problem for online shopping. In store you can simply grab multiple sizes and see which one fits best. Many online stores try to give multiple measurements of the clothes but even then it's extremely difficult to predict how it will look on you.

Online shoppers seem to solve this issue by just buying multiple items and returning the ones that don't fit. After which the retailer throws these returns in the bin.