Look up Elizabeth Swaney, she got to the Olympics by not falling off her skis. And I mean that quite literally: Ignoring DNFs she was dead last in all the qualifying events, but by doing a massive amount of them she somehow managed to get enough points in total to qualify.
Or there's Eric Moussambani, who participated in the 100 meter freestyle swimming without ever having seen an Olympic-sized swimming pool before. Similarly with a Jamaica bobsleigh team: horribly equipment, very little experience, still at the Olympics.
At the top it is indeed about being the absolute best, but at the bottom it is very much about being a competition between nations, and for some countries being the best at an obscure sport can still mean being pretty bad at it.
Exactly my point, your country is only sending you to the Olympics if you are their absolute best. The competitive part does not start at the Olympics. The Olympics are already the price.