> But shouldn’t search be responsible for reducing or at least ranking the results in such a way that no matter how many results you find what you are looking for in the top N?

Maybe if you are Google, having well paid teams and excessive data on what people with your profile are usually searching at the moment. Obsidian is lacking all this, so the search-quality is very depending on the amount of files and results.