Sure, there are some people with specific intellectual disabilities, brain injuries and the like.

But beyond that it gets woolly - how do you separate aptitude, interest, effort, and opportunity? And even if it were possible, would the work needed to identify a (presumably small) set of 'truly stupid' people really be worth the effort?