Being an intelligent being is not the same as being considered intelligent relative to the rest of your species. I think we’re just looking to create an intelligence, meaning, having the attributes that make a being intelligent, which mostly are the ability to reason and learn. I think the being might take over from there no?
With humans, the speed and ease with which we learn and reason is capped. I think a very dumb intelligence with stay dumb for not very long because every resource will be spent in making it smarter.
Why would the dumb intelligence be less constrained than a human in making itself smarter?
> every resource will be spent in making it smarter
The root motivation on which every resource will be spent is simply and very obviously to make a profit.