I mean that's basically what all these image search indexes do. They look at an image and add a bunch of tags for whatever they see in the photo that can be queried later. It works really well and armed with one of these models and word2vec you can build your own search quite easily.

tensorflow object detection is one such means. Hosted solutions would be Amazon Rekognition.