alt Hacker NewsSo what are some use cases people have found for running these sized multimodals on their device? What is it accurate on, and what is the hallucination rate like?
So what are some use cases people have found for running these sized multimodals on their device? What is it accurate on, and what is the hallucination rate like?
The main one is mapping images to text and visa versa, e.g. semantic search of images via text, where the images are encoded and the text question is encoded with the same model, then finding nearest neighbors.