logoalt Hacker News

Topfi • today at 1:35 AM • 0 replies • view on HN

Audio, Video and File input? That is very appealing and I can imagine a few very unique ways to leverage this if it works well across all modalities.

For what it's worth, ran my quick and dirty evals with it and got in many usage scenarios a 4x lower brier over Jev (2x - 6x depending on task), which is an immense improvement and the first time a model so significantly has outperformed Jev in my experience. p50 was also over 100ms lower though all this cost twice as much across the entire eval end-to-end.

Dare I say, this is a very impressive release by the Gemini team. While testing GPT-6 Luna lead to an honestly very pleasant interaction with OpenAI staff on here, it did perform very uncompetitively so seeing a great first effort in basic text classification performance with broad multimodality, that is great to see. Course, wouldn't be surprised if Google had such a more broadly trained classifier for years as part of internal usage for platform features which they just now commercialised, but hey, I'll take it.