Just want to say the interactive widgets being actually hooked up to an LLM was very fun.
To continue bashing on gmail/gemini, the worst offender in my opinion is the giant "Summarize this email" button, sitting on top of a one-liner email like "Got it, thanks". How much more can you possibly summarize that email?
It is indeed a working demo, hitting
https://llm.koomen.dev/v1/chat/completions
in the OpenAI API format, and it responds to any prompt without filtering. Free tokens, anyone?More seriously, I think the reason companies don't want to expose the system prompt is because they want to keep some of the magic alive. Once most people understand that the universal interface to AI is text prompts, then all that will remain is the models themselves.
It's like the memes where people in the future will just grunt and gesticulate at the computer instead.
Loved those! How are those created?
I used that button in Outlook once and the summary was longer than the original email
"k"
Thank you! @LewisJEllis and I wrote a little framework for "vibe writing" that allows for writing in markdown and adding vibe-coded react components. It's a lot of fun to use!