alt Hacker NewsOne skill that I still possess and that LLMs haven't been able to replace (yet) is to ask good questions, for example:
- Rephrasing the original question to validate my understanding - Asking "why" a sufficient amount of times until I understand where the other party is coming from - Asking open questions aimed at generating insights
et cetera.
Instead, LLMs (often badly) guess what the background of the question may be, answer with that in mind and find it very difficult to let go of what they have made up.
Asking non-leading questions is a skill. Sometimes I feel the urge to mention something to AI (in a question or in passing), but I stop myself because I know it will stick to that thing and become dumber because of it.
I usually don't want AI to ask me questions. I want it to guess the things I didn't specify, because if I wanted to specify them, I would. Sometimes I even tell it directly to not ask me any questions and assume reasonable choices for underspecified things. But when I do want it to ask clarifying questions I just ask it to do that. And it does. If you prefer that style, you might put it in a prompt. Or use a flexible coding harness like pi and ask it to create a skill or extension that will help you push it in that inquisitive direction easily or automatically.