Regardless of how you think about LLMs (I do find them useful), there’s something really odd to think that you can select for “proven experience” in a young technology where current experience appears to have little to do with experience 15 months ago, and where the biggest boosters fully claim it will have nothing to do with experience in 15 months.

What you’re selecting for is enthusiasm, knowing the current shibboleths of the in-group, and possibly for who knows how to use them to make a good demo.

And, fair enough, if that's what you want. But it's not "proven experience" in my mind.