Maybe just a very rigorous version of the Turing test? Modern LLMs can superficially simulate conversation but it's trivial to force them into revealing their non-human like intelligence.

They've been "patched" since but all models fail basic tests like "Should I walk or drive to the car wash which is 100 feet away" by recommending you walk.

So you'd just ask questions that require theory of mind, abstract and common sense reasoning, causal inference, learning novel rules, transferring knowledge novel situations, recognizing ambiguity, etc.

To answer for OP:

We are now calling text and image generators "intelligent" in the same way a spell checker is intelligent.

Whatever it's become, "AI" research started as a way to study digital neurology, or how to digitize a mind, not just how to generate data.

The Turing Test should have had a caveat, it needs to fool a, "non-stupid" person, and we still have not gotten even close to passing that version.

Not OP, but I'd settle for something that actually learns, instead of being a static pile of linear algebra. Pretending it learns because you change the input (context) doesn't count.

strawberry

Can it produce a chart topping album if its given all the tools and the prompt "produce chart topping album" .

you might say almost no humans can do tht either but some human can but no ai can.