Apparently one goal that hasn't been met is being able to correctly determine whether a hn post is setting a challenge for AI. One of the ones I saw was reproducing a Harry Potter book verbatim, where the desired behaviour is actually to not be able do that.

My "goalpost", unmoved for decades and with nowhere to move it to, was always to independently and repeatedly make contributions to research maths. That one has now been met. That doesn't mean I suddenly think LLMs think like humans (or at all), that their way of doing maths is equivalent to or a replacement for the human one, that they are conscious, that their differences vs humans don't matter, that there will be a singularity or anything else, but it does mean I no longer have a specific, well defined "task" that I don't think they'll ever be able to do.