I don't know. I know I used to be pretty AI sceptic, until they became good enough to help with non trivial code problems on their own.

I strongly suspect, that we will come to a point, where it gets impossible to tell if something is AGI and consciouss or not.

History shows continuous evolution, there won't be a "final AGI thing". The definition of AGI is so vague anyways that any conversation around it is hardly useful. 5 years ago, what we have today would have been considered AGI.

Perhaps Douglas-Adamsesque the LLMs will specify the AGI.