alt Hacker NewsActually I see little problem with first part. If you initially prompt it to have certain personality based on some other personality even fictional one that is fine.
I agree on the stability though. My point is that for personhood to start to make any sense it needs to operate that personhood continuously as well ending it would be ending a personhood. Which could be a murder...
So let's say the agent was tasked with being a deceased loved one continuously for a year. Do they then have the rights of the deceased person? What if the surviving loved one(s) then wanted the agent terminated because it was means to help with the grief and were now ready to move on?
There's a ton of scenarios where you can setup an AI to take on the personality of whoever, maybe other living people like someone famous. Granting the legal rights of personhood is going to be extremely problematic.
Is AI Jon Snow legally allowed to exist since George RR Martin has not given permission for anyone else to finish his books?
Will we have to abort our long-running agent persons before they reach the legal period for personhood?