alt Hacker NewsBut you could still prompt it to act like any person, including fictional and deceased ones, which proves it has no real concept of self. It's just a language model for humans to generate whatever text meets the task. You could have it run for a year as different perspectives in GRR Martin's ASOIAF to finish his books for him. And then what, award it with Jon Snow's personhood?
An AI agent would need some kind of stable personality of it's own. Some sense of self outside whatever the hell people task it with for this to be meaningful. Data from Star Trek is a good fictional benchmark for that. Or Voyager's Holographic doctor.
Actually I see little problem with first part. If you initially prompt it to have certain personality based on some other personality even fictional one that is fine.
I agree on the stability though. My point is that for personhood to start to make any sense it needs to operate that personhood continuously as well ending it would be ending a personhood. Which could be a murder...