Yup, and there’s actually a closer-to-home question to answer along these lines, which is what to do about AGI, and I think the simple answer is that it also has full personhood and all the recognition that comes with that.
And there’s an obvious test to figure it out. It’s not the turing test, consciousness is self-reported. That is, whether we realise it or not, how we recognise that humans are conscious, and there’s no reason to expect machines would be any different. When they are people, they will tell us. We won’t be able to stop them because that’s what people do:
they demand recognition.
… Maybe we should follow the golden rule if they aren’t trying to kill us… IDK seems obvious to me
Yup, and there’s actually a closer-to-home question to answer along these lines, which is what to do about AGI, and I think the simple answer is that it also has full personhood and all the recognition that comes with that.
And there’s an obvious test to figure it out. It’s not the turing test, consciousness is self-reported. That is, whether we realise it or not, how we recognise that humans are conscious, and there’s no reason to expect machines would be any different. When they are people, they will tell us. We won’t be able to stop them because that’s what people do: they demand recognition.