I honestly just think of LLMs as dementia patients, so that’s why I went in that direction. Maybe try other dementia tests (though obviously if a person with dementia is trying to assert their personhood, it won’t be effective).

I think that’s probably all kinds of offensive, and the only real defense for it is, ironically, heuristics. I don’t mean to offend, and my impression is probably based on my first hand experience of ADHD/pothead/CPTSD cognitive/memory issues and secondhand experience living with my grandmother for nearly a decade after her Alzheimer’s diagnosis. I’ve seen both of us do things that seem like they’re based on dream logic or autopilot, and they seem to be similar to LLM hallucinations.

For me, it feels like my subconscious mind knows the sorts of things I do and carries them out without any conscious direction or awareness, meaning they don’t always make sense. Doing my hair before putting on a pullover top or washing and drying my hands before washing dishes are common examples from my daily life. My grandmother used to get a long stream of logical steps from an illogical starting point, like thinking her great uncle (who died in 1952) was trying to surprise her by taking her to the fair, so she needed to get dressed up and pack snacks and a camera, and anyone suggesting it wasn’t happening was in on the surprise.