Actually, I would like it if it started its answers with “IIRC…”. That way, it wouldn’t sound so sure of itself when hallucinating, and I’d feel like I could gently correct it by telling it that it might be misremembering. Either way, it’s more accurate to think of an AI as trying to remember from all that it’s been taught than for it to come across as if it knows the correct answer.
Actually, I would like it if it started its answers with “IIRC…”. That way, it wouldn’t sound so sure of itself when hallucinating, and I’d feel like I could gently correct it by telling it that it might be misremembering. Either way, it’s more accurate to think of an AI as trying to remember from all that it’s been taught than for it to come across as if it knows the correct answer.