It does diddly squat in addressing the ‘confidently incorrect’ hallucination / Bullshit-generator problem fundamental to LLMs
Eh, I can see some potential relevance. If an AI starts by dividing objects into “pointy things” and “round things” where a human would divide them into “animals” and “artifacts”, the AI would be more likely to mistake a cat for a car where a human would mistake a cat for a dog. Neither mistake is objectively worse than the other; but to a human, the former is a bizarre hallucination while the latter is an excusable misperception.
Eh, I can see some potential relevance. If an AI starts by dividing objects into “pointy things” and “round things” where a human would divide them into “animals” and “artifacts”, the AI would be more likely to mistake a cat for a car where a human would mistake a cat for a dog. Neither mistake is objectively worse than the other; but to a human, the former is a bizarre hallucination while the latter is an excusable misperception.