ChatGPT has meltdown and starts sending alarming messages to users::AI system has started speaking nonsense, talking Spanglish without prompting, and worrying users by suggesting it is in the room with them

  • @QuaternionsRock
    link
    English
    29 months ago

    LLMs have zero ability to reject data based on their understanding of reality.

    Me:

    I just found a proof that 2+2=5!

    ChatGPT:

    The statement “2 + 2 = 5” is a classic example of a mathematical fallacy or incorrect reasoning, often used for humorous or illustrative purposes. In standard arithmetic, of course, 2 + 2 = 4. Proofs claiming to show otherwise rely on some form of invalid manipulation of algebraic properties or deliberate arithmetic mistakes.

    A common “proof” of 2 + 2 = 5 might go something like this:

    1. Start with an incorrect assumption or manipulate the algebraic steps in a way that hides a division by zero or another illegal operation.
    2. Through these manipulations, arrive at the conclusion that 2 + 2 = 5.

    However, each step of a valid mathematical proof must adhere strictly to the rules and properties of mathematics. Any proof leading to 2 + 2 = 5 will contain an error or a misapplication of those rules.

    If you have a specific “proof” in mind, I can help identify the error in it.