• @[email protected]
    link
    fedilink
    English
    71 month ago

    You may be misunderstanding the bit measure here. It’s not ten bits of information, basically a single byte. It’s ten binary yes/no decisions to equal the evaluation of 1024 distinct possibilities.

    The measure comes from information theory but it is easy to confuse it with other uses of ‘bits’.

    • @Buffalox
      link
      English
      31 month ago

      What? This is the perfectly normal meaning of bits. 2^10 = 1024.

      • @[email protected]
        link
        fedilink
        English
        71 month ago

        Only when you are framing it in terms of information entropy. I think many of those misunderstanding the study are thinking of bits as part of a standard byte. It’s a subtle distinction but that’s where I think the disconnect is

        • @Buffalox
          link
          English
          2
          edit-2
          1 month ago

          Yes, the study is probably fine, it’s the article that fails to clarify before using it, that they are not talking about bits the way bits are normally understood.

      • @credo
        link
        English
        3
        edit-2
        1 month ago

        I think we understand a computer can read this text far faster than any of us. That is not the same as conscious thought though- it’s simply following an algorithm of yes/no decisions.

        I’m not arguing with anything here, just pointing out the difference in what CPUs do and what human brains do.

        • @Buffalox
          link
          English
          -11 month ago

          a computer can read this text far faster than any of us.

          I think you missed the comprehend part.

          • @credo
            link
            English
            -3
            edit-2
            1 month ago

            No i didn’t. Feed a book into chat GPT. You will see what fast comprehension is. I think you missed the consciousness part.

            Stop being an ass.

            Edit: The average person knows approximately 15-20,000 words. This is between 14 and 15 bits minimum to address every word independently. But I’m no brainologist, and I don’t know that’s how processing speech actually works. This is all just for comparison to bitwise operations.

            • @[email protected]
              link
              fedilink
              English
              01 month ago

              comprehension - the action or capability of understanding something.

              LLMs don’t understand anything they read.