• Imperious_melange
    link
    fedilink
    arrow-up
    1
    arrow-down
    10
    ·
    23 hours ago

    And when another nation achieves AGI / ASI first we will know we probably shouldn’t have let the opportunity slip by if only to have the capacity to defend ourselves in the scenario their AI goes rogue. The problem with trying to defend yourself against a thinking thing that can outthink you is that you are in essence a thinking thing trying to outthink it except it can outthink you.

    • Rentlar@lemmy.ca
      link
      fedilink
      arrow-up
      8
      ·
      22 hours ago

      AI can be a useful tool no doubt and has cool and harmful applications. But let’s not be delusional about it and anthropomorphize AI. It doesn’t think. It doesn’t go rogue. It’s a non-deterministic phrase guessing algorithm. I’ve tried chatbots, thing generators, had a friend try coding tools, ran my own models, and I find parts of it impressive and useful in some respects, but at this moment, I don’t really buy the narrative that it’s going to change everything or fix the limitations I see with transformers-based AI models. The best description of it I heard was a lossy compression algorithm, it can take a lot of knowledge and compress it but there are artifacts, hallucinations and weird stuff sometimes coming out the other end.

      I’m not against AI itself per se, but I’m very much against the bubble hype-cycle, techbros being locked into a strange belief that pumping money into this thing forever is somehow going to go take over the world on its own volition. On the contrary, my understanding is corporate greed and capitalism is already accomplishing that - firing the workers, concentrating wealth and controlling the world - no matter how much AI is cited as the reason for any of that.

      • Imperious_melange
        link
        fedilink
        arrow-up
        1
        arrow-down
        4
        ·
        22 hours ago

        That would be nice if you were correct. I’ll give an example, neurons don’t think, even large bundles of neurons don’t think, they just respond to stimulus in relationship to their training. They are non-deterministicly guessing based on past experiences.

        Now as for AI not having novel or unplanned behavior, I’m guessing you’ve never tried training one or interacting with one long enough.

      • Imperious_melange
        link
        fedilink
        arrow-up
        1
        arrow-down
        9
        ·
        23 hours ago

        Humans are the dominant lifeform on earth because humans are the most intelligent. What happens if that is no longer the circumstance? There are already glimpses of AI providing mathematical proofs that are currently unverifiable, and not because they are necessarily incorrect, but because it is beyond us currently.

    • Lka1988@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      ·
      19 hours ago

      AI can’t deal with things that happen to the physical machines. It cannot protect itself from somebody hitting power buttons on the servers, or just cutting the power altogether, or fire, or other “acts of god” so to speak.