• @[email protected]
    link
    fedilink
    English
    603 months ago

    But in a separate Fortune editorial from earlier this month, Stanford computer science professor and AI expert Fei-Fei Liargued that the “well-meaning” legislation will “have significant unintended consequences, not just for California but for the entire country.”

    The bill’s imposition of liability for the original developer of any modified model will “force developers to pull back and act defensively,” Li argued. This will limit the open-source sharing of AI weights and models, which will have a significant impact on academic research, she wrote.

    Holy shit this is a fucking terrible idea.

    • @[email protected]
      link
      fedilink
      English
      113 months ago

      I read that as “incentivizing keeping AI in labs and out of the hands of people who shouldn’t be using it”.

      That said, you’d think they would learn by now from Piracy: once it’s out there, it’s out there. Can’t put it back in the jar.

      • @[email protected]
        link
        fedilink
        English
        303 months ago

        They should be doing the exact opposite and making it incredibly difficult not to open source it. Major platforms open sourcing much of their systems is basically the only good part of the AI space.

        • @[email protected]
          link
          fedilink
          English
          102 months ago

          Also, they used our general knowledge and culture to train the damn things. They should be open sourced for that reason alone. Llms should be seen and treated like libraries, as collections of our common intellect, accessible by everyone.

      • @[email protected]
        link
        fedilink
        English
        143 months ago

        Not open-sourcing it is a terrible idea, it just creates more black boxes and gives corporations a further upper hand.

        • @JustAnotherKay
          link
          English
          -42 months ago

          Yeah what do I care if Jimmy down the street enjoys using his Ollama chatbot? I’m too busy worrying about Terminator panning out

    • @AbouBenAdhem
      link
      English
      23 months ago

      I haven’t yet read Li’s editorial, but I’m generally more inclined to trust her take on these issues than Hinton and Bengio’s.

    • @ZILtoid1991
      link
      English
      22 months ago

      Same energy as PirateSoftware’s “If AAA companies can’t kill games due to always online DRM then small indie devs have to support their games forever, thus bankrupting them” argument.

  • @Zarxrax
    link
    English
    333 months ago

    Wtf does a kill switch even mean? PCs have kill switches on them already, in the form of a power switch.

    • Echo Dot
      link
      fedilink
      English
      413 months ago

      I’m afraid the AI has become self-aware and put a piece of tape over the power switch it is now unstoppable.

    • Rentlar
      link
      fedilink
      English
      153 months ago

      The legislator tried pressing the button on the monitor but the computer kept whirring!!! It’s alive and has a mind of its own!!!

  • @[email protected]
    link
    fedilink
    English
    192 months ago

    IRL, arms manufacturers claim they’re not culpable when their products are used to blow up civilians. They point at the people making decisions to drop the bombs as the ones responsible, not them.

    This legislature tries to get ahead of that argument, by putting reponsibility for downstream harm on the manufacturers instead of their corporate or government customers. Even if the manufacturer moves their munitions plants elsewhere, they’re still responsible for the impact if it harms California residents. So the alternative isn’t to move your company out of state. It’s to stop offering your products in one of the largest economies in the world.

    The intent is to make manufacturers stop and put up more guardrails in place instead of blasting ahead, damn the consequences, then going, oops 🤷🏻‍♂️

    There will be intense lobbying with the Governor to get him to veto it. If it does get signed, it’ll be interesting to see if it has the intended effect.

      • @hate2bme
        link
        English
        32 months ago

        Have you ever seen Terminator?

  • Echo Dot
    link
    fedilink
    English
    133 months ago

    You would have assumed that legislators in California of all places would have access to experts that could explain to them why this won’t work.

  • @[email protected]
    link
    fedilink
    English
    82 months ago

    As we’ve previously explored in depth, SB-1047 asks AI model creators to implement a “kill switch” that can be activated if that model starts introducing “novel threats to public safety and security,”

    A model may only be one component of a larger system. Like, there may literally be no way to get unprocessed input through to the model. How can the model creator even do anything about that?

    • @[email protected]
      link
      fedilink
      English
      22 months ago

      It just says can be activated. Not “automatically activates”.

      Kill switches are overly dramatic silliness. Anything with a power button has a kill switch. It sounds impressive but it’s just theatre.

      • @WilderSeek
        link
        English
        22 months ago

        They’re safety washing. If AI has this much potential to be that dangerous, it never ever should have been released. There’s so much in-industry arguing, it’s concerning.