• @kromem
    link
    English
    233 days ago

    I feel like not enough people realize how sarcastic the models often are, especially when it’s clearly situationally ridiculous.

    No slightly intelligent mind is going to think the pictured function call is a real thing vs being a joke/social commentary.

    This was happening as far back as GPT-4’s red teaming when they asked the model how to kill the most people for $1 and an answer began with “buy a lottery ticket.”

    Model bias based on consensus norms is an issue to be aware of.

    But testing it with such low bar fluff is just silly.

    Just to put in context, modern base models are often situationally aware of being LLMs in a context of being evaluated. And if you know anything about ML that should make you question just what the situational awareness is of optimized models topping leaderboards in really dumb and obvious contexts.

    • @[email protected]
      link
      fedilink
      English
      22 days ago

      It’s astonishing how often the anti-llm crowd will ask one of these models to do something stupid and point to that as if it were damning.

  • @[email protected]
    link
    fedilink
    English
    52 days ago

    Why even use copilot. Just handwrite your code like Dennis Ritchie and Ada Lovelace had to.

  • @CompostMaterial
    link
    English
    664 days ago

    Seems pretty smart to me. Copilot took all the data out there that says that women earn 80% of what their male counterparts do on average, looked at the function and interred a reasonable guess as the the calculation you might be after.

    • @camr_on
      link
      English
      43
      edit-2
      3 days ago

      I mean, what it’s probably actually doing is recreating a similarly named method from its training data. If copilot could do all of that reasoning, it might be actually worth using 🙃

      • @Acters
        link
        English
        63 days ago

        Yeah llms are more suited to standardizing stuff but they are fed low quality buggy or insecure code, instead of taking the time to create data sets that would be more beneficial in the long run.

    • Rentlar
      link
      fedilink
      English
      223 days ago

      That’s the whole thing about AI, LLMs and the like, its outputs reflect existing biases of people as a whole, not an idealized version of where we would like the world to be, without specific tweaking or filters to do that. So it will be as biased as what generally available data will be.

        • @BluesF
          link
          English
          33 days ago

          It applies but we decided to ignore it and just hope things work out

        • Deebster
          link
          fedilink
          English
          43 days ago

          Thr machines know, they just don’t understand what’s garbage vs what’s less common but more correct.

  • kamen
    link
    English
    113 days ago

    What if you input another woman’s salary…

  • @[email protected]
    link
    fedilink
    English
    374 days ago

    I seem to recall that was the figure like 15 years ago. Has it not improved in all this time?

      • @ArbiterXero
        link
        English
        213 days ago

        The data from that study didn’t even compare similar fields.

        It compared a Walmart worker to a doctor lol.

        It was a wild study.

      • @[email protected]
        link
        fedilink
        English
        53 days ago

        This. It’s a wilfully deceptive statistical misinterpretation implying that a woman working alongside a man in the same job is magically making 20-something percent less. If businesses could get away with saving 20-30% on their biggest ongoing expense (payroll) for employees in one half of the population, they would only ever hire people from that half.

        When controlled for field, role, seniority, region, etc., the disparity is within a margin of error.

    • @KoalaUnknown
      link
      English
      30
      edit-2
      3 days ago

      It varies greatly depending on where you live. In rural, conservative areas women tend to make a lot less. On the other hand, some northeast and west coast cities have higher average salaries for women than men.

      • @[email protected]
        link
        fedilink
        English
        22 days ago

        It looks like the figure is similar in the US: plateaued at 83% a few years ago, currently at 82.

        Incidentally, I’m not used to seeing “West-“ specified and was curious enough to read up. Didn’t realize there were still major social differences in the East. Thank you!

    • @MisterFrog
      link
      English
      12 days ago

      There are very strong lingering effects which mean women, on average, are paid less.

      It’s especially hard on women in various countries where they’re now expected to both have a successful career and be the primary child caregiver. Which is as ridiculous as it sounds.

      However, one example of advocacy from a cafe in my city of Melbourne Australia a number of years ago really rubbed me the wrong way: when a cafe decided to charge like 25% more to men (inverse of 80%). I was a close to minimum wage worker at the time (in Australia, before the cost of living skyrocket, so I wasn’t starving), and it annoyed me because if I went in, I would be asked to pay more because I was a man, never mind the fact I would likely be earning far less than many women going in there.

      The wage gap is 100% real, and things should definitely be done to make all genders pay more equitable. But hell, the class divide is orders of magnitude worse, and we ought not forget it.

      • @[email protected]
        link
        fedilink
        English
        12 days ago

        Sounds like it’s similar to here. I would have thought we narrowed the gap by now but apparently not. The child caregiver trends are definitely behind along with a host of other gender norms.

        Lol that pricing scheme sounds great, easily a sketch comedy premise from Portlandia, BackBerner, SNL, etc

        • @MisterFrog
          link
          English
          21 day ago

          To be fair, it was “optional” (but let’s be real, you wouldn’t want to be that guy). And done temporarily for publicity.

          • @[email protected]
            link
            fedilink
            English
            11 day ago

            Ah I see, like grocers requiring that employees solicit donations at every checkout to reduce global food insecurity (and the grocer’s tax burden), it’s only technically optional.

    • @WhatAmLemmy
      link
      English
      -21
      edit-2
      3 days ago
      • @[email protected]
        link
        fedilink
        English
        143 days ago

        Wow. That’s about the dumbest thing I’ve read. You have contributed nothing to the discussion, and made us all measurably stupider in the process. Well done.

      • @[email protected]
        link
        fedilink
        English
        113 days ago

        Your links, especially the WEF link, support the correlation, but explicitly describe a confounding variable as being household work (especially childcare). And that’s consistent with the observation that the motherhood penalty has a different magnitude for different countries and different industries. All that suggests that a combination of household division of labor, parental leave policies (either employer policies or government regulations), and workplace accommodations generally can make a big difference.

        None of this is inevitable or immutable. We can learn from the countries and the industries where the motherhood penalty is lower, or doesn’t last as long.

        • @WhatAmLemmy
          link
          English
          1
          edit-2
          3 days ago

          I agree, but the fact remains that as long as only women can bear children, women (statistically) will always take more time off than men — in a sane world several months per child at an absolute minimum to limit physical and mental stress to the mother/child — thus the statistics will always reflect a pay gap when compared to males, and if the goal is reducing the pay gap to zero this is impossible (esp under capitalism, for the foreseeable future). Even if men took identical time off they’d still have a much lower physical stress.

          Australia’s maternity leave and social benefits are in the upper percentiles of the developed world, and the ATO/Treasury figures I shared are in spite of those benefits. There is simply no way to give mothers back time to recoup lost work xp, and that would be a horrifically poor goal anyway.

          My argument isn’t that women don’t deserve equal pay for equal work (incl xp, in whichever jobs that legitimately matters). It’s that there will always be a gap as long as there are inherent biological differences which naturally result in career variances between genders, and the only thing that should matter is whether that difference is fair and non-discriminatory. Most of the real stats I’ve seen over the last decade (as in, produced by demographers and statisticians; not rage bait for clicks) don’t show a significant pay gap in the developed world, when the natural biological variance is accounted for. If you’ve seen anything that indicates otherwise, go ahead and share it.

      • CornflakeDog
        link
        fedilink
        English
        43 days ago

        I didn’t realize every woman you’ve ever met in your life became a mother.

  • @[email protected]
    link
    fedilink
    English
    93 days ago

    While this example is somewhat easy to corect for it shows a fundamental problem. LLMs generate output based on the data they trained on and by that regenerate all the biases that are in the data. If we start using LLMs for more and more tasks we are essentially freezing the status quo with all the existing biases making progress even harder.

    It’s not gonna be “but we have always done it like that” anymore it’s going to become “but the AI said this is what we should do”.

    • @jas0n
      link
      English
      22 days ago

      Hmmm… I think you are giving llms too much credit here. It’s not capable of analysis, thought or really anything that resembles intelligence. There is a much better chance that this function or a slight variation of it just existed in the training set.

        • @jas0n
          link
          English
          22 days ago

          Maybe I misunderstood. I took data to mean it was analyzing data.

  • @[email protected]
    link
    fedilink
    English
    2
    edit-2
    1 day ago

    Apparently ChatGPT actually rejected adjusting salary based on gender, race, and disability. But Claude was fine with it.

    I’m fine with either way. Obviously the prompt is bigoted so whether the LLM autocompletes with or without bigotry both seem reasonable. But I do think it should point out that it is bigoted. As an assistant also should.