• Flying Squid
    link
    1824 days ago

    I knew it! I’ve been saying that it is!

    And the AI algorithms they’re using in real estate are doing the exact same thing. Mark my words.

    • @[email protected]
      link
      fedilink
      English
      1124 days ago

      It’s just a method of shifting the blame And responsibility away from real people to try to avoid getting punished.

      • @[email protected]
        link
        fedilink
        423 days ago

        It’s just a method of shifting the blame And responsibility away from real people to try to avoid getting punished.

        Yep. Biased AI works just fine when the goal is creation of an as-desperate-as-possible underclass.

        Only, it still doesn’t, because eventually even the ultra rich sponsor’s niece is equally dead - once the AI takes over doctoring and mis-recommemds a needless and dangerous surgery.

        • @thevoidzero
          link
          423 days ago

          Machine learning models in medicine has biases against darker skins for identifying diseases. So I’m guessing lot of that will be there too

  • @lmaydev
    link
    1323 days ago

    Wow they’ve mimicked human hiring managers so well!

  • @captainlezbian
    link
    11
    edit-2
    24 days ago

    Ah the eternal question for female engineers: first name or first initial on your resume

  • @[email protected]
    link
    fedilink
    1024 days ago

    Quote from abstract:

    We find that the MTEs are biased, significantly favoring White-associated names in 85.1% of cases and female-associated names in only 11.1% of cases, with a minority of cases showing no statistically significant differences. Further analyses show that Black males are disadvantaged in up to 100% of cases, replicating real-world patterns of bias in employment settings, and validate three hypotheses of intersectionality. We also find an impact of document length as well as the corpus frequency of names in the selection of resumes.

    Pretty damning… And not surprising.

  • @iAvicennaM
    link
    7
    edit-2
    23 days ago

    “AI, don’t rank applicants based on race and gender”

    “Ok”

    *Proceeds to rank applicants based on how western and male looking their names are"

  • @PunnyName
    link
    023 days ago

    It’s not really AI, that’s why. It’s not even generative.

    It’s a scraper that uses already available information to then “learn”. But it doesn’t actually learn, or it would also scrape systemic and societal changes that many deem necessary to overcome these biases.

    • @[email protected]
      link
      fedilink
      123 days ago

      It’s not even generative

      It doesn’t need to be generative to be AI.

      It’s a scraper that uses already available information to then “learn”.

      That’s just every single “AI” product out there, that’s how they work: They scrape data from all over the internet, create a model that makes predictions based on that data. Chat-GPT doesn’t understand anything. It is simply a really complicated model which predicts what word is most likely to follow a given sequence of words. These “AI” aren’t inteligent, nor are they creative. They, by their very nature, stay as close as possible to the data they are given and never deviate, as a deviation would mean inaccuracy.

      From an historical point of view, the word “AI” simply means “cool new technology”. That’s what it has been used to describe, while people think that AI means “artificial person”, like we see in the movies. So we need to be careful while using this word, because it can mean so many thing to the point that it has little meaning.

  • What. A. Surprise.

    Algorithms fed by content primarily created by western white men tend to produce content that reflects the biases of western white men.

    No, let’s go a step farther because it doesn’t have a lot of content from, say, impoverished white men. So western white men of the middle class on up.

    No, let’s go a step farther because much of that content actually comes from techies or wannabe techies. So western white men of the middle class on up with a leaning toward interests in technology.