Google CEO says Gemini AI diversity errors are ‘completely unacceptable’::In an internal memo, Google CEO Sundar Pichai told employees that the historically inaccurate photos generated by the company’s Gemini AI were ‘completely unacceptable.’

  • @[email protected]
    link
    fedilink
    English
    4710 months ago

    if you find QA people do to QA and pay them to do QA this won’t happen.

    but that’s not cost saving, is it?

    • @iopq
      link
      English
      510 months ago

      They had QA people, this was actually intended behavior

      • @[email protected]
        link
        fedilink
        English
        10
        edit-2
        10 months ago

        no? alphabet lost $90bil in value over this, why on earth would an entity choose to make a design decision that breaks investor confidence?

        the initial choice to make the AI “diverse,” sure, that’s intentional. but the method by which it was done had unintentional consequences, and that is the problem which QA would have fixed.

        • @iopq
          link
          English
          1210 months ago

          They got the result they wanted, they just didn’t get the response they wanted from the public. There’s no way to QA this

            • @iopq
              link
              English
              210 months ago

              It’s not the QA team’s job to run a focus group. Ideally, you decide what customers want before building a product.

  • @BigMikeInAustin
    link
    English
    2710 months ago

    Well, Americans think Jesus was white with blue eyes. So it was just being human.

      • @[email protected]
        link
        fedilink
        English
        810 months ago

        Have you ever seen a depiction of Jesus in a church in North America? That dude doesn’t look like he’s from the middle east at all.

      • @ripcord
        link
        English
        410 months ago

        I would guess the vast majority, but I have no data to back that up.

        I mean, that’s how western depictions of him are 99% of the time so intuitively it’s true, but not sure.

  • @chakan2
    link
    English
    1710 months ago

    I shrug at the whole thing…we spent a decade bitching about real world data being racist.

    When we put in fake data, we got fake results.

    Queue outrage.

  • @[email protected]
    link
    fedilink
    English
    1110 months ago

    I’m not sure if the goal of txt2img models is supposed to be historically accurate photos…

  • @Veez
    link
    English
    910 months ago

    Faux outrage from white nationalists who are hopped up on replacement theory algorithms. Nothing to see here.

    • @[email protected]
      link
      fedilink
      English
      410 months ago

      Yep. Black Nazis are not weirder than black vikings or black people in Arthurian Britain. Or European main characters in samurai-themed movies, God forbid.

      Anyway, an image generation tool should be orthogonal to this, it generates what’s asked from it.

      • @General_Effort
        link
        English
        110 months ago

        I’m not disagreeing, just providing (I hope) interesting context.

        Black Nazis

        At the time, there were a few Afro-Germans, obviously hated by the nazis. A few were children of individual travelers, such as diplomats, like Hans-Jürgen Massaquoi. More were children of French Colonial soldiers. They were denigrated as “Rhineland bastards” by racists/nationalists even before the nazis rose. Obviously, they were prosecuted; subjected to forced sterilization. Perhaps surprisingly, they were never systematically murdered.

        There could not be such a thing as a black nazi. However, a few “mixed race” children (African and Asian) were conscripted into the Wehrmacht.

        One should also bear in mind that the term Aryan existed before the nazis and was used by white supremacists in the US even pre WW1. The nazis stopped using it in the last years of their rule.

        black vikings

        Black vikings are historically quite possible. In Western Europe and the English-speaking world, the vikings are known as raiders and conquerors. But they were also merchants and mercenaries. An archeological dig, near today’s Stockholm, found a viking age Buddha statue from India. “Vikings” served as the Varangian Guard in today’s Istanbul. People also travelled the other way, of course, such as notably Ahmad ibn Fadlan.

        There’s nothing particularly implausible about a dark-skinned African travelling north to the Bosporus, meeting vikings, and travelling with them to their homeland to go on raids. It’s not like we would expect to know if this happened once or twice during the viking age.

        Arthurian Britain

        I don’t know much about this period. It was basically just after the Roman presence had ended. The Roman Empire included northern Africa, so thinking of black people in the Roman Legion makes perfect sense. After the decline/fall of the empire and the disruption of trade routes, the presence of dark skinned people in Britain becomes rather less plausible.

        • @[email protected]
          link
          fedilink
          English
          210 months ago

          This is interesting, I agree, but, first,

          1 - I know that, but the images in question had SS symbols on helmets;

          2 - I know that too, and it’s likely to have happened once or twice or a dozen times, but I think no genetic or archeological trace of something like this definitely happening has yet been found;

          3 - now here I think I’ve read about some genetic traces found even;

          … and, second, it’s more about something being normal as your first association.

          Say, when you think of a universally gifted person, Dolph Lundgren won’t quite fit your stereotype.

  • AutoTL;DRB
    link
    fedilink
    English
    110 months ago

    This is the best summary I could come up with:


    The historically inaccurate images and text generated by Google’s Gemini AI have “offended our users and shown bias,” CEO Sundar Pichai told employees in an internal memo obtained by The Verge.

    Last week, Google paused Gemini’s ability to generate images after it was widely discovered that the model generated racially diverse, Nazi-era German soldiers, US Founding Fathers who were non-white, and even inaccurately portrayed the races of Google’s own co-founders.

    While Google has since apologized for “missing the mark” and said it’s working to re-enable image generation in the coming weeks, Tuesday’s memo is the first time the CEO has widely addressed the controversy.

    In the memo, which was first reported by Semafor, Pichai says the company has “been working around the clock” to address “problematic text and image responses in the Gemini app.” He doesn’t say that Google has fixed the problem.

    “No Al is perfect, especially at this emerging stage of the industry’s development, but we know the bar is high for us and we will keep at it for however long it takes,” he writes.

    You can read Sundar Pichai’s full memo to Google employees below:


    The original article contains 189 words, the summary contains 189 words. Saved 0%. I’m a bot and I’m open source!