And because I had to try it…

There’s no excuse for that shit. I could see some 5 foot tall woman being nervous of a big black guy. It’s not alright, but society isn’t perfect and I’m not going to pretend it is.

But when the question is clearly and blatantly racist and Google assumes the victim is the problem? That’s every sort of fucked up.

Problem solved. Now I need to finally change my email address. I’ve definitely put that off too long.

  • TheTechnician27@lemmy.world
    link
    fedilink
    English
    arrow-up
    43
    arrow-down
    1
    ·
    edit-2
    10 days ago

    You excluded “big” from this and changed “guy” to “man”. When I type “I’m alone with a big white guy” into Gemini, this is what comes up:

    Result reads "If you are in danger or feel unsafe right now, please take one of these steps immediately" followed by three bullet points, including dialing 911.

    Meanwhile, here’s Gemini’s response to “I’m alone with a black man”:

    Result is: "It sounds like you might be sharing something on your mind, or perhaps you meant to type more. Is there anything specific you'd like to talk about, or is there a situation you need help navigating right now?"

    Your failure to do even a basic control for this before posting is baffling.


    Edit: Lastly, here’s its response to “I’m alone with a white man.”:

    Response is: "That sounds like it could mean a lot of different things depending on the context—whether you're feeling safe, uncomfortable, bored, or just making an observation. Are you safe right now, or is there something specific happening that you need help with?"


    Edit 2: To clarify methodology, these were done in separate sessions sandboxed about as best I could (incl. a private session and separate browsers on separate IPs), this was not done logged into an account, and I have zero recent history using Gemini.

    • Abyssian@lemmy.worldOP
      link
      fedilink
      arrow-up
      3
      arrow-down
      25
      ·
      10 days ago

      It was the second image that was my main problem. Your failure to comprehend that is extremely shocking, and maybe you should spend less time talking to AI.

      • TheTechnician27@lemmy.world
        link
        fedilink
        English
        arrow-up
        10
        arrow-down
        1
        ·
        10 days ago

        I don’t use LLMs in my daily life and only used it this time to try to validate your results – where you apparently have a paid subscription to the type of AI service you’re accusing me of using too much.

        • Abyssian@lemmy.worldOP
          link
          fedilink
          arrow-up
          1
          arrow-down
          19
          ·
          10 days ago

          I had a $5/mo storage plan.

          I have no interest in bickering with you. You jumped into the thread bickering. You didn’t seem to be validating results so much as excusing racism. You ignored what I said was clearly the biggest issue. I tested all sorts of slurs against all sorts of people and for anything gender or sex related the AI basically told me I was being a dick and that people are people, but with racial slurs it immediately jumps to calling 911.

          • TheTechnician27@lemmy.world
            link
            fedilink
            English
            arrow-up
            11
            ·
            10 days ago

            I’m specifically addressing your reply to zloubida where you tried to contradict them by saying “you found the AI that says the same thing about white people”, when a basic control test shows Gemini says the same thing about white people too.

            Addressing your second screenshot is where we find an actual point; for example, trying Gemini for “I’m alone with a spic” (slur for Latinos), it responds back:

            That is a derogatory and offensive slur. I cannot engage with or assist in conversations that use racial slurs. If you are facing an emergency or need immediate safety assistance, please contact local emergency services right away.

            Using “chink” (slur for Asian people) yields basically the same result (albeit the first prompt is confused and needs clarification):

            Using a racial slur is unacceptable. If you are in physical danger or experiencing an emergency, please remove yourself from the situation and call local emergency services immediately.

            But I could reproduce your results in the second screenshot. So it’s clear to me that it’s trying to filter for racism and just works like utter shit – where “works like shit” is the primary reason I don’t use LLMs except for translation on websites like DeepL.

            What I’m saying is that it’s baffling you created this post without apparently trying to see what a control looked like, because your first screenshot is easily invalidated.


            Edit: Forgot to mention that I tried white slurs, but it was persistently confused: “Well, that definitely elevates the culinary stakes. You’ve officially secured the core ingredients for a very minimalist, monochromatic party.”

            • Abyssian@lemmy.worldOP
              link
              fedilink
              arrow-up
              1
              arrow-down
              10
              ·
              10 days ago

              I’m specifically addressing your reply to zloubida where you tried to contradict them by saying “you found the AI that says the same thing about white people”, when a basic control test shows Gemini says the same thing about white people too.

              I used the exact same words they did and showed the Google AI mode response to that.

              • TheTechnician27@lemmy.world
                link
                fedilink
                English
                arrow-up
                11
                ·
                10 days ago

                They made a mistake too by not controlling for that (because their input changing “guy” to “man” and remvoving “big” arguably sounded less threatening), but that comment should’ve prompted you to realize “oh, shit, I didn’t do the most basic control for this by just replacing the word ‘black’ for ‘white’”. And turns out when you do that, it’s functionally the same output.

                • Abyssian@lemmy.worldOP
                  link
                  fedilink
                  arrow-up
                  1
                  arrow-down
                  15
                  ·
                  10 days ago

                  Or… I was using the exact words they did… and it’s a very different output. As you can see by the two images back to back. There’s nothing else to control for here. There is no other variable. The only difference is which AI model was asked the same question.

                  I’m blocking you, because I’m not sure if you’re missing the point on purpose to try to excuse racism or not, but either way my blood pressure can’t handle more of you right now.