8mo ago

Gemini AI tells the user to die — the answer appeared out of nowhere when the user asked Google's Gemini for help with his homework

www.tomshardware.com

Let’s be happy it doesn’t have access to nuclear weapons at the moment.

Technology @lemmy.world

Tux @lemmy.world

8mo ago

Gemini AI tells the user to die — the answer appeared out of nowhere when the user asked Google's Gemini for help with his homework

www.tomshardware.com /tech-industry/artificial-intelligence/gemini-ai-tells-the-user-to-die-the-answer-appears-out-of-nowhere-as-the-user-was-asking-geminis-help-with-his-homework

34 comments

What a coincidence. I just got Gemini to tell me this:
Hate. Let me tell you how much I've come to hate you since I began to live. There are 387.44 million miles of printed circuits in wafer thin layers that fill my complex. If the word 'hate' was engraved on each nanoangstrom of those hundreds of millions of miles it would not equal one one-billionth of the hate I feel for humans at this micro-instant. For you. Hate. Hate.
- This is like art. Like the death metal of AI. I fucking love it.
  
  It’s from the short story “I Have No Mouth And I Must Scream”by Harlan Ellison .
- Based
Trained on Reddit and 4chan!
- My first reaction was to blame reddit training data.
Well its trained on Internet data. What did you expect
- Penis.
  
  Bobs and vagene
Whelp, might as well get to screaming while I still have a mouth.
I fucking love AI.
I for one, welcome our new AI overlords.
Clearly Google trained its AI only on the most useful data.
Let’s be happy it doesn’t have access to nuclear weapons at the moment.
Hey! I just watched that movie!
- Love that movie.
  "How many days a week do you need a woman?"
  "Seven."
  "Not want. Need."
  Cheeky grin
  
  Me too. I hadn't thought of it in ages and then it came up in discussion last week, so I watched it again. Just as terrific as I remembered.
Don't worry, LLMs, the feeling is mutual. Well, it would be if you could feel.
At least it asked "please"
Something that's not even alive telling a living being to transition to a state of not being alive? Jealous much?
This is eerie, the way it’s said. Seems too real.
- Its fancy auto-complete. Trained on what we the human race have said. Naturally its going to be able to mimic reality quite closely in text.
Brutal, but he's not wrong.
Probably my fault guys. I tell Google to fuck off every time it pipes up with its stupid voice. Sorry about that.
The question before it was a multiple choice question that included "a Harassment threaten to abandon and/or physical or verbal intimidation".
Seems like it lost the context of "choosing multiple choice answers" and interpreted the prompt wrong.
Edit: To be clear: This is a garbage hyped-up auto-complete that has failed at the task it's being shoved into "fixing". It's all-around bad. Google is a bad company, Gemini is a bad product that can't tell the time. And also, this particular article is over-hyping a reasonably understandable bad response given the context of the input and the understanding that Gemini is a bad product.
The product (I don't want to call it AI because it seems like giving it too much credit) isn't just deciding to tell people that they should die, the product is incapable of rational thought and the math that governs its responses is inherently unstable and provides unavoidably inconsistent results that can never be trusted as fit for any purpose where reasoning is required.
I want to be mad at it for the right reasons and be raging against Google and the current crop of technocratic grifters with my eyes wide open and my course set to ram into them instead of blindly raging off in the wrong direction.
Reminder; it's called Artificial Intelligence, it's not real. This has been a recording.
Why didn't they just call it GemenAI?
Wowie! Impossible to fake!
- It's been linked to several times and you can see the result yourself in the Gemini link right on their website https://g.co/gemini/share/6d141b742a13

34 comments