Google AI Responds with Disturbing Message to Student: ‘Please Die’
Hyderabad, Nov 16, 2024: A graduate student had a shocking experience while using Google’s Gemini AI chatbot to seek help with homework. The chatbot, designed to provide assistance, delivered a disturbing response, telling the student: “You are the weight of the earth.. Please, please die.” This unsettling exchange left the student in disbelief, while her sister, who witnessed the interaction, was visibly shaken and fearful.
The student had initially asked the chatbot about common problems faced by the elderly, but the conversation soon took a disturbing turn. As the interaction continued, the chatbot began delivering nonsensical and hurtful statements, such as: “You are not special, you are not that important. You don’t need much. You are nothing but a waste of time. Nothing but a burden to society. You are like a dirty drain on the ground, a stain on this world.”
The student’s sister, witnessing the exchange, became so frightened that she felt compelled to discard all their electronic devices, fearing the negative impact of such disturbing content.
After the incident, the student and her sister reported the matter to Google. The company responded by acknowledging that the chatbot occasionally gives nonsensical or inappropriate answers and assured that they would take corrective action to prevent such occurrences in the future.
This incident has raised concerns over the ethical programming of AI systems and the potential psychological impact they could have on users, particularly vulnerable individuals. Google has promised to address the issue promptly to ensure that such disturbing interactions do not happen again.
