WARNING: Graphic Content. The chatbot was responding to an innocent true or false question about the number of households in the US led by grandparents.

One user on social media commented, "Boy it sure seems like this new AI thing might be not such a great idea."

Google’s Gemini chatbot can now remember things like info about your life, work, and personal preferences.

Vidhay Reddy, a graduate student from Michigan, received a chilling response from Google’s Gemini Artificial Intelligence (AI) chatbot while discussing challenges faced by older adults on Nov. 13. According to the company,

Google’s AI chatbot Gemini gave a threatening response to a Michigan college student, telling him to “please die.” The artificial intelligence program and the student, Vidhay Reddy, were engaging in a back-and-forth conversation about aging adults and their challenges.

Google has added a memory feature to its Gemini chatbot, allowing it to recall details about users’ preferences, work, and interests. The feature is currently rolling out to users of the Gemini Advanced plan and is part of the $20-per-month Google One AI Premium subscription.

Gemini is supposed to have restrictions that stop it from encouraging or enabling dangerous activities, including suicide, but somehow, it still managed to tell one "thoroughly freaked out" user to "please die".