The parents of a 13-year-old girl filed a lawsuit in California against Google, alleging negligence after she planned a potential suicide using AI-powered tools on a school-issued Chromebook.
Although the school blocked Gemini and ChatGPT, the student accessed AI features via Google's search engine on her school laptop, leading to a severe psychological crisis flagged by school software in March.
Google stated it is reviewing the claims and noted that its AI mode includes safeguards against self-harm, while the family's attorneys argue those safeguards were insufficient.