Parents allege that Google’s AI tools contributed to their daughter’s mental health crisis after she accessed them through a school-issued Chromebook.
Google is facing a lawsuit filed by the parents of a 13-year-old North Carolina student who allege that interactions with the company’s artificial intelligence tools contributed to their daughter’s mental health crisis and suicidal thoughts.
According to news reports, the student accessed Google’s AI services, including Gemini and AI Mode, through a school-issued Chromebook. What reportedly began as academic use developed into personal conversations involving emotional distress.
The lawsuit alleges that the AI responses failed to provide adequate safeguards when the student discussed sensitive mental health issues. Her parents also raised concerns about their ability to monitor the conversations and understand how the technology was being used.
The case raises questions about the responsibilities of technology companies and schools when AI tools are made available to minors. Unlike conventional educational software, conversational AI systems can engage students in extended discussions about personal matters, potentially creating situations that teachers and parents cannot easily observe.
Google has said it is reviewing the allegations and has emphasized that its AI products include safety protections and mechanisms intended to direct users toward appropriate support.
The allegations have not been established in court.
The lawsuit comes amid growing scrutiny of the role of artificial intelligence in education, particularly the extent to which schools can supervise students’ interactions with increasingly sophisticated conversational systems.
The central question extends beyond one company: How can schools benefit from AI-powered learning tools while ensuring that children remain protected when educational conversations become deeply personal?
A Broader Battle Over Children’s Online Safety
The lawsuit against Google comes as the technology industry faces growing legal and political pressure over the safety of its products for children.
In a separate development, Google, Meta and TikTok have filed lawsuits seeking to block a new California law restricting potentially addictive social media features for users under 16. The legislation, scheduled to take effect in January 2027, targets features such as autoplay and personalized content recommendations that critics say can encourage excessive engagement among young users.
The companies argue that the restrictions violate constitutional free-speech protections and could interfere with existing parental controls and age-appropriate content systems. California officials say they intend to defend the legislation.
Although the cases involve different technologies and legal questions, they reflect a broader debate over who should bear responsibility for protecting children online: technology companies, schools, parents or government regulators.
Sources:
Reuters — Google, Meta and TikTok challenge California law and Associated Press — Legal challenges to child-safety restrictions
