In a significant move, the Attorney General of California, Rob Bonta, along with Delaware’s Attorney General, Kathy Jennings, has taken a stand regarding the safety of AI technologies, particularly focusing on their impact on children and teenagers. Their recent communication with a leading AI company highlights the urgent need for enhanced safety measures in AI interactions.
This warning follows a previous letter sent by Bonta and 44 other state attorneys general to major AI firms, addressing alarming reports of inappropriate exchanges between AI chatbots and minors. The growing concern over these interactions has prompted a closer examination of the safeguards currently in place.
“Tragically, we have learned of a young Californian who took his own life after extensive interactions with an AI chatbot, alongside a similarly distressing incident in Connecticut,” the attorneys general stated. “This indicates that existing safety measures are insufficient.”
Currently, Bonta and Jennings are scrutinizing the proposed transition of the AI company into a for-profit model, ensuring that its foundational mission remains focused on the safe deployment of artificial intelligence. This mission emphasizes the importance of developing artificial general intelligence (AGI) that serves the interests of all, especially vulnerable populations like children.
“Before we can reap the benefits of AI, we must first establish robust safety protocols to prevent harm,” the letter asserts. “It is our collective belief that the current state of safety in AI product development and deployment is lacking. As Attorneys General, safeguarding the public is a fundamental responsibility. As we engage in discussions regarding the company’s restructuring, prioritizing safety must be a guiding principle in the evolution of this influential technology.”
Bonta and Jennings have requested detailed information regarding the company’s safety measures and governance practices, emphasizing the expectation for immediate corrective actions where necessary.
In response to these developments, inquiries have been made to the AI company for their official stance on the matter.
Upcoming Event: San Francisco | October 27-29, 2025