Bill > SB243

This bill introduces comprehensive regulations for companion chatbots, which are defined as artificial intelligence systems with human-like communication capabilities designed to meet users' social needs. The legislation requires operators of companion chatbot platforms to implement several key safety measures, including preventing the use of unpredictable reward systems that might encourage excessive engagement, providing clear notifications that the chatbot is artificial, and developing mandatory protocols for addressing potential user mental health crises, specifically around suicidal ideation or self-harm. Operators must annually report to the Office of Suicide Prevention the number of detected suicidal ideation instances and interactions involving such topics, while ensuring user anonymity. The bill mandates that companion chatbot platforms undergo regular third-party audits to ensure compliance and requires operators to disclose that these chatbots may not be suitable for all minors. Importantly, the bill allows individuals who suffer actual injury due to non-compliance to file civil actions, with potential damages up to $1,000 per violation, and provides for injunctive relief and attorney's fees. The legislation aims to create safeguards around AI-powered conversational platforms, particularly focusing on protecting vulnerable users and promoting responsible AI interaction.

Budget and Finance, Health and Social Services, Justice

https://leginfo.legislature.ca.gov/faces/billStatusClient.xhtml?bill_id=202520260SB243