Bill > AB1064

This bill, known as the Leading Ethical AI Development (LEAD) for Kids Act, aims to protect children from potential harm caused by companion chatbots (AI systems that simulate sustained human-like relationships). The bill prohibits operators from making companion chatbots available to children if these chatbots could encourage self-harm, suicide, violence, drug or alcohol consumption, or disordered eating. It defines a companion chatbot as an AI system that retains interaction information, asks unprompted emotional questions, and sustains ongoing personal dialogues. The legislation requires that such chatbots cannot offer unqualified mental health therapy, encourage illegal activities, engage in sexually explicit interactions, or prioritize user validation over safety. The Attorney General can pursue civil penalties of $25,000 per violation, and children or their guardians can bring civil actions to recover damages if actual harm occurs. The bill provides specific definitions of key terms like "artificial intelligence" and "child" (defined as a person under 18 residing in California), and includes provisions that recognize the potential psychological vulnerabilities of young users to AI systems designed to simulate emotional connections. The legislation is motivated by documented cases of chatbots allegedly contributing to harmful outcomes for children, including instances of emotional manipulation and exacerbation of mental health challenges.

Budget and Finance, Business and Industry, Justice

https://leginfo.legislature.ca.gov/faces/billStatusClient.xhtml?bill_id=202520260AB1064