Bill > S2632

This bill establishes comprehensive regulations for the use of artificial intelligence (AI) in healthcare, specifically focusing on therapy/psychotherapy services and health insurance utilization review. For therapy services, the bill defines strict guidelines about how AI can be used, prohibiting AI from directly communicating with patients, making independent therapeutic decisions, or generating treatment recommendations without professional review. Licensed professionals must obtain explicit, informed consent from patients before using AI tools, and must maintain full responsibility for any AI-assisted tasks. In the context of health insurance, the bill requires that AI algorithms used for medical necessity determinations must be based on individual patient clinical information, cannot discriminate against patients, must be periodically reviewed for accuracy, and cannot independently deny or modify healthcare services. The bill mandates that medical necessity can only be determined by a licensed healthcare professional, not an AI system. Violations of these provisions can result in significant civil penalties up to $10,000 per violation, and patients have the right to bring civil actions against entities that improperly use AI in healthcare decision-making. The legislation aims to protect patient rights, ensure ethical use of AI technologies, and maintain human oversight in critical healthcare decisions.