Illinois Governor JB Pretzker last Friday signed the AA bill to a law prohibiting the use of artificial intelligence to provide mental health services, aiming to protect residents from potentially harmful advice.
The law known as wellness and surveillance of the Psychological Resources Act prohibits AI systems from making therapeutic treatment or clinical decisions. The act allows AI tools to be used in administrative roles such as scheduling and memotaking, but derive clear boundaries for direct patient care.
A company or individual found to be breached could face a $10,000 fine enforced by the Illinois Department of Financial Specialist Regulation.
“Illinois deserve quality healthcare from real, qualified professionals, rather than computer programs that draw information from every corner of the internet to generate a response that harms patients,” Illinois financial regulations secretary Mario Toreto Jr. said in a press release. “This law exists as our commitment to protecting the well-being of our residents by ensuring mental health services are provided by trained professionals who prioritize patient care above all else.”
The new law responds to growing concerns over the use of AI in sensitive areas such as healthcare. The Washington Post reported last May that the AI-powered therapist chatbot recommended “a few methane to get through this week” to fictional ex-addicts.
Last year, the Illinois House Health Care Licensing and Insurance Board held a joint Health Insurance AI hearing that it warned that AI lacked the empathy, accountability, or clinical surveillance needed for safe mental health treatment.
“When we talk about AI, it's already outweighed the human mind. Especially when it comes to regulations and healthcare, it's only a matter of time before they outweigh our structure and systems,” Sen. Bob Morgan, chair of the House Healthcare Licensing Committee, said at the hearing.
Florida Governor Ron DeSantis also shows that state-level AI regulations are coming soon in his state, calling artificial intelligence “the biggest problem facing society and the economy.” Desantis said Florida will develop its own AI policy in the coming months.
