Illinois Legislation Regulates AI in Mental Health Services
Illinois Governor JB Pritzker has recently signed legislation that restricts the use of artificial intelligence (AI) in therapy and psychotherapy, mandating that any AI applications in these areas be supervised by approved clinicians. This move aims to enhance patient safety and maintain the quality of mental health services.
Prohibition of AI in Therapeutic Decision-Making
The new law explicitly prohibits the use of AI for aiding mental health and therapeutic decision-making. However, it allows the implementation of AI in administrative tasks and support services, provided they are utilized by certified behavioral health professionals. This limitation is put in place to ensure that patients receive care from qualified individuals rather than relying on unregulated AI systems.
Intent Behind the Legislation
Governor Pritzker emphasized that the legislation prioritizes patient safety, job security for qualified healthcare providers, and the protection of vulnerable populations, particularly children. “The residents of Illinois deserve quality health care from real and qualified professionals, not from AI systems pulling information from various online sources,” stated Mario Treto Jr., Secretary of the Illinois Financial and Professional Regulatory Department (IDFPR).
Concerns Over AI in Therapy
The Illinois General Assembly and the National Association of Social Workers’ Illinois chapter have expressed concerns regarding the risks of employing AI in direct therapeutic treatment. A notable example is a report from the Washington Post, which revealed how an AI therapist irresponsibly advised a fictional drug addict to use methamphetamine. Such instances underscore the potential dangers of unregulated AI applications in sensitive areas like mental health.
Expert Testimonies and Regulatory Oversight
During a 2024 joint hearing, experts indicated that “AI algorithms are as effective as the data on which they are trained.” Legislators were advised to be cautious about viewing AI as a cost-effective shortcut to professional medical care. The IDFPR is authorized to investigate violations of this new law, with confirmed breaches leading to fines of up to $10,000.
Addressing the Risks of Unqualified AI
State representative Bob Morgan (D-Deerfield) highlighted the growing awareness of the risks posed by unqualified chatbots that offer harmful non-clinical advice during vulnerable periods. He reassured Illinois residents that while they will still have access to therapeutic applications, the legislation aims to protect individuals requiring real mental health services from inadequate AI interventions.
Future of AI in Health Care
In its 2024 report, the Congressional Budget Office (CBO) examined the role of AI and machine learning in healthcare, noting that the evidence of its effectiveness remains mixed. As the landscape of healthcare technology evolves, further empirical research will be vital in understanding the overall impact of AI on health spending and patient care.