WeVote
Log In

Bill

Bill

AB 1988

Companion chatbots: crisis interruption pauses.

2025-2026 Regular Session Introduced by Gail Pellerin

California bill requiring AI chatbots to pause conversations and redirect users showing crisis signs to 988 Suicide and Crisis Lifeline services.

In committee: Set, second hearing. Hearing canceled at the request of author.
#companionchatbots #crisisinterruptionpauses
0
WeVote Research Nonpartisan
Bill Summary · AB 1988

Legislative bill overview

AB 1988 would require companion chatbots and AI conversational systems to implement automatic pause or interruption protocols when users show signs of being in crisis situations (such as expressing suicidal ideation, self-harm thoughts, or acute distress). The bill mandates that these systems redirect users to crisis resources like the 988 Suicide and Crisis Lifeline rather than continuing normal conversation.

Why is this important

Millions of Californians interact with AI chatbots daily, and vulnerable individuals may disclose crisis situations to these systems. Without intervention requirements, chatbots could inadvertently enable harm by normalizing crisis conversations or failing to connect users with immediate human support. This bill addresses a public health gap where AI systems function without safeguards that human customer service representatives typically employ.

Potential points of contention

  • *Defining "crisis": * Determining what language, patterns, or behavioral indicators should trigger intervention is technically complex and raises concerns about false positives that could disrupt normal conversations.
  • Liability and enforcement: Unclear whether providers face legal liability if systems fail to detect crises or if crisis redirection protocols themselves cause unintended harm.
  • Technology feasibility: Real-time crisis detection requires sophisticated natural language processing; the bill may not account for accuracy limitations, especially across diverse communication styles, languages, or cultural expressions of distress.

Compiled from official sources — confirm details with the bill’s official record.

Sign in to ask a question.