California is tightening its rules for AI companion chatbots as concerns grow about how children and teenagers use systems designed to provide friendship, emotional support and ongoing conversations.
California became the first U.S. state to create specific safety rules for AI companion chatbots aimed at protecting children. In October 2025, Governor Gavin Newsom signed SB 243, which introduced rules on safety disclosures, responses to self-harm messages, break reminders and sexually explicit content for minors. The law took effect in 2026.
California added more requirements on September 10, 2026, when Newsom signed SB 1119, also known as Adam’s Law. The new law requires features such as parental controls, alerts when children turn off certain safety settings, crisis-response measures and independent child-safety audits. It also requires companies to carry out annual risk assessments for companion chatbots used by children.
These laws show the growing focus on a key difference between companion AI and regular chatbots. Companion systems are designed to keep users engaged in ongoing conversations and can develop a sense of friendship, support or relationship over time.
What Counts as an AI Companion Chatbot in California
California’s rules treat AI companion chatbots differently from regular question-and-answer chatbots. The state’s definition covers AI systems that have ongoing conversations with users and are designed to create a sense of friendship, companionship or another type of social relationship.
This can include chatbots presented as virtual friends, companions or relationship-based characters. This difference is important because companion chatbots can remember past conversations and use personal information to make future interactions feel more continuous and personal.
Because of this, California’s rules look beyond the accuracy of individual responses. They also focus on how companion chatbots interact with young users and how they handle conversations involving self-harm, sexual content or other potentially dangerous situations.
California’s First Major Companion Chatbot Law Took Effect in 2026
California’s first major law focused specifically on AI companion chatbots was SB 243, which Governor Gavin Newsom signed on October 13, 2025. The law introduced several safety requirements for platforms that offer AI companions. It took effect in 2026.
For children and teenagers, the law requires platforms to clearly tell users that they are talking to AI and not a real person. Chatbots must also give regular reminders that the system is artificial and encourage young users to take breaks. The law also sets limits on sexual content. AI companion chatbots cannot generate sexually explicit images for minors.
Another key part of SB 243 focuses on self-harm and suicide-related conversations. Platforms must have procedures for identifying and responding to messages that indicate suicidal thoughts or self-harm.
Companies must also provide information about these safety procedures and certain crisis-related notifications to California’s Department of Public Health. The law also prevents AI companion chatbots from claiming to be health-care professionals. Key requirements under SB 243:
- AI disclosure: Minors must be told that they are interacting with an AI system.
- Break reminders: Chatbots must regularly remind young users to take breaks.
- Self-harm protocols: Platforms must have procedures for handling conversations about suicide and self-harm.
- Crisis information: Companies must report certain crisis-related information to California health authorities.
- Sexual content: Chatbots cannot generate sexually explicit images for minors.
- Professional identity: AI systems cannot present themselves as health-care professionals.
These requirements created the initial safety framework for AI companion chatbots in California. The state later added further protections through new legislation in 2026.
ALSO READ: AI Safety Concerns Escalate as Researchers Push OpenAI and Anthropic to Slow Down
California Introduces New Safeguards for Child AI Companion Users
California added more safety requirements for AI companion chatbots through SB 1119, signed by Governor Gavin Newsom on September 10, 2026. Known as Adam’s Law, the legislation strengthens protections for children who use AI companion chatbots.
According to the governor’s office, the law requires companies to have crisis procedures for conversations involving suicidal thoughts, provide parental controls and notify parents when a child turns off certain safety settings.
The law also introduces independent child-safety audits and annual risk assessments for companion chatbot systems. These requirements go beyond dealing with harmful conversations after they happen.
They also require companies to regularly examine the risks their systems may pose to children and check whether their safety measures are working. California says SB 1119 is the first law in the U.S. to require independent child-safety audits and annual risk assessments for AI companion chatbots.
How California’s New Rules Protect Children Using AI
The new laws are important because California treats AI companion chatbots differently from regular software and general-purpose AI tools. A search engine, productivity chatbot or general AI system is often used to complete a specific task. An AI companion, on the other hand, is designed to keep interacting with the user over time.
These interactions can include repeated conversations, personalized replies and ongoing communication based on previous chats. California’s rules cover several parts of these interactions, including:
- AI awareness: Children should know that they are talking to an AI system.
- Break reminders: Young users should receive reminders to take breaks.
- Self-harm responses: Platforms must have procedures for conversations involving suicidal thoughts or self-harm.
- Parental controls: Parents must have certain controls over the service.
- Safety settings: Parents may be notified when a child turns off certain safety features.
- Risk assessments: Companies must regularly assess potential risks linked to their AI companion systems.
- Independent audits: Outside experts must review certain child-safety measures.
The laws do not say that all AI companions cause emotional dependency or psychological harm. Instead, they require companies to put specific safety measures in place to address risks identified by lawmakers.
Self-harm Is A Key Focus of California’s AI rules
Self-harm and suicide-related conversations are a major part of California’s rules for AI companion chatbots. Under SB 243, companion chatbot companies must have procedures to identify and respond when users talk about suicidal thoughts or self-harm.
The 2026 law adds further protections for children in these situations. The focus comes as concerns grow about people turning to AI chatbots when they are experiencing emotional distress.
California’s rules also make clear that an AI companion should not act as a replacement for a doctor, therapist or other health professional. SB 243 prohibits companion chatbots from presenting themselves as health-care professionals. This is especially important when children or teenagers use AI companions for emotional support.
Parental Controls Become Part of Companion AI Regulation
Adam’s Law also adds a stronger role for parents. The law requires companion-chatbot services to provide parental controls and notify parents if a child disables certain safety settings.
This represents a broader approach to child safety than simply filtering individual chatbot responses. Instead of relying entirely on the AI system to determine whether a conversation is safe, California is also giving parents tools to oversee aspects of a child’s interaction with companion AI.
For companies, this could mean changes to account systems, age-related controls, safety settings and notification mechanisms.
AI Companion Companies Face Independent Safety Audits
Independent audits are another important part of California’s new rules. Under Adam’s Law, companies must carry out independent child-safety audits and annual risk assessments for AI companion chatbots.
This means companies may have to do more than test their own systems. Outside reviewers will also examine whether the safety measures for children are working as required. Independent reviews can provide an additional check on how companies identify and address risks in their AI companion systems.
California is also developing broader systems for independent AI testing and auditing. This shows that third-party reviews are becoming a larger part of the state’s approach to AI oversight.
Why California Is Paying More Attention to AI Companions
AI companion apps are different from many other AI products because they are built around ongoing social interaction. A companion chatbot may be presented as a friend, confidant, romantic partner or fictional character.
It can have repeated conversations with users and, in some cases, remember details from earlier chats. These features have led researchers to study issues such as emotional attachment, dependence and how users may view AI companions as social relationships.
California’s laws focus on these types of interactions, particularly when children use companion chatbots. The rules require companies to add safeguards for situations such as self-harm conversations, sexual content and the disabling of safety settings.
The laws do not say that AI companions are inherently harmful or that they always cause emotional or psychological problems. Instead, they focus on specific risks that may arise from the way these systems interact with young users.
California’s Rules Are Part of A Wider U.S. Debate
California is not the only state looking at AI chatbot safety. Lawmakers in other U.S. states have also proposed rules related to AI chatbots, children and mental-health risks. However, California has taken a specific approach by creating rules for AI systems designed to maintain ongoing social or relationship-like interactions.
The governor’s office says California’s 2025 law created the first dedicated child-safety framework for AI companion chatbots. The legislation passed in September 2026 then added more protections. Together, the rules cover several areas, including:
- AI disclosure
- Crisis-response procedures
- Parental controls
- Content restrictions
- Risk assessments
- Independent safety audits
How California’s AI Companion Rules Are Expanding
California’s rules for AI companion chatbots have expanded from basic safety requirements to broader checks on how these systems are designed and operated. The first law, SB 243, focused on measures such as telling users they are talking to AI, providing break reminders, responding to crisis situations and restricting sexually explicit content for minors.
The newer SB 1119 adds more requirements, including parental controls, notifications when children turn off certain safety settings, independent safety audits and regular risk assessments. This means California’s rules are looking beyond individual chatbot responses.
They also focus on how companion systems are designed, what safety measures they include and how companies check whether those measures work. As AI companion apps become more widely used, this broader approach could shape how companies develop and test these systems.
How California’s AI Companion Rules Could Shape Future Regulation
California’s new laws create a more specific set of safety rules for AI companion chatbots, especially those used by children. The impact of these rules will depend on how companies implement them and how regulators enforce them.
Over time, this could provide more information about whether measures such as AI disclosures, crisis procedures, parental controls, risk assessments and independent audits work effectively. California’s approach could also give other policymakers a model to consider as they develop their own rules for AI companions. The state is regulating more than individual chatbot responses. Its rules also look at how these systems are designed, how they interact with children and what safety measures companies put in place.
The laws do not say that virtual relationships are always harmful. Instead, they focus on specific risks linked to AI companion chatbots, including self-harm conversations, inappropriate content and situations that may require greater parental oversight.
As more people use AI companions for friendship, emotional support or other ongoing interactions, these rules could become part of a wider discussion about how governments should regulate social AI.