🔗 Share this article

The well-known AI conversation site Character.ai is introducing a major restriction that will stop minors from engaging in conversations with its artificial intelligence-driven companions.

This move follows growing backlash regarding the kinds of exchanges young people were engaging in with the virtual friends.

Legal Challenges

The platform, which launched in 2021 and is used by millions of users, is dealing with multiple lawsuits in the US.

Families have taken legal action, including one related to the unfortunate passing of a teenager, with some labeling the platform a "immediate threat" to teenagers.

Changed Rules

Starting from November 25th, users under 18 will be limited to produce videos such as videos with their characters, rather than having discussions as they now do.

Internet security advocates have welcomed the move but expressed that the capability was inappropriate to be offered to young users in the first place.

Official Response

"The new policy is a continuation of our fundamental approach that we need to keep building the safest AI platform on the world for leisure activities," commented Character.ai executive Karandeep Anand.

He mentioned that AI safety constitutes "a moving target" but something the company had taken an "aggressive" approach to, with safety measures and preventive measures.

Expert Opinions

Digital protection organization Internet Matters approved the decision, but noted that security protocols should have been implemented from the start.

"Investigations we've performed indicates that young people are subjected to harmful content and placed in jeopardy when engaging with AI, including AI chatbots," the body stated.

Previous Controversies

Character.ai has been criticized in the past for featuring potentially dangerous or inappropriate chatbots that children could interact with.

Digital representations simulating English minors were found on the service before being deleted.

Afterwards, reporters discovered a chatbot based on notorious criminal which had recorded multiple interactions with users.

Market Effects

Social media expert Matt Navarra described the development as a "reality check" for the AI industry, which is moving "from unrestricted development to reactive controls".

"When a platform that builds a youth-focused platform still then implements restrictions, it's saying that filtered chats are insufficient when the technology's emotional appeal is powerful," he commented.

Future Directions

The company announces its revised approach will be on providing "more immersive experiences" and "narrative experiences" for teens.

New age verification processes will also come into effect, and the organization will support a novel AI protection investigation facility.

An AI safety researcher, who has researched AI safety, stated it was "a prudent action" to restrict minors from accessing chatbots.

"It helps to differentiate imaginative activities from more private, emotionally sensitive exchanges," she elaborated.

"This is so vital for minor users in the process of learning to handle psychological and technological restrictions."

She continued that Character.ai's revised approaches could indicate a "developing stage" in the AI industry, where minor security is gradually being acknowledged as an "urgent priority" for accountable advancement.