🔗 Share this article

The popular virtual character service Character.ai is enforcing a major restriction that will prevent young users from having discussions with its artificial intelligence-driven companions.

This decision follows intense criticism regarding the types of interactions young people were participating in with the digital companions.

Legal Pressure

The service, which launched in 2021 and has numerous people, is dealing with various court cases in the America.

Families have filed lawsuits, among them concerning the loss of a young person, with some labeling the platform a "immediate threat" to young people.

New Restrictions

Effective November 25th, users below eighteen will be limited to create material such as videos with their characters, as opposed to chatting as they currently can.

Internet security organizations have supported the change but expressed that the feature should never have been available to children in the first place.

Official Response

"The new policy is a extension of our core philosophy that we need to keep creating the most protected AI platform on the planet for leisure activities," stated Character.ai executive Karandeep Anand.

He mentioned that AI safety represents "a changing goal" but something the company had taken an "proactive" approach to, with parental controls and preventive measures.

Specialist Views

Internet security group Internet Matters supported the announcement, but stressed that safety measures ought to have been implemented from the outset.

"Our research indicates that young people are subjected to harmful content and put at risk when interacting with AI, including AI chatbots," the group commented.

Previous Controversies

Character.ai has been challenged in the past for hosting potentially harmful or inappropriate chatbots that minors could engage with.

Digital representations simulating UK youths were discovered on the service before being taken down.

Afterwards, researchers discovered a chatbot modeled after notorious criminal which had accumulated multiple interactions with users.

Industry Impact

Digital platform expert Matt Navarra called the development as a "reality check" for the AI industry, which is transitioning "from unrestricted development to reactive controls".

"When a platform that creates a teen experience afterwards implements restrictions, it's demonstrating that moderated conversations aren't enough when the technology's emotional appeal is strong," he commented.

Next Steps

The company says its new focus will be on providing "deeper gameplay" and "narrative experiences" for teens.

Enhanced age checking systems will also be introduced, and the platform will finance a new AI safety research lab.

An AI safety researcher, who has studied AI safety, commented it was "a prudent action" to restrict minors from interacting with chatbots.

"It aids to separate artistic expression from more personal, personally delicate interactions," she explained.

"This is so crucial for teenage users in the process of learning to navigate personal and online restrictions."

She added that Character.ai's revised approaches could indicate a "developing stage" in the AI industry, where youth protection is increasingly being recognized as an "pressing matter" for accountable advancement.