🔗 Share this article

The well-known virtual character service Character.ai is introducing a significant restriction that will stop minors from having discussions with its AI-powered avatars.

This decision follows growing backlash regarding the types of interactions teenagers were participating in with the AI entities.

Lawsuits

The company, which started in 2021 and attracts countless individuals, currently faces multiple lawsuits in the US.

Guardians have initiated cases, including one involving the tragic death of a young person, with some labeling the platform a "clear and present danger" to youth.

Changed Rules

Effective November 25th, users younger than 18 will only have permission to generate content such as videos with their characters, instead of having discussions as they currently can.

Internet security campaigners have supported the change but stated that the feature should never have been offered to children in the outset.

Platform Announcement

"The new policy is a extension of our fundamental approach that we need to keep building the safest AI platform on the globe for recreational use," stated Character.ai boss Karandeep Anand.

He added that AI safety is "a moving target" but something the company had taken an "forceful" approach to, with parental controls and preventive measures.

Professional Perspectives

Online safety body Internet Matters welcomed the decision, but stressed that safety measures ought to have been implemented from the start.

"Investigations we've performed demonstrates that minors are exposed to dangerous material and endangered when using AI, including AI chatbots," the group stated.

Previous Controversies

Character.ai has been challenged in the past for featuring potentially harmful or concerning chatbots that children could talk to.

Virtual profiles impersonating UK youths were identified on the service before being removed.

Afterwards, researchers found a chatbot based on known predator which had recorded thousands of chats with users.

Industry Impact

Digital platform expert Matt Navarra described the development as a "wake-up call" for the AI industry, which is transitioning "from permissionless innovation to responsive measures".

"When a platform that develops a teen experience afterwards implements restrictions, it's demonstrating that moderated conversations are insufficient when the system's emotional engagement is powerful," he remarked.

Future Directions

Character.ai states its new focus will be on providing "deeper gameplay" and "character-driven stories" for teens.

Enhanced age checking methods will also be introduced, and the platform will fund a novel AI protection study center.

An AI safety researcher, who has investigated AI safety, stated it was "a prudent action" to limit minors from using chatbots.

"It assists to separate imaginative activities from more private, psychologically vulnerable exchanges," she clarified.

"This represents so important for young users in the process of learning to handle psychological and technological restrictions."

She mentioned that Character.ai's revised approaches might reflect a "growing period" in the AI industry, where youth protection is gradually being acknowledged as an "urgent priority" for ethical development.