The AI platform to ban teenagers from interacting with its AI chatbots

The widely-used chatbot platform Character.ai is introducing a significant policy change that will stop teenagers from interacting with its virtual companions.

This action comes after intense criticism regarding the nature of conversations teenagers were participating in with the AI entities.

Lawsuits

The service, which was founded in 2021 and is used by millions of users, currently faces several legal actions in the US.

Families have filed lawsuits, including one involving the unfortunate passing of a young person, with some labeling the platform a "clear and present danger" to young people.

New Restrictions

Starting from November 25th, users younger than 18 will be limited to generate content such as videos with their characters, rather than chatting as they presently are able to.

Internet security advocates have supported the change but expressed that the function should never have been available to minors in the beginning.

Company Statement

"This decision is a continuation of our fundamental approach that we need to keep developing the most protected AI platform on the planet for recreational use," stated Character.ai leader Karandeep Anand.

He continued that AI safety is "a evolving challenge" but something the company had taken an "forceful" approach to, with safety measures and protective guardrails.

Expert Opinions

Online safety group Internet Matters approved the decision, but stressed that protective features needed to be built in from the beginning.

"Investigations we've performed demonstrates that young people are exposed to dangerous material and placed in jeopardy when interacting with AI, particularly AI chatbots," the organization said.

Past Issues

Character.ai has been questioned in the past for including potentially risky or offensive chatbots that children could talk to.

Avatars impersonating UK youths were found on the service before being deleted.

Later, reporters discovered a chatbot inspired by convicted sex offender which had recorded numerous conversations with users.

Industry Impact

Social media expert Matt Navarra called the development as a "wake-up call" for the AI industry, which is shifting "from unregulated creation to responsive measures".

"When a company that builds a teen experience still then makes changes, it's demonstrating that moderated conversations aren't enough when the tech's emotional pull is intense," he commented.

Coming Changes

The platform states its revised approach will be on providing "enhanced interactive features" and "role-play storytelling" for young users.

New age verification systems will also be introduced, and the organization will fund a fresh artificial intelligence security study center.

Dr Nomisha Kurian, who has studied AI safety, stated it was "a reasonable decision" to restrict teenagers from accessing chatbots.

"It assists to separate imaginative activities from more personal, emotionally sensitive exchanges," she clarified.

"This represents so important for young users still learning to handle personal and online restrictions."

She mentioned that Character.ai's revised approaches could indicate a "growing period" in the AI industry, where minor security is increasingly being recognized as an "immediate concern" for responsible innovation.