🔗 Share this article

The well-known virtual character service Character.ai is implementing a major policy change that will stop young users from interacting with its virtual characters.

This action comes after widespread concern regarding the kinds of exchanges teenagers were participating in with the AI entities.

Legal Pressure

The company, which launched in 2021 and is used by countless individuals, is dealing with several legal actions in the United States.

Guardians have taken legal action, among them involving the unfortunate passing of a minor, with some describing the platform a "clear and present danger" to teenagers.

New Restrictions

Beginning November 25th, users below eighteen will be limited to create material such as videos with their characters, as opposed to engaging in conversations as they now do.

Internet security advocates have supported the change but expressed that the capability was inappropriate to be offered to minors in the first place.

Official Response

"The new policy is a continuation of our fundamental approach that we need to keep building the safest AI platform on the world for entertainment purposes," said Character.ai boss Karandeep Anand.

He mentioned that AI safety is "a changing goal" but something the company had taken an "proactive" approach to, with parental controls and safety barriers.

Specialist Views

Internet security organization Internet Matters welcomed the decision, but stressed that security protocols needed to be built in from the outset.

"Investigations we've performed demonstrates that minors are subjected to harmful content and placed in jeopardy when interacting with AI, such as AI chatbots," the group said.

Past Issues

Character.ai has been criticized in the past for including potentially harmful or concerning chatbots that minors could talk to.

Virtual profiles simulating UK youths were discovered on the service before being removed.

Afterwards, investigative journalists found a chatbot inspired by notorious criminal which had logged numerous conversations with users.

Market Effects

Social media expert Matt Navarra characterized the development as a "reality check" for the AI industry, which is shifting "from unrestricted development to responsive measures".

"When a company that develops a minor-friendly service subsequently implements restrictions, it's indicating that controlled interactions are insufficient when the system's emotional engagement is powerful," he commented.

Coming Changes

Character.ai announces its revised approach will be on providing "enhanced interactive features" and "character-driven stories" for teenagers.

New age verification processes will also come into effect, and the company will support a novel AI protection investigation facility.

An AI safety researcher, who has researched AI safety, stated it was "a prudent action" to control teenagers from using chatbots.

"It aids to differentiate imaginative activities from more private, emotionally sensitive interactions," she clarified.

"This is so vital for minor users still learning to manage psychological and technological restrictions."

She mentioned that Character.ai's new measures may represent a "maturing phase" in the AI industry, where child safety is increasingly being recognized as an "immediate concern" for ethical development.