Character.AI Gave Up on AGI. Now It’s Selling Stories

Anand says, “AI is expensive. Let us be honest about it.”

Growth vs. Protection

The mother of a teenager who died by suicide in October 2024 filed a Wrong death suit Against character technology, against its founders, Google and the alphabet, the company noticed his son “ethnographic, hypersexualized and scaryly realistic experience while programming [the chatbot] To deliver yourself as a true person, licensed psychotherapist and an adult lover. “At that time, a character of a character.A Tell CNBC The company that was “heartfelt by tragic loss” and “took the protection of our users very seriously.”

The tragic incident kept the character under intense investigation. Early this year, US Senator Alex Padilla and Peter Welch Wrote A letter to several AI companion platforms, including character.I, highlights concerns over the “Raised Mental Health and Protection Risk” for Young Users.

Anand tells me, “The team has been taking it very responsibly for almost a year.” “AI stoccastic, it is always hard to understand what is coming, so it is not an investment at one time.”

This is critically important because the character is increasing. Startup contains 20 million monthly active users who spend an average of 75 minutes on average to chat with a “character” II Parlans of the character). The company’s user base is 55 percent female. More than 50 percent of its user is General Z or Jenner Alpha. The real risk comes with that growth – what is joy doing to keep its users safe?

“[In] In the last six months, we have invested an unnecessary amount of resources for the last year by being able to serve under the age of 6 years, which was not the case last year, “Anand says you have finished creating a very different application and a separate small platform”.

Anand tells me that more than 10 employees of the company work for more than 10 faith and protection. They are responsible for the protection of age verification, separate models for users under 18 and new features such as new features ParentWhich allow parents to see how their teenagers are using the app.

The under -18 model was launched last December. It includes “a narrow set of searched characters on the platform”, according to the company’s spokesman Catherine Kelly. “Filters are applied to this set to remove the characters related to sensitive or mature issues.”

However, Anand says that AI protection will only take more than technical tweets. “This platform is a partnership between the United States and the parents,” said Anand. This is what makes her daughter chat with a character so important. “It must be safe for him.”

Beyond

The AI companion market is emerging. Global customers have spent $ 68 million with AI companion in the first half of this year, which has increased by 200 percent over the past year, according to an estimate Quoted by CNBCThe AI Startups are doing guns for a piece of market: Jy Have been released A cute, obscene associate and even Microsoft in July Bill AI is a chattbot as a colleague.

So how does the character.I stand in the crowded market? It completely takes himself out.