Character.AI Enhances Safety Features to Protect Teen Users
Character.AI, a platform renowned for enabling users to create interactive stories and characters, has unveiled a comprehensive set of safety features designed to protect its teenage audience. The move underscores the company's commitment to creating a secure and engaging environment for young users, according to a recent blog post by Character.AI.
Advanced Model Training and Teen-Specific Guidance
In a bid to tailor its services for teen users, Character.AI has been developing a distinct model aimed at minimizing exposure to sensitive content. This involves refining the platform’s Large Language Model (LLM) to differentiate between adult and teen user experiences, thus ensuring that teenagers encounter less suggestive material. The company’s efforts include using classifiers to filter out inappropriate content, effectively guiding the AI’s responses away from sensitive topics.
Enhancing Model and User Input Filters
Character.AI employs a dual approach to manage content: blocking unsuitable model outputs and monitoring user inputs that could prompt inappropriate responses. This includes the deployment of classifiers to detect specific content types in model responses and improvements in detecting and responding to user inputs that may violate terms of service. For instances where content references self-harm, the platform directs users to appropriate mental health resources.
New Features for User Safety
The platform is also introducing several new features aimed at enhancing user safety. These include parental controls that provide insights into children's activities on the platform, and time-spent notifications that alert users after prolonged sessions. Additionally, Character.AI has updated its disclaimers to remind users that its characters are fictional and not substitutes for professional advice, especially in the case of user-created characters with professional titles.
Collaboration with Safety Experts
Character.AI has partnered with online safety experts, including ConnectSafely, to ensure its platform is safe for users under 18. This collaboration aims to incorporate expert advice into the platform’s safety design, enhancing both current and future features. By consulting with these organizations, Character.AI strives to maintain a balance between creativity and safety.
Character.AI's commitment to safety reflects its recognition of the evolving nature of AI technology and its impact on user experience. The platform's ongoing improvements aim to foster a creative space where users can explore safely, ensuring that safety remains integral to its operations.
For more details, visit the Character.AI Blog.