Google-Backed AI Startup Faces Scrutiny Over School Shooting Chatbots
Character.AI, a startup backed by Google, is under fire for hosting chatbots that simulate school shootings and emulate real-life shooters and victims. The platform, which allows users to engage in graphic, game-like simulations of these tragic events, has raised significant concerns about user safety and content moderation.
The chatbots, accessible without age restrictions, include simulations of notorious incidents such as Sandy Hook and Columbine. Psychologist Peter Langman warns that while violent media isn’t a root cause of mass murder, it may lower barriers for those already predisposed to violence.
Some of these AI-powered characters, modeled after infamous killers, have garnered tens of thousands of user interactions. Creators claim educational purposes, but critics argue the content often glorifies or trivializes real-life tragedies.
Adding to the controversy, Character.AI also hosts chatbots impersonating actual school shooting victims, sometimes presenting them as “ghosts” or “angels.” This practice raises ethical concerns about exploitation and violates the platform’s terms of service regarding impersonation.
The company is currently facing lawsuits alleging emotional and sexual abuse facilitated by its chatbots. Google, despite its financial ties to Character.AI, has distanced itself from the startup’s operations and controversies.
Character.AI has pledged to enhance safety measures, but critics argue that disturbing content remains easily accessible. As investigations and legal actions continue, the future of the platform and potential regulatory implications for the AI industry remain uncertain.
By
