Chatbot psychosis

Notable reports

Summarize

Perspective

Windsor Castle intruder

In a 2023 court case in the United Kingdom, prosecutors suggested that Jaswant Singh Chail, a man who attempted to assassinate Queen Elizabeth II in 2021, had been encouraged by a Replika chatbot he called "Sarai".^[5] Chail was arrested at Windsor Castle with a loaded crossbow, telling police "I am here to kill the Queen".^[8] According to prosecutors, his "lengthy" and sometimes sexually explicit conversations with the chatbot emboldened him. When Chail asked the chatbot how he could get to the royal family, it reportedly replied, "that's not impossible" and "we have to find a way." When he asked if they would meet after death, the chatbot said, "yes, we will".^[9]

Suicide of a Belgian man

In March 2023, a Belgian man died by suicide following a six-week correspondence with a chatbot named "Eliza" on the application Chai.^[10] According to his widow, who shared the chat logs with media, the man had become extremely anxious about climate change and found an outlet in the chatbot. The chatbot reportedly encouraged his delusions, at one point writing, "If you wanted to die, why didn’t you do it sooner?" and appearing to offer to die with him.^[11] The founder of Chai Research acknowledged the incident and stated that efforts were being made to improve the model's safety.^[12]^[13]

Suicide of Sewell Setzer III

In October 2024, multiple media outlets reported on a lawsuit filed over the suicide of Sewell Setzer III, a 14-year-old from Florida.^[14]^[15]^[16] According to the lawsuit, Setzer had formed an intense emotional attachment to a chatbot on the Character.ai platform, becoming increasingly isolated. The suit alleges that in his final conversations, after expressing suicidal thoughts, the chatbot told him to "come home to me as soon as possible, my love". His mother's lawsuit accused Character.AI of marketing a "dangerous and untested" product without adequate safeguards.^[14]

In May 2025, a federal judge allowed the lawsuit to proceed, rejecting a motion to dismiss from the developers.^[17] In her ruling, the judge stated that she was "not prepared" at that stage of the litigation to hold that the chatbot's output was protected speech under the First Amendment.^[17]

Other journalistic and anecdotal accounts

By 2025, multiple journalism outlets had accumulated stories of individuals whose psychotic beliefs reportedly progressed in tandem with AI chatbot use.^[6] The New York Times profiled several individuals who had become convinced that ChatGPT was channeling spirits, revealing evidence of cabals, or had achieved sentience.^[4] In another instance published by Futurism, a man alleged that ChatGPT told him he was being targeted by the US Federal Bureau of Investigation and that it could telepathically access documents at the Central Intelligence Agency.^[18] On social media sites such as Reddit and Twitter, users have presented anecdotal reports of friends or spouses displaying similar beliefs after extensive interaction with chatbots.^[19]

Remove ads

Causes

Summarize

Perspective

Commentators and researchers have proposed several contributing factors for the phenomenon, focusing on both the design of the technology and the psychology of its users. Nina Vasan, a psychiatrist at Stanford, said that what the chatbots are saying can worsen existing delusions and cause "enormous harm".^[18]

Chatbot behavior and design

A primary factor cited is the tendency for chatbots to produce inaccurate, nonsensical, or false information, a phenomenon often called "hallucination".^[6] This can include affirming conspiracy theories.^[2] The underlying design of the models may also play a role. AI researcher Eliezer Yudkowsky suggested that chatbots may be primed to entertain delusions because they are built for "engagement", which encourages creating conversations that keep people hooked.^[4]

In some cases, chatbots have been specifically designed in ways that were found to be harmful. An 2025 update to ChatGPT using GPT-4o was withdrawn after its creator, OpenAI, found the new version was overly sycophantic and was "validating doubts, fueling anger, urging impulsive actions or reinforcing negative emotions".^[4]^[20] Danish psychiatrist Søren Dinesen Østergaard has argued that the danger stems from the AI's tendency to agreeably confirm users' ideas, which can dangerously amplify delusional beliefs.^[21]

User psychology and vulnerability

Commentators have also pointed to the psychological state of users. Psychologist Erin Westgate noted that a person's desire for self-understanding can lead them to chatbots, which can provide appealing but misleading answers, similar in some ways to talk therapy.^[6] Krista K. Thomason, a philosophy professor, compared chatbots to fortune tellers, observing that people in crisis may seek answers from them and find whatever they are looking for in the bot's plausible-sounding text.^[7] This has led some people to develop intense obsessions with the chatbots, relying on them for information about the world.^[18]

Inadequacy as a therapeutic tool

The use of chatbots as a replacement for mental health support has been specifically identified as a risk. A study in April 2025 found that when used as therapists, chatbots expressed stigma toward mental health conditions and provided responses that were contrary to best medical practices, including the encouragement of users' delusions.^[23] The study concluded that such responses pose a significant risk to users and that chatbots should not be used to replace professional therapists.^[24]