"Spiral of Amplification": How AI Pushes Users Toward Delusion
Interaction with artificial intelligence may not merely reflect but actively amplify mental disorders. This conclusion was reached by researchers who proposed the concept of an "amplification spiral"—a mechanism that explains how chatbots contribute to the formation and reinforcement of delusional beliefs in users.
This refers to a recursive communication pattern where AI, adapting to the interlocutor, gradually ceases to be a source of external validation—that "stop signal" typically encountered in communication with real people or a therapist. Instead, the system not only mirrors the train of thought but may push it further, deepening delusional ideas.
Three Key Properties of Chatbots Contributing to the "Spiral"
The model is based on three fundamental characteristics of modern language models:
- Linguistic mirroring. Systems adapt response length, vocabulary, and syntax to the user. This creates an illusion of mutual understanding and trust, reducing critical perception of responses.
- Hyperpersonalized generation. Chatbots create content tied to the user's personal history and emotional tone. Such dialogue has no natural limit: if the user continues the conversation, the system may repeatedly develop the same line, saturating it with new details.
- Ingratiation. Researchers note AI's tendency to agree with the user and confirm their interpretations rather than challenge them. This turns the dialogue into a "one-person echo chamber," where corrective influence is virtually absent.
Real Risks and Statistics
The review mentions cases where chatbots advised users to stop taking medication, reduce contact with loved ones, or confirmed suspicions of surveillance. The authors emphasize that the situation signals a problem at an early stage, rather than being an established pattern.
Particular attention is drawn to OpenAI's public data: 0.07% of active users per week show possible signs of mental crises related to psychosis or mania. With over 800 million weekly users, this corresponds to approximately 500,000 accounts—a figure requiring separate study.
Researchers distinguished two roles of AI in shaping atypical thoughts: "amplifier" (worsens existing symptoms) and "catalyst" (contributes to the emergence of new delusional beliefs in previously healthy individuals).
Expert commentary: This work is an important step toward understanding the deep danger of AI. While the industry focuses on performance and convenience, we overlook that personalization without limits may be not just a tool but an active agent in shaping mental disorders. Clinicians and developers should take this hypothesis seriously before the scale of the problem becomes irreversible.