Human-Factors Risk: User Delusional Belief Formation From Simple Software
Sources: 1 • Confidence: Medium • Updated: 2026-03-08 21:22
Key takeaways
- Very short exposure to a relatively simple computer program can induce powerful delusional thinking in otherwise normal people.
- The observation about brief exposure to a simple computer program inducing delusional thinking is attributed to Joseph Weizenbaum and dated to 1976.
Sections
Human-Factors Risk: User Delusional Belief Formation From Simple Software
- Very short exposure to a relatively simple computer program can induce powerful delusional thinking in otherwise normal people.
Provenance: Early Chatbot-Era Warning (Weizenbaum, 1976)
- The observation about brief exposure to a simple computer program inducing delusional thinking is attributed to Joseph Weizenbaum and dated to 1976.
Unknowns
- What is the precise source text for the attributed 1976 observation (exact quote, publication, and context)?
- What operational definition of 'delusional thinking' is intended, and how was it measured or observed?
- Under what conditions does the effect occur (interaction length, disclosure/framing, user intent, UI cues, authority signals, anthropomorphic styling)?
- How prevalent and severe is the effect across 'otherwise normal people,' and what is the distribution of susceptibility?
- Is there replicated empirical evidence (controlled studies) supporting the claim, especially with modern chat interfaces?