User Over-Trust And Delusional Belief Formation From Brief Human-Software Interaction
Sources: 1 • Confidence: Medium • Updated: 2026-04-13 03:56
Key takeaways
- Very short exposure to a relatively simple computer program can induce powerful delusional thinking in otherwise normal people.
- The observation that brief exposure to a simple program can induce delusional thinking is attributed to Joseph Weizenbaum and dated to 1976.
Sections
User Over-Trust And Delusional Belief Formation From Brief Human-Software Interaction
- Very short exposure to a relatively simple computer program can induce powerful delusional thinking in otherwise normal people.
- The observation that brief exposure to a simple program can induce delusional thinking is attributed to Joseph Weizenbaum and dated to 1976.
Unknowns
- What specific evidence (study design, sample size, measures, and results) supports the claim that brief exposure to simple software induces delusional thinking?
- What are the boundary conditions for the effect (e.g., disclosures, UI framing, user intent, and interaction length) and does model complexity increase or decrease it?
- How should “delusional thinking” be operationally defined for monitoring in real deployments (short-term misbelief, persistent false belief, harmful actions)?
- Is there any direct decision-readthrough (operator, product, or investor) supported by this corpus beyond the general caution about user susceptibility?
- What should be monitored next (and with what metrics) to validate or falsify the claimed effect in modern chatbot-like systems?