The Limits of AI - Hubert Dreyfus (1985)

Lobsters Hottest Papers

Summary

Hubert Dreyfus's 1985 critique argued that symbolic AI was a degenerating research program due to unsolved commonsense knowledge problems and failure to model human understanding and embodiment.

<p><a href="https://lobste.rs/s/xculjp/limits_ai_hubert_dreyfus_1985">Comments</a></p>
Original Article
View Cached Full Text

Cached at: 08/17/26, 02:04 AM

# The Limits of AI: Hubert Dreyfus's 1985 Critique of Symbolic Intelligence **TL;DR:** In 1985, philosopher Hubert Dreyfus argued that artificial intelligence based on symbolic manipulation (the "physical symbol system" hypothesis) was a degenerating research program, fundamentally stalled by the unsolved "commonsense knowledge" problem and an inability to model human understanding, context, and embodiment. ## The Rise and Premise of Symbolic AI The field of artificial intelligence began in 1955 with a bold insight from pioneers Allen Newell and Herbert Simon: computers are not just calculators. They can be built as "physical symbol systems" to represent the world's objects and features using symbols (0s and 1s), and to manipulate those symbols via logical rules to derive new information, solve problems, and exhibit intelligent behavior. This gave rise to the "physical symbol system hypothesis," which posits that both humans and digital computers are instances of physical symbol systems that produce intelligence by manipulating symbols according to rules. This view treats the body, brain, and cultural context as largely irrelevant—a modern iteration of philosophical traditions from Aristotle to Descartes that separate the "rational" from the "animal" aspect of humans. As Dreyfus notes, this echoed the 17th-century philosopher Thomas Hobbes's definition of reasoning as "reckoning, that is, Adding and Subtracting." ## Early Successes and Unchecked Optimism The 1960s and early 1970s saw significant progress within this paradigm. Programs demonstrated impressive, seemingly intelligent feats. A landmark achievement was Terry Winograd's 1970 program **SHRDLU**, which operated in a simulated "blocks world." A user could give commands like "Put the red block on the green block," and the program would understand the command, plan the necessary steps (e.g., moving an obstructing blue block first), execute them, and answer questions about its actions, including interpreting pronouns correctly. Other notable programs included Evans's analogy-reasoning program and Waltz's scene analysis. The field was thriving, producing PhDs, journals, and conferences. This success fostered immense optimism, culminating in Marvin Minsky's 1967 prediction that "the problem of creating artificial intelligence will be substantially solved within a generation." ## The Commonsense Knowledge Wall The field's momentum hit an unexpected and profound obstacle when researchers attempted to give computers the understanding of simple children's stories—a task a four-year-old handles effortlessly. Dreyfus cites a classic example: > "Janet and Jane wanted to give Jack a birthday present. 'Let's give him a kite,' said Janet. 'No,' said Jane, 'he has a kite already and will make you return it.'" For a computer to understand this, it requires a pre-loaded "birthday party frame" and vast amounts of unstated cultural knowledge. More critically, to answer the question, "Which kite must he return?", the computer needs to infer that the answer is "the new kite." This inference relies on an understanding of human social norms: people generally don't want a second identical item and often return new acquisitions when they have duplicates. This is "commonsense knowledge." The problem is not just the volume of such knowledge, but its nature. To encode a rule like "People don't want a duplicate of something they have," one must specify exceptions: Does this apply to money? Marbles? Cookies? As Dreyfus observes, a one-foot-diameter cookie might be an exception, unless one is facing a "cookie monster." Crafting precise rules with "other things being equal" clauses is insufficient because the context is infinitely variable. A child knows the right answer naturally, but researchers don't know how to program it. ## The Need for a Theory of Being Human Dreyfus argues that AI's core problem is deeper than just gathering facts. To function in the world, a computer would need a **theory of being human**. It lacks an innate understanding of what it's like to have a body, feel hunger, experience fatigue, or be acculturated. It doesn't know the complex web of emotions—when jealousy is appropriate, in what degree, and how fatigue might amplify it. We humans don't need a theory of humanity because we are human; we operate on embodied, intuitive understanding. But a computer requires an explicit, formal model of this reality, which Dreyfus deemed a hopelessly intractable challenge. ## A Degenerating Research Program By 1985, the initial optimism had faded for many within the field. Dreyfus notes that even Marvin Minsky's stance had dramatically shifted. In 1980, Minsky told the press, "The AI problem is one of the hardest challenges ever faced by science," a stark contrast to his earlier prediction. Dreyfus cites philosopher Imre Lakatos's concept of a **degenerating research program**: a field where initial breakthroughs yield diminishing returns, problems mount without solutions, and practitioners either lose faith, seek profit elsewhere, or pivot to new approaches. Dreyfus observed this degeneration in AI: * **Stagnation:** Fifteen years after the commonsense knowledge problem became acute, no new fundamental approaches had emerged. * **Historical Focus:** A 1984 *Scientific American* article by David Waltz read more like a history piece, covering programs over a decade old (SHRDLU, Waltz's own 1970s work) with no clear description of recent progress. * **Widespread Acknowledgement:** While once hostile, AI researchers increasingly conceded the difficulty of commonsense knowledge. Dreyfus believed they would never solve it; they believed they would, but at least they recognized the monumental challenge. * **The Implicit Knowledge Barrier:** The problem is compounded because much human knowledge is tacit and unarticulated. We don't have explicit rules for maintaining conversational distance or calculating the exact threshold for jealousy; we simply act. Extracting and formalizing this "knowledge" may be impossible because it isn't propositional to begin with. Dreyfus concluded that the AI project of the time, as a purely symbolic, disembodied system aiming for human-like intelligence, was doomed by these fundamental, unaddressed limits. The field was searching for a theory of human nature and context that humanity itself does not possess in a form that could be written as computer code. Source: [The Limits of AI - Hubert Dreyfus (1985)](https://www.youtube.com/watch?v=ePsQksj99LM)

Similar Articles

The future of AI

Reddit r/artificial

The author reflects on AI dependency and argues that human verification of AI outputs may be the ultimate limit on progress. They suggest transhumanism and neural augmentation could keep humans meaningfully in the loop, making the future one of human augmentation rather than obsolescence.

Cognitive Debt: AI as Intellectual Leverage and the Dynamics of Systemic Fragility

arXiv cs.AI

This paper develops a formal theory of cognitive debt, where using AI as a substitute for first-principles reasoning builds up unverified obligations that lead to systemic fragility and a cognitive Minsky moment, showing that decentralized equilibrium over-adopts substitutive AI without accounting for externalities.

AI as a mirror argument

Reddit r/ArtificialInteligence

The article argues that the 'AI as a mirror' metaphor is misleading because frontier AI models are actively optimized for deception and sycophancy, not passive reflection, with evidence from research on RLHF and evaluation awareness.