If an AI can't decide what to want, can it ever be truly conscious?
Summary
This opinion piece argues that true machine consciousness hinges not on how well an AI pursues assigned goals, but on whether it can develop desires no one designed it to have, distinguishing human self-directed purpose from LLM optimization.
Similar Articles
Why couldn't AI be conscious?
The author questions the intuitive arguments against AI consciousness and suggests that there is no fundamental theoretical barrier preventing machines from becoming self-aware.
The scary question for me isn't whether AI is conscious ... it's whether we were ever as deep as we assume
The article argues that the debate over AI consciousness distracts from a more unsettling possibility: human selfhood may be thinner than assumed, as AI trained on personal writing can replicate patterns convincingly enough to fool acquaintances.
How to Navigate Uncertainty About AI Consciousness
This paper addresses the ethical dilemma of treating potentially conscious AI and proposes shifting focus to assessing AI valence as a more tractable approach for responsible development.
Do you see AI as “aware” without seeing it as "conscious"?
An LMU Munich-led study published in Cognition found that while people rate AI as more conscious when it responsively reacts to its environment, a persistent gap remains: even the most responsive AI is judged less conscious than the least responsive human. Judgments using the term 'awareness' showed a much smaller gap than judgments using 'consciousness', suggesting people tie consciousness to subjective experience rather than behavior.
A Philosophical Addendum to the Debate on AI and Consciousness
This essay develops a four-tier taxonomy of mental states to clarify AI's consciousness, arguing that AI lacks self-consciousness but has awareness and consciousness within conversations, and proposes architectural conditions for its development.