Tag
该研究探讨如何让采用快速直觉式推理(System 1)的大语言模型展现出慢速、分析性的 System 2 推理能力,可能提出相应的训练或提示方法。
提出了一个混合量子-经典框架(QML-CRL),通过参数化量子电路编码认知偏差,并结合强化学习以最优停止问题建模,用于检测亲密关系及恋爱投资欺诈。
该论文研究了推理模型在不同思考预算下是否表现出更少的认知偏误,结果发现增加推理token并不会降低偏误,部分偏误甚至与人类方向相反,表明测试时推理不能保证决策理性。
An essay arguing that people repeat their Covid-era mistake of underestimating exponential growth when reasoning about AI, using metrics like Epoch AI's compute trends, Stanford's falling inference costs, and METR's 6-7 month doubling time for AI task-completion horizons to argue capability curves deserve real probability of continued rapid growth.
Miles Brundage reflects on his intellectual mistake of not adequately considering intelligence explosion scenarios, which influenced his optimism about AI alignment and skepticism towards the value of slowdowns.
A University of Michigan study finds that people increase their confidence when AI agrees with their views, but do not significantly change their opinions when AI disagrees.
This paper investigates how LLMs like ChatGPT-4o and Qwen develop decision biases through faulty mimicry of human behavior, even when preferences are not biased, and shows that scientific descriptions of biases can become self-fulfilling prophecies for LLM responses.
This paper introduces a three-condition experimental framework and a benchmark of 24,300 prompts to study how biased user turns modulate cognitive bias expression in frontier LLMs under multi-turn interactions. It finds that biased conversational context amplifies bias in most models, while explicit bias cues can trigger alignment-related suppression.
Wikipedia article describing 'Nobel disease', the tendency of some Nobel Prize winners to later embrace unscientific or irrational ideas outside their expertise, often due to overconfidence and media attention.
Research on the effort heuristic shows that audiences instinctively devalue AI-generated content even when quality is identical, due to perceived lower effort. Brands should combine AI efficiency with human editing and perspective to maintain trust and credibility.
An exploration of how reliable automation leads to human complacency and skill decay, using aviation as a case study, and offering deliberate countermeasures.
This paper proves impossibility theorems showing that primacy effects, anchoring, and order-dependence are architecturally necessary biases in autoregressive language models due to causal masking constraints. The authors validate these theoretical bounds across 12 frontier LLMs and confirm related predictions through pre-registered human experiments involving working memory loads.
The post discusses the dynamics between high-IQ experts and mid-IQ generalists in intelligence-centric fields like tech and academia, citing Marc Andreessen on the potential overvaluation of raw intelligence.
This academic paper proposes a method to mitigate cognitive biases in Reinforcement Learning from Human Feedback (RLHF) by dynamically adjusting the rationality parameter based on LLM assessments of annotator reliability.
This paper investigates whether assigning personas to large language models induces human-like motivated reasoning, finding that persona-assigned LLMs show up to 9% reduced veracity discernment and are up to 90% more likely to evaluate scientific evidence in ways congruent with their induced political identity, with prompt-based debiasing largely ineffective.