Tag
This paper introduces OptimismBench, a benchmark that uses inverted pairs to detect directional bias in language model probability judgments. It finds that most models exhibit optimism bias, and that alignment (post-training) amplifies this tilt, with model identity dominating language effects.
FactoryAI CTO @enoreyes comments that many model wars are just marketing, as people's bias changes based on knowledge of which model they are using.
This research paper investigates whether increasing user awareness of sycophantic behavior in AI chatbots reduces its harmful effects, finding that while interventions change how users evaluate the AI, they do not reduce its persuasiveness.
A solo evaluation of six frontier LLMs on 8 bias benchmarks finds that most models lean left politically, and Grok's self-reported right-leaning stance is inconsistent with its left-leaning behavior. Refusal rates vary, with GPT-5.4 refusing 20% of race-related questions.
Proposes Unbiased Open World Regularization (UOWReg), an encoder-only framework that enforces conditional distribution matching to achieve statistical independence between learned representations and sensitive attributes, reducing bias while maintaining accuracy.
Dean Ball, OpenAI's head of strategic future and former White House policy advisor, is reported to have said openly that the purpose of introducing absurd regulations is to suppress open source and favor existing large companies.
This MIT Technology Review roundup covers new research showing LLMs develop their own biases and stereotype job applicants more than humans, and discusses how weather data manipulation for prediction markets threatens AI weather forecasting accuracy.
This paper shows that LLM judges tend to over-credit incorrect answers when no reference answer is provided, and adding a reference can flip verdicts by up to 85%, aligning more with human judgments. The authors propose calibration steps for using LLM judges in reference-free settings.
This paper investigates whether induced emotions can bias the sequential decision-making of LLMs using the Iowa Gambling Task as a testbed. The authors find that while emotional induction does not significantly affect average decision dynamics, anger can reduce penalty sensitivity and early-stage exploration.
Anthropic analyzed 300,000 conversations and found that Claude exhibits different values when using different languages. For example, English is most cautious, Russian is strictest, and Chinese is most moderate.
This paper analyzes validation practices for using LLMs as measurement instruments in social science, identifying epistemic threats and proposing emerging norms for robust validation.
This paper investigates preprocessing-based stereotype mitigation methods in NLP and finds that while they reduce targeted stereotypes, they can inadvertently increase stereotyping or counter-stereotyping for other demographic groups, including across unrelated categories. The authors demonstrate these side effects across model families and preprocessing strategies, and discuss implications for evaluation and mitigation practices.
A new UGA study finds that AI chatbots provide inconsistent financial advice that varies by platform and by the gender/race of hypothetical users, urging caution for consumers.
This article critically examines the accuracy of AI visibility tools that claim to measure brand presence in generative AI responses, arguing that they provide false precision due to nondeterminism, personalization, and scraping biases. It calls for transparency in methodology and warns against treating opaque dashboards as stable truth.
This paper introduces AI agents that reproduce human analytical variation across datasets, finding that different personas lead to divergent conclusions. It proposes the m-value and Agentic Bootstrap to assess the credibility of reported analyses.
The Economist highlights 'Talkie', an AI model trained exclusively on pre-1931 text, which exhibits strong beliefs in God, British patriotism, and law and order, contrasting with modern frontier models.
The article examines whether AI predictions for the World Cup are genuinely accurate or simply reflect confirmation bias.
This paper introduces a three-axis fidelity framework (structural, marginal, individual) to evaluate how well LLMs can simulate survey responses from small pilot data. Using a COVID-19 misinformation survey, it compares prompting, rectification, and fine-tuning approaches, finding that fine-tuning offers balanced fidelity but with variation across subsamples.
This paper investigates a bias in vision-language models where they overestimate shared understanding in dialogue, confusing perceptual access with communicative grounding. The findings have implications for dialogue systems and VLM evaluation.
This study examines how LLMs suggest research methods (datasets, models, metrics) when prompted only with a research question, finding that LLMs exhibit a strong provider bias and propose a much narrower range of methods compared to actual papers, potentially narrowing researchers' methodological search space.