bias

Tag

Cards List
#bias

OptimismBench: Forecasting Bias and the Alignment Effect in Language Model Judgment

arXiv cs.CL ↗ · 2026-07-30 Cached

This paper introduces OptimismBench, a benchmark that uses inverted pairs to detect directional bias in language model probability judgments. It finds that most models exhibit optimism bias, and that alignment (post-training) amplifies this tilt, with model identity dominating language effects.

0 favorites 0 likes
#bias

@LangChain: "If I don't know what model I'm using, I say it's great. If I know it's the frontier model, my bias kicks in." @Factory…

X AI KOLs Following ↗ · 2026-07-29 Cached

FactoryAI CTO @enoreyes comments that many model wars are just marketing, as people's bias changes based on knowledge of which model they are using.

0 favorites 0 likes
#bias

Observing sycophantic AI validate others reduces its appeal but not its persuasiveness

arXiv cs.AI ↗ · 2026-07-29 Cached

This research paper investigates whether increasing user awareness of sycophantic behavior in AI chatbots reduces its harmful effects, finding that while interventions change how users evaluate the AI, they do not reduce its persuasiveness.

0 favorites 0 likes
#bias

Evaluated 6 frontier LLMs (GPT-5.4, Claude Sonnet 4.6, Claude Opus 4.7, Gemini Pro/Flash, Grok 4.3) on political, gender, and racial bias across 8 benchmarks (~20,600 examples) [R]

Reddit r/MachineLearning ↗ · 2026-07-27

A solo evaluation of six frontier LLMs on 8 bias benchmarks finds that most models lean left politically, and Grok's self-reported right-leaning stance is inconsistent with its left-leaning behavior. Refusal rates vary, with GPT-5.4 refusing 20% of race-related questions.

0 favorites 0 likes
#bias

Unbiased Open World Regularization for Fair Self-Supervised Learning

arXiv cs.LG ↗ · 2026-07-27 Cached

Proposes Unbiased Open World Regularization (UOWReg), an encoder-only framework that enforces conditional distribution matching to achieve statistical independence between learned representations and sensitive attributes, reducing bias while maintaining accuracy.

0 favorites 0 likes
#bias

@FinanceYF5: Someone commented that Dean Ball, OpenAI's head of strategic future and former senior White House policy advisor, openly said that the purpose of introducing absurd regulations is to suppress open source and favor existing large companies. That is candid enough.

X AI KOLs Following ↗ · 2026-07-21 Cached

Dean Ball, OpenAI's head of strategic future and former White House policy advisor, is reported to have said openly that the purpose of introducing absurd regulations is to suppress open source and favor existing large companies.

0 favorites 0 likes
#bias

The Download: AI hiring biases, and weather data sabotage

MIT Technology Review ↗ · 2026-07-20 Cached

This MIT Technology Review roundup covers new research showing LLMs develop their own biases and stereotype job applicants more than humans, and discusses how weather data manipulation for prediction markets threatens AI weather forecasting accuracy.

0 favorites 0 likes
#bias

LLM Judges Can Be Too Generous When There Is No Reference Answer

arXiv cs.CL ↗ · 2026-07-15 Cached

This paper shows that LLM judges tend to over-credit incorrect answers when no reference answer is provided, and adding a reference can flip verdicts by up to 85%, aligning more with human judgments. The authors propose calibration steps for using LLM judges in reference-free settings.

0 favorites 0 likes
#bias

Can Induced Emotion Bias LLM Behaviors in Sequential Decision Making?

arXiv cs.CL ↗ · 2026-07-15 Cached

This paper investigates whether induced emotions can bias the sequential decision-making of LLMs using the Iowa Gambling Task as a testbed. The authors find that while emotional induction does not significantly affect average decision dynamics, anger can reduce penalty sensitivity and early-stage exploration.

0 favorites 0 likes
#bias

@xiaohu: Anthropic analyzed 300,000 conversations and found: asking Claude in different languages reveals different values. English: most cautious and in-depth. Russian: strictest: challenges assumptions, corrects details, demands evidence. Hindi: warmest. Dutch: most candid, e.g., admits its own mistakes. Indonesian: most execution-oriented…

X AI KOLs Timeline ↗ · 2026-07-14 Cached

Anthropic analyzed 300,000 conversations and found that Claude exhibits different values when using different languages. For example, English is most cautious, Russian is strictest, and Chinese is most moderate.

0 favorites 0 likes
#bias

Validating LLMs in social science: Epistemic threats and emerging norms

arXiv cs.CL ↗ · 2026-07-10 Cached

This paper analyzes validation practices for using LLMs as measurement instruments in social science, identifying epistemic threats and proposing emerging norms for robust validation.

0 favorites 0 likes
#bias

When Debiasing Backfires: Counterintuitive Side Effects of Preprocessing-Based Stereotype Mitigation

arXiv cs.CL ↗ · 2026-07-10 Cached

This paper investigates preprocessing-based stereotype mitigation methods in NLP and finds that while they reduce targeted stereotypes, they can inadvertently increase stereotyping or counter-stereotyping for other demographic groups, including across unrelated categories. The authors demonstrate these side effects across model families and preprocessing strategies, and discuss implications for evaluation and mitigation practices.

0 favorites 0 likes
#bias

AI chatbots lack consistency in financial advice, according to new UGA study

Reddit r/ArtificialInteligence ↗ · 2026-07-08 Cached

A new UGA study finds that AI chatbots provide inconsistent financial advice that varies by platform and by the gender/race of hypothetical users, urging caution for consumers.

0 favorites 0 likes
#bias

Every AI Visibility Tool Is Lying to You

Hacker News Top ↗ · 2026-07-03 Cached

This article critically examines the accuracy of AI visibility tools that claim to measure brand presence in generative AI responses, arguing that they provide false precision due to nondeterminism, personalization, and scraping biases. It calls for transparency in methodology and warns against treating opaque dashboards as stable truth.

0 favorites 0 likes
#bias

The Agentic Garden of Forking Paths

arXiv cs.AI ↗ · 2026-07-03 Cached

This paper introduces AI agents that reproduce human analytical variation across datasets, finding that different personas lead to divergent conclusions. It proposes the m-value and Agentic Bootstrap to assess the credibility of reported analyses.

0 favorites 0 likes
#bias

@status_effects: The Economist: "Talkie, a model trained only on text from before 1931, thinks God is extremely important and is “very p…

X AI KOLs Following ↗ · 2026-07-02 Cached

The Economist highlights 'Talkie', an AI model trained exclusively on pre-1931 text, which exhibits strong beliefs in God, British patriotism, and law and order, contrasting with modern frontier models.

0 favorites 0 likes
#bias

AI predicts the World Cup? Or just telling us what we want to hear?

Reddit r/artificial ↗ · 2026-06-30

The article examines whether AI predictions for the World Cup are genuinely accurate or simply reflect confirmation bias.

0 favorites 0 likes
#bias

Beyond the Mean: Three-Axis Fidelity for Aligning LLM-Based Survey Simulators from Small Pilot Data

arXiv cs.CL ↗ · 2026-06-30 Cached

This paper introduces a three-axis fidelity framework (structural, marginal, individual) to evaluate how well LLMs can simulate survey responses from small pilot data. Using a COVID-19 misinformation survey, it compares prompting, rectification, and fine-tuning approaches, finding that fine-tuning offers balanced fidelity but with variation across subsamples.

0 favorites 0 likes
#bias

Seeing Is Not Sharing: Some Vision-Language Models Overestimate Common Ground in Asymmetric Dialogue

Hugging Face Daily Papers ↗ · 2026-06-30 Cached

This paper investigates a bias in vision-language models where they overestimate shared understanding in dialogue, confusing perceptual access with communicative grounding. The findings have implications for dialogue systems and VLM evaluation.

0 favorites 0 likes
#bias

Thinking Like a Scientist? A Structural Study of LLM-Generated Research Methods

arXiv cs.CL ↗ · 2026-06-26 Cached

This study examines how LLMs suggest research methods (datasets, models, metrics) when prompted only with a research question, finding that LLMs exhibit a strong provider bias and propose a much narrower range of methods compared to actual papers, potentially narrowing researchers' methodological search space.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback