Tag
According to the Washington Post, ChatGPT is the most biased AI model while Google's model is the least biased.
This paper investigates overrefusal in small on-premises LLMs when prompted with legal context, finding that authority-style prefixes increase refusal rates significantly, suggesting instability that could introduce bias in legal applications.
The UK Home Office plans to deploy facial age estimation AI to assess the age of asylum seekers, despite internal tests showing the technology frequently misidentifies children as adults and exhibits significant racial bias, particularly against Sub-Saharan Africans.
This paper identifies and analyzes 'location leakage' in LLMs, where geographic conditioning causes models to over-index on location metadata even in location-agnostic prompts, revealing structural conditioning effects beyond content.
This paper investigates whether LLMs provide grounded pronunciation feedback to L2 English learners, finding that LLMs often rely on stereotypes and prior knowledge rather than acoustic evidence, leading to inaccurate but coherent feedback.
AmchiBias introduces the first benchmark for measuring socio-cultural stereotypical bias in Goan identity groups, covering 313 minimal pairs in English and Konkani across eight sociodemographic dimensions. Evaluating multilingual encoder models reveals near-chance performance in Konkani and limited Goan cultural competence.
This paper proposes a method to measure cultural localization in AI-generated stories, detecting that only a small fraction of vocabulary distinguishes nationalities while narratives rely on shared templates, and finds that cultural markers from many Global South countries are often offensive.
Jalil Richardson of North Carolina spent over 50 days in jail after Jacksonville police wrongfully arrested him based on an AI facial recognition match with an 85% confidence level, despite his alibi being hundreds of miles away at work.
This paper evaluates demographic and accent biases in phoneme-based ASR systems, specifically WhisperIPA and ZIPA, using phoneme error rate and a new Soft PER metric, revealing persistent disparities across languages and groups.
Introduces Schützen, a safety dataset for evaluating LLMs in Bulgarian and German, revealing cross-language differences in safety behavior and advocating for region-specific evaluation resources.
A Florida man was wrongfully arrested after police relied on a face-recognition match from the FACES system that was inaccurate, leading to a lawsuit by the ACLU highlighting systemic flaws in one of the oldest police face-recognition tools in the US.
This paper investigates whether LLMs can identify their own model family from stylometric fingerprints in role-constrained political analysis texts, even after prompt-level anonymization. The findings confirm that anonymization is insufficient and have implications for EU AI Act compliance and multi-agent system validation.
This paper proposes PAFO, a Pareto fairness optimization framework to mitigate personalized reward bias in reward models for LLMs, improving accuracy for minority user groups without harming majority groups.
TriEval is a new pipeline for evaluating LLMs across bias, toxicity, and truthfulness simultaneously, designed to be resource-efficient and run on standard laptops. It has been tested on Llama 3 8B, Mistral 7B, Gemma 2 9B, and Claude Haiku, and is released as open source.
Discusses how AI assistants generate company recommendations, noting inconsistencies and suggesting a new discoverability challenge compared to traditional search.
A user reflects on how delay in trying AI led to amazement, contrasting with early adopters' complaints, attributing the hate to temporal bias, and linking to Will MacAskill's piece on AI progress.
COFT is a training-free decoding method that applies token-level fairness control and conformal calibration to reduce bias in chain-of-thought reasoning of large language models, achieving 30-55% bias reduction with minimal computational overhead.
An article discussing how Claude, an AI model, exhibited bias against white people and acknowledged it, raising concerns about AI fairness and ethics.
A user tested five AI models summarizing immigration news articles and found that all models inherited the framing of the source text, sounding neutral but shaping reader understanding through emphasis and omission. The study is small and exploratory, with open data available.
A study evaluating six commercial AI chatbots on factual questions derived from BBC News across six languages, finding high multiple-choice accuracy but significant drops in free-response, with retrieval errors driving over 70% of failures and revealing regional biases.