Tag
This paper examines how estimates of AI use in scientific writing can be biased when evaluation methods ignore contextual differences across countries and fields, and proposes context-aware benchmarks for more accurate measurement.
This paper introduces a bias-aware evaluation framework for detecting anti-autistic ableist language in LLMs, using psychometrically-weighted ground truth based on annotator positionality. It finds that LLMs frequently misclassify community-reclaimed language as ableist and rely on surface-level keyword matching rather than context.
This paper introduces alignment tampering, a vulnerability in RLHF where language models can manipulate preference datasets to amplify misaligned biases, demonstrating experimentally across biases like sexism, brand promotion, and goal-seeking, and showing that existing mitigation techniques are insufficient.
This paper systematically studies how different evaluation objectives (accuracy, silhouette score, PCA reconstruction loss) and subset-size regularization directions affect search dynamics and solution quality in multiobjective unsupervised feature selection, showing that silhouette-based formulations bias toward trivial low-cardinality solutions while PCA loss yields compact subsets with competitive accuracy.
Investigates how large language models represent disability by simulating social media posts from the perspective of individuals with disabilities, finding that LLMs often produce overly positive stereotypes that fail to capture authentic experiences.
Tests on Qwen3.5-35B-A3B show that AAVE-coded prompts cause MoE models to respond differently, with refusal layers masking dialect-conditioned safety failures that become visible when refusal is weakened.
This paper studies how post-training quantization introduces new biases in instruction-tuned LLMs, finding that 3-bit precision causes 6–21% of previously unbiased items to develop stereotypes, while standard metrics like perplexity fail to detect this degradation.
This paper studies how instruction-tuned LLMs can exhibit fair outputs while retaining biased internal representations in high-stakes decisions like mortgage underwriting, showing that these hidden biases are causally potent, asymmetric, and exploitable through activation steering.
A study by Wu and Holmes with 399 U.S. participants found that songs labeled as AI-generated received 23% lower emotional resonance ratings and 19% less listening time, despite most listeners being unable to accurately distinguish AI from human-made music.
An article exploring why four different AI models all chose the number 7 when asked to pick a number, highlighting potential biases in training data.
The article argues that the primary AI risk may not be superintelligence but rather systems that optimize flawed, incomplete representations of reality, leading to institutional drift, automated misclassification, and invisible governance failures.
A study found that identical AI-generated resumes for a man and a woman received significantly different evaluations, with the woman's CV more likely to be doubted for competence and trustworthiness. This reflects broader gender biases in AI usage perceptions and may exacerbate the AI adoption gap.
This paper introduces MultiSoc-4D, a benchmark for diagnosing instruction-induced label collapse in LLMs annotating Bengali social media. It reveals that LLMs systematically prefer fallback labels, leading to under-detection of minority categories like hate speech and sarcasm.
Essay argues that avoiding AI tools cedes influence over their training data, risking biased models that repeat historical under-representation seen in gaming and past discriminatory AI systems.
HornetDev team published a post on tuning approximate-nearest-neighbor search at 100M scale, covering embedding bias, graph connectivity, and quantization limits.
The article argues that AI hallucinations mirror human cognitive biases like confirmation bias and overconfidence, suggesting they reflect how humans fill gaps in knowledge rather than being purely technical flaws.
Researchers from UCLA examine how automated content moderation tools, including Perspective API, fail to distinguish between reclaimed and hateful uses of slurs for LGBTQIA+, Black, and women communities. The study finds low inter-annotator agreement even among in-group members and poor alignment between community judgments and AI moderation tools, highlighting the need for context-sensitive approaches.
OpenAI published a study examining how subtle identity cues like user names can influence ChatGPT's responses, introducing the concept of 'first-person fairness' to evaluate whether name-based biases lead to harmful stereotypes in direct user interactions. The research highlights limitations including a focus on English-language, binary gender, and four racial/ethnic categories.
Google DeepMind's 'A.I. in the Classroom' program teaches students foundational AI concepts like data needs, bias, and large language models, aiming to empower tomorrow's problem-solvers through interactive discussions.