diversity

This paper proposes a method to automatically generate diverse user personas using large language models for testing interview dialogue systems, reducing manual effort and increasing variation in simulated user behaviors.

The paper introduces DIVE, a diversity-driven framework that enables frozen LLMs to self-improve by evolving persistent natural-language skills from task experience and verifier feedback, without parameter updates. It outperforms existing methods on math and logical reasoning tasks and transfers across model scales.

The paper argues that simply scaling multimodal environments does not always improve agent training, and proposes Ability-aware Environment Selection (AES) and Hierarchical Difficulty Curriculum (HDC) to better structure environment distributions along diversity and difficulty dimensions.

This paper systematically evaluates analogy diversity in ten LLMs, finding domain homogeneity and a trade-off between diversity and quality, with a mechanistic analysis of model internals.

Introduces a training-free Semantic-Aware Kernel Entropy (SAKE) guidance method for text diffusion models, using order-2 Rényi entropy over a kernel Gram matrix to balance fidelity and diversity during sampling. Experiments show improved Pareto frontier and multi-sample performance on reasoning-intensive tasks.

A critical reflection on whether using only three base models for millions of personal AI agents can produce genuinely diverse deliberation, arguing that correlated errors across models may create false unanimity and seeking operational metrics—drawn from ensemble learning—to measure true human representational diversity.

An article highlighting the often-overlooked contributions of women who worked on the computers used in the Apollo space missions.

A paper titled 'Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversity' has been accepted to ICML. It proposes a simple prompt-engineering trick for more diverse sampling, sparking debate over whether such work belongs at a top-tier ML conference.

LEMUR 2 introduces a large-scale dataset of over 14,000 neural network architectures and 750,000 training records across multimodal tasks, supporting NAS, AutoML, and deployment analysis.

Flow-ERD is a multi-agent traffic simulator that combines agent-type aware flow matching with entropy-regularized distillation to achieve both realistic and diverse motion patterns, ranking first on the WOSAC test benchmark.

A startup called Springboards has built Flint, an LLM trained to produce more diverse responses to overcome the groupthink problem in mainstream chatbots.

This paper introduces approach-level diversity for LLM math reasoning, showing that surface-level diversity metrics are unreliable proxies and that directly optimizing for approach diversity remains an open problem.

Proposes a multi-objective reinforcement learning framework combining semantic embeddings with Pareto-DQN to balance engagement, diversity, and fairness in recommendations, mitigating filter bubbles.

This paper introduces Spokes, a probabilistic diversification framework using the G-Vendi score to optimize diversity in pretraining data selection, achieving significant improvements in downstream task performance on FineWeb and DCLM by jointly optimizing quality and diversity.

This paper introduces a domain-agnostic multi-layered framework for unsupervised extraction of perspectives to evaluate pluralism in LLM-generated text, finding that rare perspectives are disproportionately underrepresented.

This paper introduces DiRL, a direction-aware reinforcement learning framework that distinguishes reasoning-driven diversity from memorization-driven diversity in LLM exploration. It extracts an internal reasoning-memorization direction from model representations and shapes rewards to prioritize reasoning-aligned exploration, showing improvements on math and general reasoning benchmarks.

This paper proposes an evolutionary framework inspired by parallel tempering that uses multi-temperature sampling and information exchange to improve the diversity and quality of scientific hypotheses generated by large language models, demonstrated across molecular, equation, and algorithm discovery.

This paper proposes MADS, a method that leverages neural activation states from LLMs to select diverse core sets for instruction tuning, showing that a 15% subset can outperform full-dataset fine-tuning on multiple benchmarks.

Palantir announces a Neurodivergent Fellowship targeting software developers, with compensation ranging from $110,000 to $200,000 per year.

This paper introduces Vector Policy Optimization (VPO), a reinforcement learning algorithm that trains LLMs to produce diverse solutions by optimizing across multiple reward dimensions, significantly improving test-time search performance compared to scalar RL baselines.