diversity

Amazon and UCF researchers introduce SatisDive, a training-free inference-time method that formulates text-to-image generation as satisficing—requiring each candidate to meet a reward floor and the batch to meet a diversity cutoff—showing that varying the reward floor traces a Pareto frontier between worst-candidate reward and batch diversity, and that SatisDive Pareto-dominates FK steering on Pick-a-Pic with FLUX.1-dev and SANA-1.6B.

The paper proposes using Generative Flow Networks (GFlowNets) to generate diverse synthetic expert conversations for post-training LLMs, avoiding the mode collapse seen in prompting and reward-based synthesis, with stronger downstream outcome-prediction results across tutoring and emotional-support dialogues.

This study investigates whether post-training makes LLMs funnier, finding it improves humor but reduces response diversity across multiple models and training stages.

Clément Delangue humorously suggests he might be a diversity pick in a tech-related context, with a link to further information.

The paper investigates the conditional diversity gap in large language models by comparing the entropy of generated outputs with training data and proposes an information-theoretic framework to measure and mitigate this gap.

This paper proposes a method to automatically generate diverse user personas using large language models for testing interview dialogue systems, reducing manual effort and increasing variation in simulated user behaviors.

The paper introduces DIVE, a diversity-driven framework that enables frozen LLMs to self-improve by evolving persistent natural-language skills from task experience and verifier feedback, without parameter updates. It outperforms existing methods on math and logical reasoning tasks and transfers across model scales.

The paper argues that simply scaling multimodal environments does not always improve agent training, and proposes Ability-aware Environment Selection (AES) and Hierarchical Difficulty Curriculum (HDC) to better structure environment distributions along diversity and difficulty dimensions.

This paper systematically evaluates analogy diversity in ten LLMs, finding domain homogeneity and a trade-off between diversity and quality, with a mechanistic analysis of model internals.

Introduces a training-free Semantic-Aware Kernel Entropy (SAKE) guidance method for text diffusion models, using order-2 Rényi entropy over a kernel Gram matrix to balance fidelity and diversity during sampling. Experiments show improved Pareto frontier and multi-sample performance on reasoning-intensive tasks.

A critical reflection on whether using only three base models for millions of personal AI agents can produce genuinely diverse deliberation, arguing that correlated errors across models may create false unanimity and seeking operational metrics—drawn from ensemble learning—to measure true human representational diversity.

An article highlighting the often-overlooked contributions of women who worked on the computers used in the Apollo space missions.

A paper titled 'Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversity' has been accepted to ICML. It proposes a simple prompt-engineering trick for more diverse sampling, sparking debate over whether such work belongs at a top-tier ML conference.

LEMUR 2 introduces a large-scale dataset of over 14,000 neural network architectures and 750,000 training records across multimodal tasks, supporting NAS, AutoML, and deployment analysis.

Flow-ERD is a multi-agent traffic simulator that combines agent-type aware flow matching with entropy-regularized distillation to achieve both realistic and diverse motion patterns, ranking first on the WOSAC test benchmark.

A startup called Springboards has built Flint, an LLM trained to produce more diverse responses to overcome the groupthink problem in mainstream chatbots.

This paper introduces approach-level diversity for LLM math reasoning, showing that surface-level diversity metrics are unreliable proxies and that directly optimizing for approach diversity remains an open problem.

Proposes a multi-objective reinforcement learning framework combining semantic embeddings with Pareto-DQN to balance engagement, diversity, and fairness in recommendations, mitigating filter bubbles.

This paper introduces Spokes, a probabilistic diversification framework using the G-Vendi score to optimize diversity in pretraining data selection, achieving significant improvements in downstream task performance on FineWeb and DCLM by jointly optimizing quality and diversity.

This paper introduces a domain-agnostic multi-layered framework for unsupervised extraction of perspectives to evaluate pluralism in LLM-generated text, finding that rare perspectives are disproportionately underrepresented.