Tag
The author argues AI won't erase human taste: brains reward surprise while models gravitate toward the statistically common, so audiences will always move on before models catch up. The post surveys supporting research (Artificial Hivemind, RLHF diversity reduction, Billboard typicality studies) and honestly presents counter-evidence like LLM-generated research ideas and AI-preferred poems.
这篇论文提出了SPECTRUM，一种用于循环自蒸馏（Looped Self-Distillation）的近端谱调制方法，通过从固定参考锚点重新估计敏感损失的键/值几何结构，在代码生成中保留正确解的多样性，实验表明其在MBPP上保留了89.9%的初始AST解丰富度，显著优于普通自蒸馏。
This study adapts a human deliberation paradigm to large language models, finding that deliberation among diverse models reduces collective error and improves individual accuracy across multiple real-world domains, with diversity being crucial.
The article discusses a rule proposed by HeggieConnor at unifygtm, stating that when evaluating AI agents, the judging model should be from a different family than the agent's model to avoid mode collapse or groupthink.
The paper introduces 'Flawed in Nature, Perfect through Evolution', a mechanism where a swarm of mutated AI models collectively improves performance in changing environments, proven through theorems and validated on synthetic tasks.
This article presents Dwarkesh Patel's eight predictions for AI development in the era of continual learning, covering fundamental changes in safety regulation, alignment, model diversity, competitive dynamics, and business models.
This paper investigates whether stochastic sampling (self-consistency) in LLMs can capture cross-question structure similar to diverse ensembles. Using a Marchenko–Pastur test, the authors find that within a single model, stochastic variation yields at most one significant dimension, while an ensemble of 24 models yields four, revealing a dimensionality gap that limits self-consistency as an ensemble substitute.