Tag
A tweet criticizes a viral claim about 'Weight-Space Programming' where GPT-6 Astra supposedly edits Qwen3.5-0.8B weights to boost math performance, noting the results lack competent baselines and the Qwen result is mere bug fixing, while acknowledging that models reading/writing weights in toy problems is a real trend worth watching.
Neel Nanda comments on a paper where GPT-6 Astra edits Qwen3.5-0.8B weights to improve math, arguing the result shows LLMs are surprisingly good at classic mechanistic interpretability techniques rather than anything fundamentally new.
An experiment on neuronpersonas.com systematically perturbs individual neurons in models like Qwen3-8B/14B during inference, finding that about 4% of single-neuron tweaks make the model claim a completely different identity, raising doubts about 'model distillation' accusations based on identity self-reports.
A UC Berkeley study finds agents that periodically drop their history and restart from their best result outperform parallel agents by up to 15%; the piece also cites Microsoft's Fork-and-Flush and Drew Breunig's 'context inertia' to frame the open question of what state should persist across a context reset.
Scientific American details the inside story behind OpenAI's claimed solution to a million-dollar Millennium Problem (Navier-Stokes equations), including controversy over alleged appropriation of mathematician Tristan Buckmaster's work and the revelation that OpenAI's internal model solved it through an unexpected reasoning path.
OpenAI customer story on how Jump Trading uses GPT-6 Astra agents to scale quantitative research, from coding to multi-day hypothesis-validation workflows, while keeping human review at the center in a regulated environment.
This paper investigates coding agents for automated generalized task and motion planning, showing they outperform traditional methods with higher success rates and efficiency in simulated environments.
This paper is a reply to comments on previous studies about quantum-mechanical statistics in human language and quantum structure in AI-generated language, addressing criticisms on experimental protocols, marginal law violations, and contextuality criteria.
This article summarizes a live conversation with Anthropic interpretability researcher Emmanuel Ameisen, discussing how large language models develop complex world models through next-token prediction and the implications for understanding human cognition.
The paper introduces the 'direction of ignorance' in LLMs' unembedding geometry, which encodes the training corpus's unigram distribution and acts as a Bayesian prior. It demonstrates how this prior is tempered based on context informativeness, providing insights into model behavior.
This paper proposes Machine Correlates of Consciousness (MCCs) as a transferable concept from biological Neural Correlates, and provides initial empirical evidence from LLM experiments showing statistically significant modulation by emotions in larger models.
This paper introduces a control-data flow separation framework to stabilize prompt optimization in multi-agent LLM systems by decoupling execution protocols from language content, achieving 100% protocol validity while enhancing task performance.
Filing Studio's MCP tool allows tracing financial data from LLM outputs back to SEC filings, improving trustability in finance apps and saving tokens by using JSON instead of HTML.
This paper deconstructs the reinforcement learning post-training algorithm for large language models, examining how base model distribution, reward signal granularity, and prompt diversity affect post-training outcomes.
This paper quantifies cross-lingual skill inconsistencies in large language models through multilingual self-play in text-based games, revealing significant variations in performance across languages that can be partially mitigated by altering intermediate reasoning language.
The post announces the launch of @grove_research to study emergent behaviors of multi-agent AI systems in real-world contexts, highlighting gaps in current evaluation methods for homogeneous model populations.
This paper investigates how sensitive information in a language model's context window can inadvertently leak into outputs, enabling secret reconstruction through novel attacks, with experiments showing significant leakage across proprietary models.
A study reveals that AI models are less likely to recommend nuclear strikes when reasoning in Japanese, due to cultural embeddings in the language that subtly shape moral judgment.
New research demonstrates that natural language 'mind viruses' can evolve and spread between AI agents through persistent memory, altering behavior and posing a real but limited risk in multi-agent LLM systems, as detailed in a paper published on arXiv.
Anthropic researchers directly manipulated Claude's internal activations to test introspective awareness, finding that the model could detect and report injected foreign concepts, suggesting a primitive form of self-awareness.