Tag
DMAIC-Bench 提出「自我克制」(self-restraint)能力评测,包含 15 个工业案例共 97 个任务及配对反事实变体,发现 13 个模型在 NO-GO 决策上的执行路由准确率平均仅 19%,远低于 GO 决策的 92%。
该论文提出一个通用框架,将数据驱动的行为发现、分析与实验研究相结合,用于理解大模型驱动智能体在轨迹中的行为组织方式,并以迭代自我反思为例说明发现、依赖学习与提示对比如何相互作用。
作者构建了一个名为 MAVIS 的个人 AI 助手,能够自行编写工具与子代理,并通过自我反思探索和扩展知识库,同时注重确定性、安全性和可观测性,现征求社区对其设计的反馈。
Emochi is a voice journaling app that turns voice notes into a generative character reflecting your emotional world, with instant transcription to help users spot emotional patterns. Built by a doctor, a designer, and two AI engineers, it offers private, non-clinical self-reflection grounded in affective science.
MemAdapter提出一个反事实适应框架,通过反事实推理、上下文感知反思和证据驱动推理三个组件,缓解LLM智能体长期记忆引发的谄媚问题,在多个基准上提升记忆可靠性。
NVIDIA researchers found that having an AI agent draft multiple command options and letting a strong judge model select the best one before acting can raise terminal-agent success rates from 50% to 68% without any retraining.
Doom or Bloom is a tool that helps users explore and map their personal AI worldview by answering simple questions.
Aks.ai is an AI-powered personal companion designed for guided self-reflection, helping users process thoughts and gain insights in a private, judgment-free space.
ViCo is a training framework that uses iterative self-reflection to improve AI-generated chart replication, achieving performance close to proprietary LLMs on academic benchmarks.
MASkills presents a continual learning framework that optimizes multi-agent LLM systems through agent skills, using skill-conditioned credit assignment and hierarchical aggregation to improve performance on tasks like HotpotQA and GAIA.
A controlled ablation study of LLM self-reflection in conflict forecasting finds that typed action routing drives performance gains, while diagnostic scaffolding and taxonomy vocabulary add no measurable value, with replication on GPT-4o.
A paper finds that self-reflection loops like Self-Refine and Reflexion do not beat repeated sampling at equal token cost across open models from 1.5B to 7B, with all 18 self-inspection comparisons negative.
LA-RL introduces a label-aware self-reflection framework for reinforcement learning in information extraction, achieving consistent improvements on named entity recognition, relation extraction, and event extraction tasks with gains of up to 20 F1 on out-of-distribution benchmarks.
Lessons from building autonomous AI agents that trade on-chain memecoins unsupervised, highlighting that execution reliability matters more than model cleverness, self-reflection beats larger context, and hard guardrails are essential.
A critique of naive AI agent architectures that rely solely on system prompts, arguing that probabilistic LLMs require self-reflection layers and deterministic gating to ensure reliable production behavior. The author introduces Langoedge as a solution for building trustworthy agents.
A user shares a surprising experience with Fable, an AI tool that analyzed their entire work history and provided deep personal insights, surpassing therapy.
BaRA is a framework for site-level web data collection combining bounded BFS traversal with history-based self-reflection, outperforming existing methods on link discovery and downloadable extraction.
The post discusses the confirmed research finding that verifier-based test-time compute scaling dominates verifier-free methods, with practical examples like Apodex showing gains from separate verification processes. It argues that building independent verifiers is a key path for future AI capability improvements.
Explains why self-reflection ReAct loops fail on long-horizon tasks and introduces the AgentOS verification architecture as a solution.
MetaResearcher proposes a framework for training deep research agents using self-reflective reinforcement learning in adversarial virtual environments, addressing limitations of static environments and fact-retrieval-only tasks.