curriculum-learning

Tag

Cards List
#curriculum-learning

More Rules, Longer Lists? Benchmarking Self-Evolving Agents on a Hidden-Rule Curriculum

arXiv cs.AI ↗ · 2026-11-02 Cached

The paper introduces CLR-Bench, a benchmark curriculum of hidden rules for evaluating whether self-evolving LLM agents can learn latent rules from feedback, finding that most current self-evolution methods barely learn unless given a fixed lesson or a stronger base model.

0 favorites 0 likes
#curriculum-learning

Effectiveness of Curriculum Learning Depends on Reward Sparsity and Competing Optima

arXiv cs.LG ↗ · 2026-10-27 Cached

该论文构建了一个最小化的策略学习模型,从数学和数值上分析了课程学习在奖励稠密与奖励稀疏情形下的效果差异,发现课程学习在稀疏奖励且存在竞争性最优解时几乎是必需的。

0 favorites 0 likes
#curriculum-learning

ICLHerd: Herding-Based Data Selection for LLMs with In-Context Learning as a Proxy

arXiv cs.CL ↗ · 2026-10-21 Cached

ICCLHerd 提出一种基于 herding 的 LLM 训练数据选择框架,利用 von Mises–Fisher 核平衡 mode-seeking 与 mode-averaging,并以 in-context learning 作为验证代理进行超参数搜索,实验表明其优于现有数据选择算法。

0 favorites 0 likes
#curriculum-learning

Beating Warcraft III’s insane AI with self-play reinforcement learning on one desktop [P]

Reddit r/MachineLearning ↗ · 2026-10-18 Cached

An agent trained via self-play reinforcement learning on a single desktop (RTX 3090) achieves an 89% win rate against Warcraft III's hardest built-in AI, running the real unmodified game under Wine with a custom shim and harness, in 840,000 games over three weeks.

0 favorites 0 likes
#curriculum-learning

Learning When to Withdraw: Curriculum Coverage and Rule-Specific Failures in Fine-Tuned Language Agents

arXiv cs.AI ↗ · 2026-10-16 Cached

该论文研究了工具使用型语言智能体在监督微调下的「选择性撤回」行为,提出一种能发现聚合准确率所掩盖的规则级回归的诊断方法,并表明微调本身并不足以保证智能体安全。

0 favorites 0 likes
#curriculum-learning

From Failures to Learnable Worlds: Policy-Conditioned Environment Generation for Navigation Agents

Hugging Face Daily Papers ↗ · 2026-10-14 Cached

WEDGE 是一个弱点引导的导航学习框架,利用 LLM 从预训练策略的成功与失败轨迹中诊断失败模式,并据此生成针对性训练环境,在 ProcTHOR 和 HM3D 上显著优于随机与难例挖掘基线。

0 favorites 0 likes
#curriculum-learning

NV-Tesseract-AD: Curriculum-Enhanced Conditional Diffusion for Multivariate Time-Series Anomaly Detection

arXiv cs.LG ↗ · 2026-10-12 Cached

NVIDIA researchers propose NV-Tesseract-AD, a curriculum-enhanced conditional diffusion framework with a Transformer backbone for multivariate time-series anomaly detection, achieving ~3.7× F1 improvement over non-curriculum baselines and strong zero-shot transfer to EasyTSAD benchmarks.

0 favorites 0 likes
#curriculum-learning

AdaC-GRPO: Towards Mastering Long-Horizon Visual Sudoku Puzzles via Adaptive Curriculum Learning

arXiv cs.AI ↗ · 2026-10-12 Cached

AdaC-GRPO 使用基于在线 rollout 准确率的自适应课程学习动态构建训练批次,帮助 Qwen2.5-VL-7B 掌握长时程视觉 Sudoku 推理任务,并发布了细粒度基准 FG-Sudoku。

0 favorites 0 likes
#curriculum-learning

Algorithmic Scratchpads and Curriculum Staging for Arithmetic Reasoning in Tiny Transformers

arXiv cs.LG ↗ · 2026-10-08 Cached

The paper investigates how ~10.6M-parameter Tiny Transformers can learn multi-step arithmetic using algorithmic scratchpads and a hierarchical developmental curriculum, showing division accuracy rising from 4.0% to 86.7% while identifying failure modes like catastrophic forgetting and poor generalization to unseen operand sizes.

0 favorites 0 likes
#curriculum-learning

Useful to Whom? Sample Value Is Defined Only Relative to the Learner

arXiv cs.LG ↗ · 2026-10-03 Cached

该论文通过冻结选中子集并只更换训练学习器的受控实验,证明样本价值(以及 easy-first 与几何覆盖策略的 crossover budget)是相对于目标学习器定义的,而非数据的固有属性。

0 favorites 0 likes
#curriculum-learning

@robinfaro13: Learning is most effective at the frontier of capability: problems that are too easy or too hard teach nothing. For LLM…

X AI KOLs Timeline ↗ · 2026-10-02 Cached

Learning is most effective at the frontier of capability: for GRPO-trained LLM reasoners, problems that are always or never solved yield zero gradient. The authors introduce "Frontier Learning" to target this effective training regime.

0 favorites 0 likes
#curriculum-learning

AutoSynthData: Generating Training Data for Enterprise Agents

Hugging Face Blog ↗ · 2026-10-02 Cached

ServiceNow CoreAI introduces AutoSynthData, a pipeline that converts an enterprise agent model's failures and a stronger teacher's successes into feasible, realistic, and verified training tasks, illustrated with the EnterpriseOps Gym environment and released dataset.

0 favorites 0 likes
#curriculum-learning

StateTree: Enhancing Long-Term Dialogue Reasoning via Reinforcement Learning

arXiv cs.CL ↗ · 2026-10-01 Cached

StateTree 提出一种数据驱动的强化学习方法,通过构建树结构的路径追踪辅助任务来增强长对话推理,模型在 10K token 上训练即可泛化到 128K token,StateTree-14B 在 LongMemEval 上达到 59.00% 准确率,超过 QwenLong-L1-32B。

0 favorites 0 likes
#curriculum-learning

ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimization

Hugging Face Daily Papers ↗ · 2026-10-01 Cached

ActiveSaddler 通过将动态课程学习建模为非平稳多臂老虎机问题,实现了 LLM Agent 优化中训练场景课程与 harness 的协同进化,在 GAIA2 和 Terminal-Bench2.0 上分别提升了 4.4 和 7.5 个百分点的 Pass@1。

0 favorites 0 likes
#curriculum-learning

SFTMill: Easily [off-policy] distill any existing LLM with an OpenAI Compatible Endpoint. Turn any behavioral goal into a comprehensive dataset.

Reddit r/LocalLLaMA ↗ · 2026-09-30

SFTMill is an open-source tool that enables off-policy distillation of large language models using an OpenAI-compatible endpoint, allowing users to create training datasets from behavioral goals defined in a curriculum.

0 favorites 0 likes
#curriculum-learning

Feeding BabyLMs Macaroni: Code-Switching Curricula Cause Cross-Lingual Convergence

arXiv cs.CL ↗ · 2026-09-28 Cached

The paper explores using code-switched text to align representations in small language models under data constraints, demonstrating that a curriculum involving code-switching improves multilingual performance.

0 favorites 0 likes
#curriculum-learning

Fewer Tokens, More Self-Teaching: On-Policy Self-Distillation for Extreme Visual Token Reduction

Hugging Face Daily Papers ↗ · 2026-09-26 Cached

The paper proposes LT-OPD, an on-policy self-distillation framework for extreme visual token reduction in multimodal large language models, significantly improving performance under low token budgets while reducing KV-cache usage and FLOPs.

0 favorites 0 likes
#curriculum-learning

Adversarial Closed-Loop Curriculum for Evolving Role-Playing Agents

arXiv cs.AI ↗ · 2026-09-25 Cached

The paper proposes AdvRole, an adversarial closed-loop curriculum framework for training role-playing agents in large language models, which evolves scenario pools to improve performance on benchmarks.

0 favorites 0 likes
#curriculum-learning

Rethinking Length-Based Training: Batch Composition and Loss Normalization in Speech Token Language Models

arXiv cs.CL ↗ · 2026-09-23 Cached

This paper systematically analyzes length-based training in speech token language models, showing that short-to-long ordering has no independent benefit when batch composition and token exposure are fixed, and evaluates the impact of loss normalization.

0 favorites 0 likes
#curriculum-learning

Spatial-Interactor: Learning Spatial Reasoning through Interaction with the Observable Physical World

arXiv cs.AI ↗ · 2026-09-23 Cached

Spatial-Interactor is a framework that trains vision-language models to enhance spatial reasoning through interaction with the physical world, employing a three-level curriculum and two-stage training strategy to improve state transition modeling and long-horizon integration.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback