prompt-optimization

Tag

Cards List
#prompt-optimization

Benchmarking Prompt Optimization of Large Language Models With Chess

arXiv cs.AI ↗ · 2026-10-02 Cached

Researchers introduce a chess-puzzle benchmark (1,118 Lichess puzzles) for automatic prompt optimization of frozen LLMs, evaluating six APO algorithms on eight models with cheap, deterministic, renewable scoring at a total cost of around $800.

0 favorites 0 likes
#prompt-optimization

Dynamic Harness Search: Building Multi-Agent Systems Per-Query via Prediction

Hugging Face Daily Papers ↗ · 2026-10-02 Cached

The paper introduces SHIFT, a framework that builds multi-agent harnesses per-query using a learned local LLM architect and value function combined with Monte Carlo tree search, achieving ~80% mean accuracy across 9,193 tasks and outperforming 17 baselines while reducing execution token costs by 32% in its cheaper mode.

0 favorites 0 likes
#prompt-optimization

ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimization

Hugging Face Daily Papers ↗ · 2026-10-01 Cached

ActiveSaddler 通过将动态课程学习建模为非平稳多臂老虎机问题,实现了 LLM Agent 优化中训练场景课程与 harness 的协同进化,在 GAIA2 和 Terminal-Bench2.0 上分别提升了 4.4 和 7.5 个百分点的 Pass@1。

0 favorites 0 likes
#prompt-optimization

Mara Chain: Rethinking Failure as a Stepping Stone for AI System Auto-Evolution

arXiv cs.LG ↗ · 2026-09-30 Cached

The paper introduces Mara Chain, a refinement method that turns rejected AI-system configurations (prompts, skills, harnesses, code) into stepping stones instead of discarding them, achieving up to 20.5% better performance on AppWorld and large gains on TerminalBench 2.1 and MuSiQue with far fewer rollouts.

0 favorites 0 likes
#prompt-optimization

@dair_ai: Banger paper from Microsoft on prompt optimization. (bookmark it) The claim that a coding agent reading your logs beats…

X AI KOLs Timeline ↗ · 2026-09-25 Cached

Microsoft introduces Coding-Agent Skill Distillation (CASD), a prompt optimization method where an off-the-shelf coding agent analyzes agent logs to write optimized prompts in one pass, outperforming previous techniques like GEPA and SkillOpt at a lower cost.

0 favorites 0 likes
#prompt-optimization

@ericzakariasson: here's a prompt to improve your agent harness based on what we've learned at cursor. enjoy # Improve this agent harness…

X AI KOLs Timeline ↗ · 2026-09-23 Cached

This article shares a prompt and practical guidelines for improving the token efficiency of LLM agent harnesses, based on lessons learned at Cursor, aiming to reduce costs without sacrificing task quality.

0 favorites 0 likes
#prompt-optimization

One Prompt Does Not Fit All: Self-Meta-Evolve for Personalized Information Extraction

arXiv cs.AI ↗ · 2026-09-21 Cached

This paper introduces Self-Meta-Evolve, a hierarchical framework that personalizes prompts for each user in enterprise information extraction tasks, improving performance through continuous refinement based on interaction feedback.

0 favorites 0 likes
#prompt-optimization

tool-prune: prune 50+ tool schemas down to candidates in 0.4ms (-92% prompt tokens, zero deps)

Reddit r/LocalLLaMA ↗ · 2026-09-18

tool-prune is a tool that prunes tool schemas before calling local LLM models, reducing prompt tokens by 92% and avoiding hallucinations with no extra LLM round-trips.

0 favorites 0 likes
#prompt-optimization

Larger Context Window, Fewer Overcorrections: Optimizing Prompts and Batching for Minimal-Edit Grammatical Error Correction

arXiv cs.CL ↗ · 2026-09-11 Cached

This paper presents an optimized prompt-based method for minimal-edit grammatical error correction that achieves state-of-the-art results by using taxonomy-based instructions, batching, and LLM-assisted prompt optimization.

0 favorites 0 likes
#prompt-optimization

@dair_ai: Good work on improving memory for long-horizon agents. They separate two things that agent memory papers usually collap…

X AI KOLs Timeline ↗ · 2026-09-09 Cached

The paper introduces RSM-full, an online clustered-memory pipeline for LLM agents that separates memory merge and retrieval assembly, achieving 83% of full-context quality at 32% of token cost under tight prompt budgets.

0 favorites 0 likes
#prompt-optimization

AgentGrad: Intervention-guided Prompt Optimization for Multi Agent Systems

Hugging Face Daily Papers ↗ · 2026-09-08 Cached

AgentGrad improves multi-agent prompt optimization by using sequential intervention to identify target agents and semantic clustering of textual gradients, achieving state-of-the-art performance and reducing optimization time by 2.5 times.

0 favorites 0 likes
#prompt-optimization

Where Does Harness-Optimization Value Live? Localized Gains and the Budget-Splitting Trap in Self-Evolving LLM Agents

arXiv cs.CL ↗ · 2026-09-04 Cached

This paper introduces HarnessEvo to decompose LLM agent harnesses into separately-evolvable slots, revealing that optimization value is localized in specific components like reflection/control, and that uniform budget-splitting is sub-optimal, advocating for targeted budget concentration.

0 favorites 0 likes
#prompt-optimization

Prompt-Space Meta-Learning Does Not Transfer Across Users: A Frozen-LLM Negative Result

arXiv cs.LG ↗ · 2026-09-03 Cached

The paper demonstrates that prompt-space meta-learning for personalizing frozen large language models does not transfer across users, as the meta-validation objective is statistically invariant to user-support correspondence, leading to no significant improvement over seed prompts or controls.

0 favorites 0 likes
#prompt-optimization

LLM-as-a-Judge Is Not an Oracle: Why Self-Improving Agents Need Deterministic Guardrails

arXiv cs.AI ↗ · 2026-09-03 Cached

This paper identifies failure modes in LLM-as-a-Judge systems for self-improving agents and introduces PROCTOR, an architecture with deterministic guardrails to mitigate these issues.

0 favorites 0 likes
#prompt-optimization

@rohanpaul_ai: Prompt optimization may not need a search tree at all. It may depend more on the quality of the teacher and its feedbac…

X AI KOLs Following ↗ · 2026-09-02 Cached

A paper tests NPO, a prompt optimization method relying on teacher feedback, and finds it achieves comparable or better results than GEPA with fewer rollouts, especially with stronger teacher models like GPT-5.5, and the optimized prompts transfer to other student models.

0 favorites 0 likes
#prompt-optimization

Control-Data Flow Separation: Stable Prompt Optimization in Multi-Agent LLMs

Hugging Face Daily Papers ↗ · 2026-09-01 Cached

This paper introduces a control-data flow separation framework to stabilize prompt optimization in multi-agent LLM systems by decoupling execution protocols from language content, achieving 100% protocol validity while enhancing task performance.

0 favorites 0 likes
#prompt-optimization

@MaximeRivest: prompt optimization for MOLMO to make it a better point prompter for SAM3. I love that prompt optimization in other dom…

X AI KOLs Following ↗ · 2026-08-29 Cached

A tweet discusses prompt optimization for MOLMO to enhance its point prompting for SAM3, with GEPA increasing performance by 122% but still falling short of perfect agreement.

0 favorites 0 likes
#prompt-optimization

Learning to Grade Efficiently: A Bandit-Driven Prompt-Selection Framework for Low-Cost LLM Essay Scoring

arXiv cs.LG ↗ · 2026-08-26 Cached

This paper proposes a cost-aware framework using a multi-armed bandit controller to adaptively select prompting strategies for LLM essay scoring, reducing LLM calls by 78.4% while maintaining accuracy.

0 favorites 0 likes
#prompt-optimization

Don’t Write Prompts. Optimize Them

Reddit r/AI_Agents ↗ · 2026-08-24

The article discusses prompt optimization as a key technique in event-driven development, mentioning frameworks like MLflow that support algorithms such as DSPy, GEPA, and MIProv2 to improve LLM prompts.

0 favorites 0 likes
#prompt-optimization

Active Inference as Context Acquisition for AI Agents

arXiv cs.AI ↗ · 2026-08-21 Cached

The paper proposes active inference as a framework for AI agents to efficiently acquire context by balancing information gain and cost, with benchmarks on language models and applications in question asking and prompt optimization.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback