rlvr

Tag

Cards List
#rlvr

The Price of Reasoning: Cost-Quality Tradeoffs in Reinforcement Learning for Neural Machine Translation

arXiv cs.CL ↗ · 2026-07-22 Cached

Investigates the importance of reasoning traces in reinforcement learning for neural machine translation, showing that including reasoning during inference improves quality at the cost of increased computational demands.

0 favorites 0 likes
#rlvr

ISO: An RLVR-Native Optimization Stack

Hugging Face Daily Papers ↗ · 2026-07-21 Cached

This paper studies the optimization layer for reinforcement learning with verifiable rewards (RLVR), proposing Isospectral Optimization (ISO) — a fixed-spectrum framework that reuses base model weight spectra while optimizing input/output singular frames. ISO-Merger and ISO-AdamW achieve strong performance with fewer training steps on reasoning and coding tasks.

0 favorites 0 likes
#rlvr

H^2SD: Hybrid Hindsight Self-Distillation

Hugging Face Daily Papers ↗ · 2026-07-21 Cached

Introduces H^2SD, a hybrid hindsight self-distillation framework that improves RLVR by using the teacher model differently for successful and failed trajectories, achieving better reasoning performance.

0 favorites 0 likes
#rlvr

@ddkang: New research from Bridgewater AIA Labs, UIUC, and MIT: we prove what we believe to be the first non-vacuous generalizat…

X AI KOLs Timeline ↗ · 2026-07-20 Cached

Researchers from Bridgewater AIA Labs, UIUC, and MIT prove the first non-vacuous generalization bounds for reasoning LLMs trained with RLVR, providing provable accuracy lower bounds on unseen data to guide safe deployment.

0 favorites 0 likes
#rlvr

Beyond Entropy: Correctness-Aware Advantage Shaping via Contrastive Policy Optimization

Hugging Face Daily Papers ↗ · 2026-07-16 Cached

This paper introduces Contrastive Policy Optimization (CPO), which uses token-level contrastive disagreement between reference-guided and vanilla generation distributions for correctness-aware advantage shaping in reinforcement learning with verifiable rewards. CPO outperforms entropy-based RLVR methods on both in-domain and out-of-domain benchmarks.

0 favorites 0 likes
#rlvr

@bojie_li: Introducing RLVP, Penalize the Path, Reward the Outcome: a paper I collaborated with Noah Shi from University of Washin…

X AI KOLs Timeline ↗ · 2026-07-09 Cached

This paper introduces RLVP (Reward the Outcome, Penalize the Path), a reinforcement learning method that uses a verifiable penalty for path violations and outcome reward to achieve near-zero constraint violations with high task success, improving sample efficiency in real-world agentic environments.

0 favorites 0 likes
#rlvr

Reinforcement Learning for Evidence-Seeking Diagnostic Reasoning with Large Language Models

arXiv cs.AI ↗ · 2026-07-07 Cached

This paper proposes a reinforcement learning framework for evidence-seeking diagnostic reasoning using LLMs. The RL-trained 7B model outperforms larger models in multilingual clinical consultation tasks, showing that specialized RL can distill high-level clinical reasoning.

0 favorites 0 likes
#rlvr

@dair_ai: Highly-recommended read from MIT on the part of RL with verifiable rewards that everyone keeps hitting. RLVR only optim…

X AI KOLs Timeline ↗ · 2026-07-03 Cached

This paper from MIT proposes an adversarial generator-discriminator framework that combines verifiable rewards with a learned signal from human demonstrations to address issues like diversity collapse, unnatural responses, and reward hacking in RLVR training of language models.

0 favorites 0 likes
#rlvr

@tanayj: https://x.com/tanayj/status/2072766211256119475

X AI KOLs Timeline ↗ · 2026-07-02 Cached

This article explores the challenge of applying reinforcement learning to tasks that lack clear verifiability, citing Dario Amodei's prediction about achieving a 'country of geniuses in a data center' and discussing techniques such as RLVR, RLHF, Constitutional AI, and rubric-based rewards from Scale AI.

0 favorites 0 likes
#rlvr

RL Beyond the Verifiable (8 minute read)

TLDR AI ↗ · 2026-06-30 Cached

An analysis discussing the limitations of reinforcement learning with verifiable rewards (RLVR) in math and coding, and the challenge of extending RL to subjective or unverifiable tasks like planning or scientific discovery. It explores techniques such as RLHF and Constitutional AI as alternatives for alignment.

0 favorites 0 likes
#rlvr

Transferability for General Reasoning: An Automated Curriculum for Multi-Domain RLVR

Hugging Face Daily Papers ↗ · 2026-06-27 Cached

This paper proposes Transfer-Aware Curriculum (TAC), a bandit-style online curriculum for multi-domain RLVR that prioritizes domains whose updates benefit other domains using gradient-geometry alignment. TAC improves macro-averaged accuracy on Qwen3-1.7B and Llama3.2-3B over fixed and learnability-only curricula.

0 favorites 0 likes
#rlvr

@dwarkesh_sp: What does the next training paradigm look like? 0:00:00 – The big research bet the labs are making 0:02:12 – Grindabili…

X AI KOLs Following ↗ · 2026-06-26 Cached

A discussion on the next training paradigm for AI, covering research bets, grindability, RLVR, and a vision for 2027.

0 favorites 0 likes
#rlvr

Pigeonholing: Bad prompts hurt models to collapse and make mistakes

arXiv cs.CL ↗ · 2026-06-24 Cached

This paper introduces 'pigeonholing,' a phenomenon where bad prompts cause LLMs to collapse and repeat errors, leading to a 38-40% performance drop. Experiments across 10 tasks and 10 models show worsening with more conversation turns, and propose RLVR with synthetic errors as a mitigation.

0 favorites 0 likes
#rlvr

GraphPO: Graph-based Policy Optimization for Reasoning Models

arXiv cs.CL ↗ · 2026-06-18 Cached

GraphPO is a novel graph-based reinforcement learning framework that represents rollouts as a directed acyclic graph, merging semantically equivalent reasoning paths to reduce redundant exploration and improve credit assignment for large reasoning models.

0 favorites 0 likes
#rlvr

Sparsity Curse: Understanding RLVR Model Parameter Space from Model Merging

arXiv cs.LG ↗ · 2026-06-18 Cached

This paper investigates the 'sparsity curse' in merging RLVR (Reinforcement Learning with Verifiable Reward) models, finding that sparse updates cause near-orthogonal parameter directions that hinder aggregation, and proposes SAR-Merging, which uses Fisher information and sparsification to resolve conflicts and improve merging performance on math and coding tasks.

0 favorites 0 likes
#rlvr

@johnschulman2: PPO had a second wave in the LLM era for reasons unanticipated by the original paper - the importance-ratio objective f…

X AI KOLs Following ↗ · 2026-06-18 Cached

This paper reveals that the clipping mechanism in PPO and GRPO biases entropy in RLVR for LLMs: clip-low increases entropy, clip-high decreases it. The authors prove that standard clipping reduces entropy even with random rewards, and show that adjusting clip-low can prevent entropy collapse and promote exploration.

0 favorites 0 likes
#rlvr

We trained a cybersecurity-focused Mythos like LLM open weights on HuggingFace

Reddit r/LocalLLaMA ↗ · 2026-06-15

An open-source LLM called OpenMythos was trained for cybersecurity tasks using SFT and RLVR, with datasets available on HuggingFace. The model aims to reduce hallucinations and improve precision in security-related queries.

0 favorites 0 likes
#rlvr

CORA: Analyzing and bridging thinking-answer gap in Multimodal RLVR via Consistency-Oriented Reasoning Alignment

arXiv cs.CL ↗ · 2026-06-15 Cached

This paper analyzes the thinking-answer inconsistency in multimodal reinforcement learning with verifiable rewards (RLVR) for large vision-language models and proposes CORA, a method that introduces a consistency reward model and hybrid reward advantage splitting to improve faithfulness and task performance.

0 favorites 0 likes
#rlvr

ProcessThinker: Enhancing Multi-modal Large Language Models Reasoning via Rollout-based Process Reward

arXiv cs.CL ↗ · 2026-06-11 Cached

ProcessThinker introduces a practical post-training pipeline that provides step-level process rewards without training an explicit process reward model. It uses rollout-based rewards to give dense credit assignment for multi-step reasoning in multimodal LLMs, consistently improving performance on video benchmarks.

0 favorites 0 likes
#rlvr

@neural_avb: This post-training article came out earlier this year and completely flew under my radar. Highly recommended for my GRP…

X AI KOLs Timeline ↗ · 2026-06-06 Cached

A recommendation of a post-training article on GRPO/RLVR that was overlooked earlier this year, aimed at those interested in reinforcement learning from verifiable rewards.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback