reward-model

Tag

Cards List
#reward-model

AVC-Reward: Event-Centric Audio-Video Consistency Evaluation

Hugging Face Daily Papers ↗ · 2026-10-15 Cached

AVC-Reward 提出一个事件中心的音视频一致性评估框架,通过可训练奖励模型在全局和谐、时间同步和属性对齐三个层面评估复杂多事件场景,并在与人类判断对齐上达到最先进水平,还可作为在线强化学习信号提升联合生成模型的一致性。

0 favorites 0 likes
#reward-model

TextVerifier: Seeing Beyond Recognition to Verify Chinese Text Rendering

Hugging Face Daily Papers ↗ · 2026-10-14 Cached

TextVerifier 提出了一种针对中文文本渲染缺陷的逐字符验证方法,利用表意文字描述序列(IDS)作为文本塔输入,并在 TextRenderBench-ZH 基准上达到 0.844 的 F1,显著优于 OCR 置信度、通用 VLM 和 TextPecker,还可作为 Flow-GRPO 后训练的逐字符奖励进一步降低渲染错误。

0 favorites 0 likes
#reward-model

SyncReward: Human-Aligned Synchronization Reward for Audio-Visual Generation

Hugging Face Daily Papers ↗ · 2026-10-12 Cached

SyncReward 提出了一套面向音视频生成的人体对齐同步奖励框架,包括 80K 专业同步评分数据集 SyncReward-Data-80K、1K 挑战基准 SyncReward-Bench,以及通过语义-时间对比预训练与人类监督训练的奖励模型,可作为评估指标并用于推理时 best-of-N 选择和强化学习后训练以提升音视频同步质量。

0 favorites 0 likes
#reward-model

Think Before You Score: Thinking Reward Model for Visual Generation

Hugging Face Daily Papers ↗ · 2026-09-29 Cached

This paper introduces the Thinking Reward Model (TRM) that explicitly formulates case-adaptive rubrics for evaluating visual generation, achieving state-of-the-art performance among open-source reward models.

0 favorites 0 likes
#reward-model

Robot Demos Are Easy. Reliability Is Hard — Jason Ma, Dyna Robotics [26:41]

Reddit r/singularity ↗ · 2026-09-27 Cached

Dyna Robotics addresses the reliability gap in robotics by combining a large-scale data pyramid, a specialized reward model, and iterative deployment to achieve near-perfect task performance, moving towards commercial-grade autonomy.

0 favorites 0 likes
#reward-model

We benchmarked 24 LLMs against human writers on 475 creative writing prompts

Reddit r/LocalLLaMA ↗ · 2026-09-18

A benchmark release comparing 24 LLMs to human writers on 475 creative writing prompts, using a custom reward model to show that frontier models outperform amateurs but not professionals.

0 favorites 0 likes
#reward-model

F$^{2}$DR: A Fine-Grained Full-Pipeline Reward Framework for DeepSearch Workflows

arXiv cs.CL ↗ · 2026-09-18 Cached

F2DR is a fine-grained reward framework designed to evaluate full-pipeline DeepSearch workflows in large language models, addressing limitations of existing reward models by assessing content, trajectory, and answer dimensions, and introducing DeepSearch RM-Bench for benchmarking.

0 favorites 0 likes
#reward-model

RynnValue: Scaling Robotic Value Foundation Models with Temporal Distance

Hugging Face Daily Papers ↗ · 2026-08-10 Cached

RynnValue introduces an open-source robotic value foundation model that uses temporal distance as a scalable supervision target for reward learning, surpassing preference-supervised state-of-the-art on RBM-EVAL-OOD and improving real-world policy success rates.

0 favorites 0 likes
#reward-model

Evaluation-Verification Reward for Consistent Multi-Reference Image Editing

Hugging Face Daily Papers ↗ · 2026-07-31 Cached

This paper introduces a Multi-dimensional Evaluation-Verification Reward (EVR) for reinforcement learning fine-tuning of multi-reference image editing models, improving visual consistency and harmony.

0 favorites 0 likes
#reward-model

VlogReward: Learning Multi-Dimensional Evaluation for Vlog Editing

arXiv cs.AI ↗ · 2026-07-28 Cached

Introduces VlogReward, a reward model for evaluating vlog editing plans across six dimensions, along with a large-scale dataset and benchmark, achieving state-of-the-art results against GPT-5 and Gemini-3-Pro.

0 favorites 0 likes
#reward-model

Codifying the Judge: Scalable Evaluation via Program Distillation

arXiv cs.AI ↗ · 2026-07-28 Cached

This paper introduces PAJAMA, a system that distills LLM-as-a-judge decision logic into programmatic judges, eliminating per-sample API costs while matching the performance of a 13B LLM judge, and providing transparency and efficiency improvements for scalable evaluation.

0 favorites 0 likes
#reward-model

How Fast Can Reward Models Score? A Systems Study of C++ and PyTorch Inference Runtimes for RLHF

Hugging Face Daily Papers ↗ · 2026-07-22 Cached

This paper presents a systems study comparing C++ and PyTorch inference runtimes for reward model scoring in RLHF pipelines, finding that ONNXRuntime provides speedups on CPU while torch.compile leads on GPU, with batching strategy mattering more than language or runtime.

0 favorites 0 likes
#reward-model

@sheriyuo: TRACE assigns dense credit at tool boundaries by asking a frozen reference model whether each new observation raises th…

X AI KOLs Timeline ↗ · 2026-07-16 Cached

TRACE is a dense credit assignment method for multi-turn agentic reinforcement learning that uses a frozen reference model to compute per-action rewards from log-probability changes at tool boundaries, eliminating the need for a critic or process reward model. It significantly improves long-horizon tool-use performance on benchmarks like BrowseComp-Plus.

0 favorites 0 likes
#reward-model

Read It Back: Pretrained MLLMs Are Zero-Shot Reward Models for Text-to-Image Generation

Hugging Face Daily Papers ↗ · 2026-07-13 Cached

This paper introduces SpectraReward, a training-free reward function that leverages pretrained multimodal large language models (MLLMs) as zero-shot reward models for reinforcement learning in text-to-image generation, demonstrating consistent improvements over prior methods.

0 favorites 0 likes
#reward-model

PEBS: Per-rater Empirical-Bayes Shrinkage for RLHF Reward-Model Calibration

arXiv cs.LG ↗ · 2026-06-29 Cached

Introduces PEBS, a per-rater empirical-Bayes shrinkage estimator for calibrating reward models in RLHF, reducing within-user RMSE by over 8.5% on PRISM and over 9.6% on PluriHarms.

0 favorites 0 likes
#reward-model

TuneJury: An Open Metric for Improving Music Generation Preference Alignment

Hugging Face Daily Papers ↗ · 2026-06-15 Cached

TuneJury is an open-source pairwise reward model for text-to-music generation that provides calibrated preference scoring and generalizes across multiple downstream applications.

0 favorites 0 likes
#reward-model

@neural_avb: Locally generating GRPO-like rollouts with my SLM, and using this tiny RM as the rubric. Next I'll be RL training on fr…

X AI KOLs Timeline ↗ · 2026-06-11 Cached

Neural_avb releases a lightweight Answer-eq Reward Model for RL training on QA tasks, claiming 80% agreement with external judge LM and faster than F1/ROUGE/BertScore.

0 favorites 0 likes
#reward-model

From Long News to Accurate Forecast: Importance-Aware Fusion and PRM-Guided Reflection for Time Series Forecasting

arXiv cs.AI ↗ · 2026-06-03 Cached

This paper introduces a framework for time series forecasting that uses importance-aware news compression and process reward model-guided retrieval to incorporate long news articles within fixed context limits, improving prediction accuracy across finance, energy, traffic, and Bitcoin benchmarks.

0 favorites 0 likes
#reward-model

Predicting Inference-Time Scaling Gains from Labeled Validation-Set Output Statistics

arXiv cs.CL ↗ · 2026-06-03 Cached

This paper introduces a method to predict best-of-N inference scaling gains for language models using cheap statistics from a single labeled validation-set sampling pass. A compact predictor with three core features achieves Spearman ρ=0.90 with actual gains, enabling screening of configurations before expensive reward-model scoring.

0 favorites 0 likes
#reward-model

Latent Reward Steering: An Adaptive Inference-Time Framework that Implicitly Promotes Cognitive Behaviors in Reasoning LLMs

arXiv cs.AI ↗ · 2026-06-02 Cached

Introduces Latent Reward Steering (Lrs), an adaptive inference-time framework that uses sparse autoencoder latent states and a learned reward model to implicitly promote cognitive behaviors like verification and backtracking in reasoning LLMs, improving performance across multiple models and benchmarks.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback