semantic-reward

Tag

Cards List
#semantic-reward

Conceptizer: Next-Token Prediction Is Not All You Need

arXiv cs.CL ↗ · 2026-10-27 Cached

提出 Conceptizer 训练框架,通过约 9K 个基于上下文同义词构建的概念词表,在 next-token prediction 之外增加意义层面的奖励信号,在 Llama 3、Qwen2.5 和 Falcon3(1B-8B)上提升了困惑度与下游知识/情感任务表现。

0 favorites 0 likes
#semantic-reward

Calibrating LLMs with Semantic-level Reward

arXiv cs.CL ↗ · 2026-05-18 Cached

Proposes CSR, a framework that calibrates LLMs directly in semantic space using a novel semantic calibration reward, reducing ECE by up to 40% and improving AUROC by up to 31% over verbalized-confidence baselines across multiple datasets.

0 favorites 0 likes
#semantic-reward

Reinforcement Learning with Semantic Rewards Enables Low-Resource Language Expansion without Alignment Tax

arXiv cs.CL ↗ · 2026-05-15 Cached

This paper proposes using reinforcement learning with semantic rewards (via GRPO) to expand LLMs to low-resource languages without the typical alignment tax of catastrophic forgetting, showing improved semantic quality and transferability over supervised fine-tuning.

0 favorites 0 likes
← Back to home

Submit Feedback