smooth-aggregation

Tag

Cards List
#smooth-aggregation

RIMS: Preference Optimization via Smoothed Multi-pair Aggregation for Small-Scale LLM Retrieval-Augmented Generation

arXiv cs.CL · 2026-07-21 Cached

This paper proposes RIMS, a three-stage preference optimization framework for small-scale language models in retrieval-augmented generation, using synthetic chain-of-thought data and a differentiable soft aggregation mechanism to improve robustness against noisy evidence. Experiments show consistent gains over baselines on multi-hop QA benchmarks.

0 favorites 0 likes
← Back to home

Submit Feedback