layer-wise-analysis

Tag

Cards List
#layer-wise-analysis

Beyond Mean Attention: Diversity-Aware, Layer-Wise Scoring for KV Cache Eviction

arXiv cs.CL ↗ · 2d ago Cached

This paper introduces a diversity-aware, layer-wise scoring method for KV cache eviction in large language models, incorporating attention dispersion and redundancy to improve performance on LongBench datasets.

0 favorites 0 likes
#layer-wise-analysis

LaRA: Layer-wise Representation Analysis for Detecting Data Contamination in RL Post-Training

Hugging Face Daily Papers ↗ · 2026-05-28 Cached

LaRA is a layer-wise representation analysis framework that detects data contamination in RL post-trained LLMs by measuring geometric deviations across model layers, outperforming output-level baselines.

0 favorites 0 likes
#layer-wise-analysis

Geometry-Lite: Interpretable Safety Probing via Layer-Wise Margin Geometry

arXiv cs.LG ↗ · 2026-05-21 Cached

Introduces Geometry-Lite, a compact probe that analyzes layer-wise margin geometry to interpret how safety evidence forms across layers in LLMs, improving over single-layer probes while maintaining interpretability.

0 favorites 0 likes
← Back to home

Submit Feedback