layer-relevance

Tag

Cards List
#layer-relevance

Rethinking Layer Relevance in Large Language Models Beyond Cosine Similarity

arXiv cs.LG · 2026-05-15 Cached

This paper demonstrates that cosine similarity is a poor proxy for assessing layer importance in LLMs, and proposes using the actual accuracy drop from layer removal as a more robust metric.

0 favorites 0 likes
← Back to home

Submit Feedback