outlier-removal

Tag

Cards List
#outlier-removal

Structured Pruning of Large Language Models via Power Transformation and Sign-Preserving Score Aggregation with Adaptive Feature Retention

arXiv cs.CL ↗ · 2026-07-10 Cached

This paper proposes a structured pruning method for LLMs that addresses distribution mismatch, sign-information loss, and outlier influence when adapting unstructured pruning techniques, achieving comparable accuracy with 1.56-1.57x speedup on models like Llama-3-8B and Vicuna-v1.5-13B.

0 favorites 0 likes
← Back to home

Submit Feedback