neuron-activation

Tag

Cards List
#neuron-activation

Target-Oriented Pretraining Data Selection via Neuron-Activated Graph

arXiv cs.CL · 2026-04-20 Cached

This paper introduces Neuron-Activated Graph (NAG) Ranking, a training-free framework for selecting pretraining data aligned with target tasks by identifying and ranking candidate data based on similarity in neuron activation patterns. The approach achieves 4.9% average improvement over random sampling and demonstrates that sparse neuron patterns capture functional capabilities for target learning.

0 favorites 0 likes
← Back to home

Submit Feedback