embedding-noise

This paper analyzes noisy embedding techniques for instruction fine-tuning, explains why uniform noise outperforms Gaussian, and introduces SymNoise, a symmetric noise method that significantly improves LLaMA-2-7B performance on AlpacaEval over NEFTune.