style-removal

Tag

Cards List
#style-removal

Tracing where LLM "slop" style comes from in the model and in training, and cutting it out [R]

Reddit r/MachineLearning ↗ · 2026-10-14

This research traces where recognizable LLM "slop" style (em dashes, "not X, but Y", lists of three, buzzwords) is represented in models and which training stage installs it, showing SFT introduces rhetorical structures and DPO doubles slop. It then removes slop via fixed-vector subtraction distilled into a rank-16 LoRA, cutting the slop score 83% without hurting QA performance.

0 favorites 0 likes
← Back to home

Submit Feedback