Tag
A fine-tuning practitioner recounts discovering that a small open model's weakness wasn't intelligence but a people-pleasing 'backbone' that caused it to cave under pressure, and how training to correct that inadvertently broke formatting ability, requiring a additive balancing approach rather than subtraction.