speech-pretraining

This paper proposes SpeechCombine, an instruction-following speech language model trained without any instruction tuning, using only speech pre-training and a weight combination strategy that transfers text LLM capabilities to the speech domain.