MuScriptor: An Open Model for Multi-Instrument Music Transcription

Hugging Face Daily Papers Papers

Summary

MuScriptor is an open-source model for multi-instrument music transcription, capable of transcribing recordings into MIDI notes for each instrument without prior knowledge of the instruments present.

Existing methods for automatic music transcription are often limited to single-instrument recordings or fail on complex, real music mixes. Although previous work utilizes synthetic training data, the resulting models generalize poorly, leading to largely unusable transcription output in realistic, multi-instrument settings. In this work, we analyze the effectiveness of synthetic data for pre-training while combining it with fine-tuning on real music audio and post-training using reinforcement learning. We further introduce conditioning on instrument presence to customize transcriptions. Finally, we release MuScriptor, an open-weight multi-instrument music transcription model that works on real-world music recordings from across a diverse range of musical genres.
Original Article
View Cached Full Text

Cached at: 07/15/26, 04:22 PM

Paper page - MuScriptor: An Open Model for Multi-Instrument Music Transcription

Source: https://huggingface.co/papers/2607.08168 A joint project by Kyutai and MireloAI. MuScriptor is an open-source model for multi-instrument transcription to date. Give it a recording: pop, classical, metal, jazz, whatever, and it transcribes the notes played by every instrument into MIDI, without needing to know in advance what instruments are present.

We host MuScriptor at muscriptor.kyutai.org, where you can use the model to transcribe recordings, see and play back the transcription, and download it as MIDI. Since the model is open-source, you can also run it locally using the code in our GitHub repo.

Similar Articles