Libretto: Giving LLM Agents a Sense of Musical Structure
Summary
Libretto introduces a structured framework for symbolic music generation and revision using an LLM-native grammar and corpus-calibrated statistical evaluation across musical dimensions, enabling LLM agents to treat music as a measurable and editable object.
View Cached Full Text
Cached at: 06/23/26, 05:43 PM
Paper page - Libretto: Giving LLM Agents a Sense of Musical Structure
Source: https://huggingface.co/papers/2606.22708
Abstract
Libretto provides a structured framework for symbolic music generation and revision using LLM-native grammar and statistical evaluation across musical dimensions.
Generative music systems can now produce impressive audio from text prompts, but audio outputs are difficult to inspect, edit, and diagnose as musical structure. We introduce Libretto, an agent-facing framework forsymbolic music generationand revision. Libretto uses anLLM-native grammarwith explicitonset slots,voices, andbar-level organization, then evaluates each piece in acorpus-calibrated statistical spaceoverrhythm,harmony,melody,texture,form, andvariation. The same structural axes supportretrieval, diagnosis,copy-risk control, anditerative self-revision. Across gap filling, reference-guided full-piece generation, gradual morphing, and educational music generation, Libretto turns symbolic music from a raw token sequence into a measurable and editable object for language-model agents.
View arXiv pageView PDFProject pageGitHubAdd to collection
Get this paper in your agent:
hf papers read 2606\.22708
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2606.22708 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2606.22708 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2606.22708 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
Multimodal Music Recommendation System using LLMs
Proposes a multimodal framework integrating audio, lyric, and semantic signals with LLM-based sequential reasoning for session-based music recommendation, achieving up to 95% recall improvement over ID-only baselines.
I gave 6 frontier LLMs the same Bach MusicXML file and prompt. The results are all one-shot and unedited
A user tested six frontier LLMs on generating music from a Bach MusicXML file in a one-shot setting, presenting unedited results.
Audio perception layer for LLM agents, with a memory that grows through use
An experimental open-source framework that enables LLM agents to perceive and recognize non-speech audio events using local models (CLAP, Whisper, Silero VAD) and a growing concept memory. The system uses event-gated recognition, fingerprinting, and symbol-based reasoning, with no formal benchmarks yet.
Compositional Literary Primitives in Instruction-Tuned LLMs: Cross-Architectural SAE Features for Self, Style, and Affect
This paper characterizes compositional literary primitives in instruction-tuned LLMs using sparse autoencoders, discovering feature classes for self, style, and affect that enable emotion steering across two architectures.
FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs
Introduces FunAudioLLM, a model family that combines SenseVoice for multilingual ASR, emotion detection, and audio event detection with CosyVoice for natural speech generation, enabling enhanced voice interactions with LLMs through open-source models and code.