llm-theory

Tag

Cards List
#llm-theory

Language Identification with Succinct Machine-Independent Traces

arXiv cs.CL · 2026-07-15 Cached

This paper addresses open questions in the Gold-Angluin model of language identification in the limit, showing that computational traces using only a small alphabet and defined directly from the language enable identification in the limit, without requiring an underlying machine model.

0 favorites 0 likes
#llm-theory

Prompting Complexity: Shortest Prompts for Texts and Behaviors in LLMs

arXiv cs.CL · 2026-07-08 Cached

This paper formalizes the concept of prompting complexity, which measures the shortest plausible prompt required for a fixed language model to produce a target text or behavior, drawing an analogy to resource-bounded Kolmogorov complexity.

0 favorites 0 likes
#llm-theory

On Distinguishing Capability Elicitation from Capability Creation in Post-Training: A Free-Energy Perspective

arXiv cs.AI · 2026-05-12 Cached

This paper proposes a framework to distinguish between capability elicitation and creation in large language model post-training using a free-energy perspective, arguing that supervised fine-tuning and reinforcement learning often reweight existing behaviors rather than creating new ones.

0 favorites 0 likes
← Back to home

Submit Feedback