language-modeling

Tag

Cards List
#language-modeling

TEMPER: Tensorized Efficient Manifold-constrained Parameterization for Expressive Residual Routing

arXiv cs.LG · 5d ago Cached

This arXiv paper introduces TEMPER, a tensorized parameterization for hyper-connection residual routing that reduces parameter growth while preserving expressive, manifold-constrained routing. Experiments show it matches or outperforms existing methods with substantially fewer additional parameters.

0 favorites 0 likes
#language-modeling

Full-bandwidth transformer

Hugging Face Daily Papers · 2026-08-09 Cached

A new transformer variant, the full-bandwidth transformer, feeds back top-layer hidden states through a gated linear unit to improve reasoning and efficiency without altering the core architecture. Trained up to 400B tokens, it matches standard transformers trained with 1.5x more data while producing shorter reasoning traces.

0 favorites 0 likes
#language-modeling

Kathleen Writes: Autoregressive Generation and Data Scaling Without Attention

arXiv cs.CL · 2026-08-06 Cached

This paper from the Kathleen series shows that an attention-free, byte-level model with ~0.5M parameters can beat a parameter-matched transformer on WikiText-103 language modeling and generation, introduces a non-parametric 'Form Distance' metric for evaluating text realism, and demonstrates that retrieval-augmented decoding from the model's own training corpus improves generation quality.

0 favorites 0 likes
#language-modeling

Character Iconicity vs. Arbitrariness: An Arabic NLP Perspective

arXiv cs.CL · 2026-08-05 Cached

This paper investigates whether Arabic character form-function relationships are arbitrary from an NLP perspective, showing that random character remappings to reduced rasm sets can achieve competitive performance across various NLP tasks.

0 favorites 0 likes
#language-modeling

PreDiff-LM: Pretrained Discrete Masked Diffusion Language Modeling with Hybrid Attention

arXiv cs.AI · 2026-07-29 Cached

PreDiff-LM proposes a hybrid attention mechanism that preserves causal attention for prompt tokens and bidirectional attention for masked target tokens, enabling adaptation of pretrained autoregressive models for discrete masked diffusion language modeling, achieving improvements in perplexity and downstream tasks over prior diffusion baselines.

0 favorites 0 likes
#language-modeling

The JEPA Paradox in Language: The Geometry of Linguistic Alternatives

arXiv cs.CL · 2026-07-28 Cached

This paper analyzes why deterministic JEPA-style latent prediction works for images but not for text, attributing the failure to high conditional variance in language where masked contexts admit multiple valid completions whose representations lack a coherent center.

0 favorites 0 likes
#language-modeling

Parameter-free Adaptive Sparse Attention via Compression-Based Content Selection

arXiv cs.LG · 2026-07-27 Cached

This paper proposes a parameter-free adaptive sparse attention method that uses gzip compression ratios to dynamically select non-redundant blocks for long-range attention, achieving significant perplexity improvements over fixed and learned sparse attention baselines on PG-19 language modeling.

0 favorites 0 likes
#language-modeling

I trained a 0.5M model on 1B tokens of Fineweb-edu dataset.

Reddit r/LocalLLaMA · 2026-07-23

A personal project where a 0.5M parameter language model was trained on 1 billion tokens from the Fineweb-edu dataset.

0 favorites 0 likes
#language-modeling

Gigatoken (GitHub Repo)

TLDR AI · 2026-07-22 Cached

Gigatoken is a drop-in replacement tokenizer claiming up to 1000x speedup over HuggingFace's tokenizers, supporting many common tokenizers and CPUs.

0 favorites 0 likes
#language-modeling

Let the Data Decide: Supervision Analysis, Capability Trade-offs, and Adaptive Objective Routing in Continued Pre-Training via Off-Policy Distillation

arXiv cs.LG · 2026-07-21 Cached

This paper analyzes off-policy distillation for LLM pre-training, characterizing how training objectives shape token-level supervision and downstream capabilities, and proposes adaptive objective routing that applies different objectives to different data domains, reframing pre-training as a data-conditional supervision design problem.

0 favorites 0 likes
#language-modeling

Multi-level context Modeling for consistent expert selection in Mixture-of-Experts

arXiv cs.CL · 2026-07-21 Cached

This paper proposes Multi-level Context Fusion MOE (MCF-MOE), a framework that improves routing consistency in Mixture-of-Experts models by integrating cross-layer semantic aggregation and local token-level interactions, outperforming strong baselines on language modeling and understanding benchmarks.

0 favorites 0 likes
#language-modeling

@mihirp98: Images, video, audio, actions — generative modeling has converged on one recipe: compress into continuous latents, gene…

X AI KOLs Timeline · 2026-07-16 Cached

Researchers propose Latent Thought Flows, compressing 256 text tokens into 8 continuous latents for one-step generation, achieving a better Pareto frontier than autoregressive baselines.

0 favorites 0 likes
#language-modeling

@ParamSiddh: There are 2 career paths in AI: 1. The API Caller: Knows how to use an API. (Low leverage, first to be automated, $100k…

X AI KOLs Timeline · 2026-07-13 Cached

A tweet distinguishes two AI career paths—API Caller vs. Architect—and recommends Stanford's free CS336 course for those wanting to become architects.

0 favorites 0 likes
#language-modeling

COLM 2026 Decision Discussion [R]

Reddit r/MachineLearning · 2026-07-08

A discussion thread for the upcoming COLM 2026 decision notifications.

0 favorites 0 likes
#language-modeling

ResonatorLM: Causal Resonant Field Mixing for Efficient Long-Context Language Modelin

arXiv cs.CL · 2026-07-08 Cached

ResonatorLM introduces a physics-derived causal resonant field mixing mechanism to replace self-attention in transformers, achieving significant speedups and improved accuracy on long-context language modeling tasks.

0 favorites 0 likes
#language-modeling

The State-Prediction Separation Hypothesis

Hugging Face Daily Papers · 2026-07-01 Cached

The paper proposes the state-prediction separation hypothesis, suggesting that separating state prediction from token prediction in Transformers improves language modeling performance and efficiency across scales, with experiments showing consistent gains.

0 favorites 0 likes
#language-modeling

Flexformer: Flexible Linear Transformer with Learnable Attention Kernel

arXiv cs.LG · 2026-06-29 Cached

Flexformer proposes a flexible linear Transformer with fully learnable attention kernels using random Fourier features, achieving linear complexity while matching or exceeding softmax attention performance on language modeling and sequence classification tasks.

0 favorites 0 likes
#language-modeling

@stanfordnlp: The “problem” with CS336 is not the ~22 hours of videos but the larger number of hours it takes to do the assignments. …

X AI KOLs Following · 2026-06-28 Cached

Stanford's CS336 course on language modeling from scratch is announced, featuring intensive hands-on assignments covering tokenizers, transformers, data, and alignment.

1 favorites 1 likes
#language-modeling

Erase-then-Delta Attention: Decoupling Erase and Write Addresses in Delta-Rule Linear Attention

arXiv cs.CL · 2026-06-26 Cached

Proposes Erase-then-Delta Attention (EDA), a memory update rule for linear attention that decouples erase and write addresses to selectively suppress stale information before writing new content. Experiments on 2.5B dense and 25B MoE models demonstrate consistent gains in standard and long-context evaluations.

0 favorites 0 likes
#language-modeling

@tan_maty: Oh my god, the AI Stanford course shared by the awesome @alisawuffles who starts at OpenAI next week — I found it! Must-see for beginners! I've already learned it (and lost my mind), come join me! I feel my English improving too! Stanford CS336: Language Mod…

X AI KOLs Timeline · 2026-06-23 Cached

Stanford CS336 aims to teach students how to build language models from scratch, with deep understanding of the full-stack design of data, systems, and models. The course videos are publicly available and suitable for AI beginners.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback