non-autoregressive

Tag

Cards List
#non-autoregressive

LuthorSQL: A One-Pass Text-to-SQL Model as System 1 for a Slower LLM Agent

arXiv cs.CL ↗ · 5d ago Cached

LuthorSQL presents a non-autoregressive 7B text-to-SQL model acting as a fast System 1 gate that escalates uncertain queries to a slower LLM agent, achieving 68.03% execution accuracy on BIRD while answering nearly half of queries locally and cutting API costs by 33.3% when cascaded with Claude Opus 5.5.

0 favorites 0 likes
#non-autoregressive

One-Step Text Generation by Seq-Drifting

arXiv cs.AI ↗ · 2026-10-12 Cached

This paper proposes Seq-Drifting, a framework that learns a map from Gaussian noise to text in a single forward pass by applying drifting to sequences of continuous token representations, achieving a generative perplexity of 36.01 on LM1B with large speedups over few-step and multi-step diffusion language models.

0 favorites 0 likes
#non-autoregressive

@lily_gpupoor: 𝐒𝐎𝐓𝐀 𝐓𝐕 interview with @aaron_lou at #COLM2026! he won the ICML Best Paper on diffusion LMs, then dropped out of …

X AI KOLs Following ↗ · 2026-10-10 Cached

SOTA TV 在 COLM 2026 采访了 Aaron Lou,他凭借扩散语言模型工作获得 ICML 最佳论文,随后从斯坦福博士项目退学加入 OpenAI,并分享了自回归+投机解码与扩散路线的对比,以及他对完全自我改进叙事的保留态度。

0 favorites 0 likes
#non-autoregressive

Tacit-TTS: From Autoregressive Decoding to Masked Prediction for Efficient Transcript-Free Voice Cloning

Hugging Face Daily Papers ↗ · 2026-09-29 Cached

Tacit-TTS 将 IndexTTS2 的自回归文本到语义解码替换为掩码非自回归生成,并结合免训练声学长度估计与 ReFlow 蒸馏,实现无需参考文本的零样本语音克隆,在超过 5 秒的语音上比 IndexTTS2 快 10 倍以上,同时支持跨语言及非语音(如婴儿咿呀学语、合成乱码)的参考音频克隆。

0 favorites 0 likes
#non-autoregressive

Laya: replace LLM-as-a-judge with a 322M-parameter decision engine (26,639 stars in 9 days, hands-on test)

Reddit r/LocalLLaMA ↗ · 2026-09-27 Cached

Laya is a 322M-parameter non-autoregressive decision engine designed to replace LLM-as-a-judge, providing fast and deterministic typed decisions without token generation, making it cost-effective for classification tasks.

0 favorites 0 likes
#non-autoregressive

I Built Non-Autoregressive Decision Models a Year Ago. Then a Frontier Lab Called It a "Breakthrough"

Lobsters Hottest ↗ · 2026-09-19 Cached

The author describes their earlier work on non-autoregressive decision models and criticizes a frontier lab for calling a similar concept a breakthrough, while announcing their own faster, open-source RL Agent model.

0 favorites 0 likes
#non-autoregressive

Laya the open source version of Jev

Hacker News Top ↗ · 2026-09-19 Cached

Laya is an open-source, fast multilingual decision engine that offers non-autoregressive, calibrated probabilities for structured schemas, claiming to be 6-8 times faster than Jev with full openness.

0 favorites 0 likes
#non-autoregressive

I literally built the Jev architecture one year back and completely open-sourced it with model, dataset and paper

Reddit r/LocalLLaMA ↗ · 2026-09-17

An individual claims to have developed and open-sourced a non-autoregressive AI architecture similar to Jev a year before its public announcement, expressing frustration over the lack of recognition and support from a frontier lab.

0 favorites 0 likes
#non-autoregressive

Efficient One-to-Many Translation with Joint Multi-Stream Diffusion

arXiv cs.CL ↗ · 2026-09-16 Cached

This paper proposes a discrete diffusion framework for efficient one-to-many machine translation, achieving sublinear latency scaling with the number of target languages and supporting zero-shot transfer to unseen source languages.

0 favorites 0 likes
#non-autoregressive

Affix Cache for Diffusion Large Language Models

arXiv cs.CL ↗ · 2026-08-28 Cached

ACache introduces a caching mechanism for Diffusion Large Language Models that selectively recomputes critical tokens to improve inference efficiency without losing accuracy.

0 favorites 0 likes
#non-autoregressive

Constrained CTC Decoding for Efficient Diacritic Restoration

arXiv cs.CL ↗ · 2026-07-22 Cached

This paper proposes a non-autoregressive CTC-based approach for speech-to-text diacritic restoration in Arabic, incorporating hard constraints during decoding to improve efficiency and reduce error rates.

0 favorites 0 likes
#non-autoregressive

FreyaTTS Technical Report

arXiv cs.CL ↗ · 2026-07-13 Cached

FreyaTTS is a compact, tokenizer-free Turkish-first text-to-speech model based on a non-autoregressive conditional flow-matching Diffusion Transformer, achieving state-of-the-art performance with a fraction of the parameters of larger systems and released under Apache-2.0.

0 favorites 0 likes
#non-autoregressive

Improved Large Language Diffusion Models

arXiv cs.CL ↗ · 2026-06-25 Cached

iLLaDA is an 8B parameter masked diffusion language model with fully bidirectional attention, trained from scratch on 12T tokens. It shows broad improvements over LLaDA and remains competitive with Qwen2.5 7B on several benchmarks. The model and code are open-sourced.

0 favorites 0 likes
#non-autoregressive

Diffusion Language Models: An Experimental Analysis

arXiv cs.AI ↗ · 2026-06-20 Cached

A systematic experimental analysis evaluating eight state-of-the-art Diffusion Language Models across multiple benchmarks, analyzing trade-offs between generation quality and computational efficiency.

0 favorites 0 likes
#non-autoregressive

Efficient Punctuation Restoration via Weighted Lookahead Scoring Method for Streaming ASR Systems

arXiv cs.CL ↗ · 2026-06-05 Cached

Proposes a non-autoregressive scoring method for punctuation restoration in streaming ASR that preserves the input transcript and outperforms prompt-based and fine-tuned baselines under a limited lookahead budget.

0 favorites 0 likes
#non-autoregressive

When Confidence Misleads: Suffix Anchoring and Anchor-Proximity Confidence Modulation for Diffusion Language Models

Hugging Face Daily Papers ↗ · 2026-05-27 Cached

Researchers propose a training-free method called Suffix-Anchored Confidence Modulation to improve confidence-based decoding in diffusion language models by addressing issues with EOT tokens and premature decoding.

0 favorites 0 likes
#non-autoregressive

Towards Closing the Autoregressive Gap in Language Modeling via Entropy-Gated Continuous Bitstream Diffusion

arXiv cs.CL ↗ · 2026-05-11 Cached

This paper introduces a diffusion language model that treats text as a continuous process over binary bitstreams, using entropy-gated stochastic sampling to close the performance gap with autoregressive models. It achieves state-of-the-art results on LM1B and OWT benchmarks while reducing memory footprint.

0 favorites 0 likes
#non-autoregressive

@__JohnNguyen__: Today we released the code for our CVPR 2026 paper, Flowception. Flowception bridges fully bidirectional sequence model…

X AI KOLs Following ↗ · 2026-05-09 Cached

Meta's FAIR team released the code for Flowception, a CVPR 2026 paper presenting a non-autoregressive video generation framework that interleaves frame insertion with continuous denoising to reduce error accumulation and computational cost.

0 favorites 0 likes
#non-autoregressive

Continuous Latent Diffusion Language Model

Hugging Face Daily Papers ↗ · 2026-05-07 Cached

Cola DLM is a hierarchical latent diffusion language model that uses text-to-latent mapping and conditional decoding to achieve efficient, non-autoregressive text generation.

0 favorites 0 likes
#non-autoregressive

CRoCoDiL: Continuous and Robust Conditioned Diffusion for Language

arXiv cs.CL ↗ · 2026-04-20 Cached

CRoCoDiL proposes a continuous and robust conditioned diffusion approach for language that shifts masked diffusion models into a continuous semantic space, achieving superior generation quality and 10x faster sampling speeds compared to discrete methods like LLaDA.

0 favorites 0 likes
← Back to home

Submit Feedback