Tag
VillanovaAI released the Villanova2 model family on Hugging Face, a collection of text-generation and vision-language models (2B and 15B-A3B variants) including base, instruct, VL, and GGUF versions.
DiRAFT synthesizes financial transcripts by sampling concept-graph plans from aggregate discourse priors rather than individual source passages, and empirically evaluates residual confidentiality risks on two financial corpora, finding stochastic sampling best balances transition fidelity and privacy.
HuggingModels 介绍 novel-humanize-4b:一个基于 Qwen3-4B 构建的 4B 模型,可将生硬的中文文本改写为自然、拟人化的文风,已获 756 次下载和 66 个点赞。
HemmingwayAI 释放了 Hemmingway-1.5,一个基于 Qwen 的 27B 参数微调模型,主打「不可检测的 AI」写作,宣称在各类 AI 检测器上 90% 的输出被判定为人类书写。
DiffuSpace 发布 Clover-35B-A3B-Preview,首个开源块扩散语言模型,采用 35B 参数 MoE 骨干(约 3B 激活参数)和 128K 上下文窗口,宣称在发布时达到开源扩散语言模型的最先进性能。
该论文提出一个结合人工整理词汇表与少量人类范文的框架,利用启用推理的LLM为极低资源乃至未见语言生成流畅文本,为合成数据自举提供了一条实用路径。
该论文研究了LLM生成内容在信息生态中的循环再利用问题,发现内容回流会使完整错误声明增加7.29个百分点,同时明确背书减少8.33个百分点,揭示了未被背书的错误细节如何在下游生成中持续存在。
The paper shows that steering vectors derived in one modality (text or image) transfer zero-shot to the other in unified multimodal models, revealing shared causal control mechanisms despite a modality gap, along with a geometric signature where transferable steering vectors point in similar directions across modalities.
The paper introduces Hierarchical Masked Diffusion Language Models (HMDLM), which incorporate position-level priority hierarchies into masked diffusion language models, achieving lower perplexity on LM1B and WikiHow and improved Sudoku solution accuracy over existing diffusion baselines.
论文揭示连续扩散语言模型(如ELF)因生成过程缺少逐步离散采样步骤而导致长尾词汇严重缺失(稀有词生成率仅为人类文本的0.30×),并提出训练无关的GRAFT方法,通过在模型未确定时提交稀有词再重新生成序列,将稀有词比例恢复至人类水平的0.82–1.10×。
该论文研究了在均匀扩散语言模型(UDLM)中循环早期 Transformer 层的方法,在不改变训练目标和采样器的前提下,以显著更少的训练 FLOPs 达到相同的验证 NLL,并在推理时降低生成困惑度。
Stanford HazyResearch 提出 Next-Concept Modeling (NCM),一种既非自回归也非扩散的粗到细并行文本生成方法,据称比强扩散基线快 10–31 倍且训练 tokens 更少;不过实验规模仅到 725M 参数,能否扩展至通用 LLM 规模仍待验证。
该论文提出了一种基于回归的元评估框架,用于评估多语言风格个性化文本生成中的自动指标,发现经过校准的简单字符串和嵌入指标在40种评估设置下可媲美LLM-judge。
Yohei Nakajima 转发介绍 Next-Concept Modeling (NCM):一种快速、并行、由粗到细的文本生成新范式,在摘要等下游任务上相比同规模扩散语言模型最快可达 31 倍加速。
PixText 将局部文本修正建模为像素空间的分组图像生成,仅生成目标区域并保留未编辑内容,借助 MeanFlow 实现四步快速生成,在新提出的 TextRefinementBench 上以 83.06% 的字形通过率大幅超越最强基线。
This paper proposes Seq-Drifting, a framework that learns a map from Gaussian noise to text in a single forward pass by applying drifting to sequences of continuous token representations, achieving a generative perplexity of 36.01 on LM1B with large speedups over few-step and multi-step diffusion language models.
Next-Concept Modeling (NCM) 提出一种 coarse-to-fine 两阶段框架,利用多尺度残差 VQ-VAE 将文本编码为层级离散码并逐层并行生成,在 LM1B、OpenWebText 与 XSum 上以 10-31 倍加速达到或超越最强扩散语言模型基线,并在 Sudoku 推理任务上显著优于自回归与扩散基线。
该论文提出在连续扩散语言模型训练中对条件提示词也加入噪声,而非保持干净,仅需修改训练目标一行代码,即在Sudoku Hard上将求解率从3.73%提升至24.65%,并显著提升生成多样性,同时在部分自然语言任务上带来可衡量的质量提升。
NVIDIA introduces Sigma, the first large-scale (3B/8B) continuous diffusion language model, which denoises Gaussian-corrupted token embeddings over steerable low-dimensional ODE/SDE trajectories, achieving performance parity with discrete diffusion and autoregressive models on math and coding benchmarks while enabling embedding-space steering for quality-diversity trade-offs and efficient few-step distillation.
Vercel announced that Jev is now available in the AI SDK for Python, demonstrating it with two experiments: real-time detection of Python versus English as users type, and step-by-step Python code generation one decision at a time.