Tag
The content questions what key limitations in AI, such as long memory and context windows, are preventing the full automation of digital jobs despite advancements in frontier models.
This paper introduces 'context poisoning' as a phenomenon where attention interference degrades performance in long-context language models, deriving bounds showing evidence margin must scale with log of distractor count and proposing mitigations like evidence bottlenecks.
MiMo-V2.6-Flash-RL is a multimodal AI model that scales reinforcement learning for self-improvement, featuring a sparse mixture-of-experts architecture with 309B total parameters and 1M token context length.
StepFun's new Step 5 Preview model is tested as a coding agent, demonstrating competitive performance with models like GLM 5.3 and excelling in long-horizon tasks due to its effective stopping behavior.
TierKV proposes a predictive multi-tier KV caching framework to optimize memory usage and throughput for long-context LLMs on mobile devices, achieving significant performance improvements with minimal accuracy degradation.
Elastic Threshold Attention (ETA) is a trainable sparse attention architecture that improves long-context decoding speed without quality degradation by using dynamic thresholds predicted from query representations.
RBS-Attention introduces a training-free sparse-prefill method with dual-branch selection to mitigate mean dilution in long-context LLM inference, achieving up to 20.65× speedup on H100 GPUs while maintaining near-dense quality on benchmarks.
The paper proposes a method called DLD-RL to enhance deep research and long-context abilities in AI agents by repurposing reinforcement learning trajectories into long-context QA data, showing significant performance improvements on benchmarks.
An experiment demonstrated that a quantized Qwen 3.8 27B model, running locally on a single RTX 3090 GPU, autonomously pursued optimizing CUDA inference for over three weeks, producing functional kernels and benchmarks while maintaining coherent long-term goal-following.
Halogen version 0.12.0 fixes performance degradation at high context depths, showing improved decode and prefill speeds for Qwen3.8-Flash-Next at 1 million tokens of context on AMD Ryzen AI Max+ hardware.
Sherpa is an advanced fiction writing AI trained on 5.5 billion minutes of data, designed to solve long-horizon consistency in storytelling, outperforming existing models like ChatGPT and Claude.
The tweet asserts that AI agents now dominate inference traffic, with this trend expected to accelerate, leading to agents performing numerous tasks 24/7 and consuming vast amounts of tokens.
This paper introduces block parallelism and context-sharded block parallelism (CSBP) to efficiently train long-context diffusion language models, achieving significant throughput improvements and better performance on benchmarks like SWE-bench Verified.
Xing4.0-29B-A4B is a next-generation MoE large language model developed by China Telecom, featuring 29B total parameters with 4B active per token, native support for 256K context length, and optimization for Ascend NPU with agent-oriented architecture for complex engineering tasks.
ASPIRE is an asynchronous batched self-speculative decoding framework that enhances long-context LLM inference by enabling independent request scheduling and reducing attention staleness, achieving 1.70-4.58× speedup over baselines.
This paper proposes using state space models to efficiently select demonstrations for long-context language model prompts, reducing computational cost and improving performance.
This article analyzes the DeepSeek-V4.1 Flash model, detailing its technical report on KV cache compression and architectural optimizations that enable efficient long-context processing and high-speed inference.
Introduces DeepSeek-V4.1-Flash, a multimodal Mixture-of-Experts model with 552B parameters, featuring advanced KV cache compression techniques to reduce deployment costs and improve efficiency for long-context agent workloads.
A technique to offload the KV cache of Qwen3.8-Flash-Next to system RAM is demonstrated, allowing long-context inference with minimal decode slowdown by leveraging the model's efficient architecture.
This paper introduces techniques to manage memory peaks in training large Mixture-of-Experts models with long context lengths, including Pipelined LLEP, Ring-DTP, SCO, and OffloadStreamAdamW, which enable fixed GPU working sets and improve throughput up to 10.4x.