efficiency

The paper proposes optimizations to the Viterbi algorithm using the Hirschberg algorithm and constrained random walk, reducing memory usage from 140 GB to 5 MB and improving speed, enabling forced alignment to run on end-user devices for better scalability in speech processing.

This paper introduces a novel GRPO reward to improve abstention in large reasoning models on underspecified tasks, enhancing efficiency and human-like reasoning while maintaining performance.

Jev introduced on-the-fly compression for AI agents, which scores each tool call to retain important content and delete irrelevant data directly, eliminating the need for model-based summarization and making context compression faster and more lightweight.

The paper introduces Self-Improvement via Fast Tree-search (SIFT), a framework that uses an LLM-as-a-judge to efficiently evaluate self-modifications in coding agents, achieving better benchmark performance with significantly reduced CPU hours and API costs.

The article tests an AI model called Jev from TypeSafe AI, designed for fast, structured decisions rather than generation, aiming to improve efficiency in AI workflows by separating decision-making from general-purpose LLM tasks.

The article presents a benchmark comparison showing that Jev outperforms gpt-5.6-luna on 42 of 49 tasks with lower latency and cost, though it has limitations in text generation and certain reasoning aspects.

TypeSafe AI introduces Jev, a new AI model focused on typed decisions for software automation, offering calibrated confidence and significant improvements in speed and cost compared to traditional LLMs.

UltraTex is an efficient framework for high-resolution multi-view diffusion-based 3D texturing, introducing techniques to reduce redundancy and achieve significant speedups in training and inference.

Jev is presented as a transformative AI tool that optimizes decision-making for agents and LLMs, significantly reducing costs and improving efficiency, with a step-by-step roadmap for setup.

TypeSafe AI launches Jev, a System One Model optimized for automation, delivering 193.6x faster and 444.6x cheaper decision-making than traditional LLMs, with typed outputs and confidence estimates.

This paper introduces block parallelism and context-sharded block parallelism (CSBP) to efficiently train long-context diffusion language models, achieving significant throughput improvements and better performance on benchmarks like SWE-bench Verified.

Released a new dataset called DeepSWE-mini, a 16-instance subset of DeepSWE designed for efficient benchmarking of local AI models by replicating leaderboard rankings.

The author discusses a common bias in AI agent development where conversational tone is prioritized over message efficiency, advocating for hybrid models that minimize turns per resolution.

The article presents K2-Horizon-7B-Uno, a diffusion-augmented LLM that combines autoregressive and diffusion pathways to achieve 5200 tokens per second throughput without quality loss, with benchmarks showing competitive performance across various tasks.

The article discusses the implementation of an AI agent named Omni to handle employee requests in a broadcast media project, questioning whether it saves work by comparing structured forms versus AI interpretation, and highlights potential issues with agent-induced errors.

The article discusses why token usage escalates quickly in AI agents due to factors like system prompts and tool definitions, and inquires about effective techniques to manage token consumption.

RideWay introduces an efficiency-centered benchmark and the Efficiency Utility metric for evaluating tool-using language agents in ridehailing tasks, measuring success-gapped performance based on tool calls and user turns.

This paper proposes a dependency-aware trajectory refinement method for efficient multi-turn agent fine-tuning, improving accuracy and reducing inference costs.

Temperon is a training method that uses Sharpness-aware minimization (SAM) only in the final phase of training to achieve full SAM quality with a third less wall-clock time, validated on vision and language tasks.

Video DeltaNet presents a hybrid attention mechanism combining Softmax and linear attention to enhance efficiency in video generation models, achieving a 14.5x speedup over baseline methods.