depth-scaling

Tag

Cards List
#depth-scaling

DeepLoop: Depth Scaling for Looped Transformers

arXiv cs.LG · 2026-07-16 Cached

DeepLoop introduces a residual scaling method for looped Transformers that adjusts for parameter visits, improving stability and performance when physical blocks are reused across multiple rounds.

0 favorites 0 likes
#depth-scaling

The Complexity Ceiling Benchmark: A Multi-Domain Evaluation of Sequential Reasoning Under Depth Scaling

arXiv cs.AI · 2026-06-30 Cached

Introduces the Complexity Ceiling Benchmark (CCB) that evaluates LLM reasoning decay as the number of sequential steps increases across three domains. Finds a consistent geometric per-step decay and that all models collapse on transitive social logic within 5 steps, even with strong overall accuracy.

0 favorites 0 likes
← Back to home

Submit Feedback