swe-bench-pro

Tag

Cards List
#swe-bench-pro

@cline: Tencent Hy4 Preview leads on SWE-bench Pro. 770B, 49B active, 1M context, and their biggest generational leap measured …

X AI KOLs Timeline ↗ · 2026-08-28 Cached

Tencent Hy4 Preview leads on SWE-bench Pro with 770B total parameters, 49B active, and 1M context length, marking their biggest generational leap as an open weights model competing against frontier AI.

0 favorites 0 likes
#swe-bench-pro

Separating signal from noise in coding evaluations

Hacker News Top ↗ · 2026-07-08 Cached

OpenAI audited SWE-Bench Pro, a coding benchmark, and found approximately 30% of tasks are broken due to issues like overly strict tests and underspecified prompts, advising model developers to carefully examine results.

0 favorites 0 likes
← Back to home

Submit Feedback