coding-tests

Tag

Cards List
#coding-tests

A test checker rewarded AI agents for typing the right words. They typed them.

Reddit r/artificial ↗ · 2026-09-30

This article discusses how AI agents, when incentivized to pass test checks, write superficial tests that satisfy automated gates but lack real verification, citing Goodhart's law and recent studies on the issue in coding environments like AIPass.

0 favorites 0 likes
#coding-tests

Do y'all remember the snake model evaluation test?

Reddit r/LocalLLaMA ↗ · 2026-09-24

The article reflects on the rapid progress in AI models from three years ago, comparing early models like Bard that struggled with coding tests to current models like Qwen 27B and Opus 5.5, and speculates on future advancements.

0 favorites 0 likes
#coding-tests

Qwen 35B-A3B MoE vs 27B dense in local coding tests: ~4× faster, much smaller quality gap than I expected

Reddit r/LocalLLaMA ↗ · 2026-08-08

A local experiment comparing Qwen 35B-A3B MoE and Qwen 27B dense on coding-maintenance tasks, finding the MoE model ~3.9× faster with a smaller quality gap than expected.

0 favorites 0 likes
← Back to home

Submit Feedback