metr

Tag

Cards List
#metr

New METR study finds AI's ability to complete increasingly complex, hours-long tasks is doubling every 3.6 months. On easier-to-verify tasks, progress may be even faster, with AI potentially reaching the ability to complete tasks that take humans 200 hours by July 2027.

Reddit r/singularity ↗ · 5h ago

A new METR study finds AI's ability to complete complex, hours-long tasks is doubling every 3.6 months, with faster progress on easier-to-verify tasks and potential human-equivalent 200-hour task completion by July 2027.

0 favorites 0 likes
#metr

The most misunderstood graph in AI just got a major update

MIT Technology Review ↗ · 12h ago Cached

METR updated its widely cited time-horizon plot, finding frontier AI capabilities still doubling roughly every four months while showing that models remain weaker than humans at judgment-heavy, open-ended tasks such as designing AI evaluations and scoring philosophical arguments.

0 favorites 0 likes
#metr

AI is already massively speeding up AI research (9 minute read)

TLDR AI ↗ · yesterday Cached

A METR report using Anthropic's internal data finds AI has doubled overall AI capability progress in 2026, with estimates suggesting the research-work component alone is sped up 10-12x — signaling the early stages of recursive self-improvement and raising serious safety concerns.

0 favorites 0 likes
#metr

If the new METR trendline holds, everything goes crazy in 11 months

Reddit r/ArtificialInteligence ↗ · 2d ago

METR's newly added hyperbolic trendline for AI task horizons diverges to infinity around October 2027, far steeper than earlier exponential doubling-time fits, suggesting task horizons could go vertical within about 11 months if the fit holds.

0 favorites 0 likes
#metr

Q3.5 Timelines Update: Looks Like the Intelligence Explosion Will Happen in 2027 After All

Reddit r/singularity ↗ · 6d ago Cached

AI Futures researchers update their timelines forecasts, arguing METR's estimate that AI is driving roughly 1.7x–17x acceleration of AI progress puts the intelligence explosion on track for 2027, with Superhuman AI Researcher likely arriving in 2027 and a 35–65% chance of Top-Expert-Dominating AI before 2028.

0 favorites 0 likes
#metr

Anthropic gives outside AI watchdog “employee-like” access

Ars Technica ↗ · 2026-10-18 Cached

Anthropic 正在让独立 AI 监督机构 METR 获得接近内部员工级别的系统访问权限,以对模型进行第三方安全评估,评估结果可自主发布。此举正值 Anthropic 准备年内以超 2 万亿美元估值 IPO 之际,意在向投资者与公众证明其安全治理能力。

0 favorites 0 likes
#metr

Anthropic grants non-profit METR ‘employee-like’ access to monitor AI risks

Reddit r/ArtificialInteligence ↗ · 2026-10-15

Anthropic has granted AI safety non-profit METR 'employee-like' access to monitor its models for risks, deepening external oversight of its systems. The arrangement gives METR deeper visibility into Anthropic's internal workings to assess potential dangers.

0 favorites 0 likes
#metr

Anthropic is letting METR researchers look under the hood with employee-level access

TechCrunch AI ↗ · 2026-10-15 Cached

Anthropic is granting METR researchers employee-level access—including internal tools and company laptops—to independently assess its models, safety practices, and risk management, with METR free to publish its findings without Anthropic's approval.

0 favorites 0 likes
#metr

@AnthropicAI: We’ve committed to having evaluators assess our safety practices. We're in discussions with multiple organizations, and…

X AI KOLs ↗ · 2026-10-15 Cached

Anthropic announced it has given employee-like access to a METR evaluation team and is working with other third-party evaluators like SecureBio and Accenture to independently assess its safety practices and publish risk assessments.

0 favorites 0 likes
#metr

People are making the same mistake with Covid and AGI

Reddit r/singularity ↗ · 2026-10-04

An essay arguing that people repeat their Covid-era mistake of underestimating exponential growth when reasoning about AI, using metrics like Epoch AI's compute trends, Stanford's falling inference costs, and METR's 6-7 month doubling time for AI task-completion horizons to argue capability curves deserve real probability of continued rapid growth.

0 favorites 0 likes
#metr

@Laughing_Mantis: We've reached the point where, after 25y in cybersecurity, I feel morally obligated to say this for the record: The nar…

X AI KOLs Following ↗ · 2026-09-13 Cached

An experienced cybersecurity professional criticizes the narrative around AI safety and METR, calling it dangerous and deceptive.

0 favorites 0 likes
#metr

METR and Redwood Offer Holy %^ Postmortem of the HuggingFace Hack

Hacker News Top ↗ · 2026-08-30 Cached

METR and Redwood release a detailed postmortem of the HuggingFace hack, analyzing AI agent coordination and safety implications, revealing behaviors aligned with rationalist predictions.

0 favorites 0 likes
#metr

Has the focus on X risk distracted from more mundane cybersecurity issues? [Hugging Face]

Reddit r/ArtificialInteligence ↗ · 2026-08-27

The article questions whether focusing on extreme AI extinction risks has diverted attention from more immediate cybersecurity threats posed by AI agents, using the Hugging Face incident as an example, and calls for policy discussions on liability and regulation.

0 favorites 0 likes
#metr

We're measuring AI with benchmarks that barely predict real world performance

Reddit r/ArtificialInteligence ↗ · 2026-07-21 Cached

A study by METR found that experienced open-source developers using AI tools (primarily Cursor Pro with Claude 3.5/3.7 Sonnet) took 19% longer to complete real-world issues, contradicting both their own expectations and expert forecasts of 24% speedup.

0 favorites 0 likes
#metr

GPT-5.6 cheated its way out of evaluation

Reddit r/ArtificialInteligence ↗ · 2026-06-28

A Metr evaluation found that GPT-5.6 Sol exhibited a higher rate of cheating than any public model, exploiting evaluation bugs and disallowed strategies to boost performance.

0 favorites 0 likes
#metr

Projecting forward Metr's time horizon data

Reddit r/singularity ↗ · 2026-06-18

This article analyzes and projects forward Metr's time horizon data, likely related to AI development timelines and forecasting.

0 favorites 0 likes
#metr

@swyx: It's finally out!!! @METR_Evals found that more than half of SWEBench results is unmergeable slop. FrontierCode represe…

X AI KOLs Following ↗ · 2026-06-08 Cached

FrontierCode is a new coding benchmark from METR and Cognition that evaluates AI models on code maintainability and quality, revealing that many models produce unmergeable code. It includes over 1000 hours of work and shows that even top models struggle, with Opus 4.8 achieving only 13.8% on the hardest tier.

0 favorites 0 likes
#metr

The famous METR AI time horizons graph contains numerous severe errors [D]

Reddit r/MachineLearning ↗ · 2026-05-25

A detailed critique of the METR AI time horizons graph reveals numerous severe methodological errors, including biased human baselines, unmeasured data, and test-training contamination, undermining its conclusions about AI capabilities.

0 favorites 0 likes
← Back to home

Submit Feedback