model-performance

Tag

Cards List
#model-performance

Real downsides of Strata?

Reddit r/LocalLLaMA ↗ · 2026-10-13

A community discussion about the real-world downsides of the Strata model, comparing its performance in agentic workloads against Qwen 27B and other quantized models on llama.cpp, with mixed reports on quality loss versus speed gains.

0 favorites 0 likes
#model-performance

@xuanwo: OpenAI's marketing hasn't actually changed at all; the only difference is that the models are no longer number one, so …

X AI KOLs Timeline ↗ · 2026-10-04

A commentator argues OpenAI's marketing strategy hasn't changed—only its models' dominance has waned—and that the company should focus on building better models rather than rhetoric.

0 favorites 0 likes
#model-performance

Has Claude Opus 5.5 Actually Been Nerfed? What the Last Three Days Show

Reddit r/artificial ↗ · 2026-10-04 Cached

分析了用户关于 Claude Opus 5.5 被“削弱”的说法:截至 2026 年 10 月 4 日没有公开证据表明 Anthropic 在权重层面降低了模型能力,性能波动更多与推理配置、系统指令及服务基础设施等多层因素有关。

0 favorites 0 likes
#model-performance

Gemini 4 Argon (High): Intelligence, Performance and Price Analysis

Hacker News Top ↗ · 2026-09-30 Cached

Artificial Analysis发布Gemini 4 Argon (High)的评测分析,涵盖其在Intelligence Index v4.3.2及各项能力基准(如AA-Briefcase、AA-Omniscience等)上的智能与性能表现。

0 favorites 0 likes
#model-performance

Can we get some quality control on all these model perf posts?

Reddit r/LocalLLaMA ↗ · 2026-09-28

A community member expresses frustration with low-quality model performance posts and advocates for stricter standards, including detailed context for reproducibility and quality evaluation.

0 favorites 0 likes
#model-performance

Opus 5.5 (high) improves on Opus 5 (high) 3.5 → 3.8 on the Short-Story Creative Writing Benchmark, just behind Fable 5.1 (high) and Opus 5 (xhigh).

Reddit r/singularity ↗ · 2026-09-28

The article reports on the latest scores from the Short-Story Creative Writing Benchmark, showing improvements in AI models like Opus 5.5, Grok 4.7, and Gemini 3.8 Flash, with a leaderboard covering 56 models and over 100,000 evaluator judgments.

0 favorites 0 likes
#model-performance

This is fun. I finally got to follow up on a RemindMe comment. Back on March 25 of this year, six months ago, no model was getting even 1% on ARC-AGI-3. A commenter asked if we could see 75% at $2 cost. Well, the cost is still high ($26.1k), but GPT-6-Astra-Max was able to get 62.7% (no harness!)

Reddit r/singularity ↗ · 2026-09-25

GPT-6-Astra-Max achieved 62.7% on the ARC-AGI-3 benchmark within six months, and with a memory adapter, the benchmark is saturated, though costs remain high, indicating a trend toward cheaper AI models.

0 favorites 0 likes
#model-performance

Opus 5.5 just surpassed the professional human baseline on a benchmark testing whether AI can write complete scripts with the right voice, substance, pacing, hooks and minimal AI slop

Reddit r/singularity ↗ · 2026-09-24

The Opus 5.5 AI model has surpassed professional human writers on a benchmark evaluating script quality, including voice, substance, pacing, and minimal AI-generated errors.

0 favorites 0 likes
#model-performance

@cline: Gemini 3.8 Flash is free in Cline. It scores 41 on the Artificial Analysis Intelligence Index, the highest of any model…

X AI KOLs Timeline ↗ · 2026-09-24 Cached

Gemini 3.8 Flash is available for free in Cline, scoring 41 on the Artificial Analysis Intelligence Index, the highest in its price tier, and outperforming models like GPT-5.6 Luna and DeepSeek v4.1 Flash.

0 favorites 0 likes
#model-performance

Vals AI RSI Index: Opus 5.5 Beats the Published Human Baseline on One of Five Tasks; Shifts the Extrapolated Date for Full RSI from August 2027 to July 2027

Reddit r/singularity ↗ · 2026-09-23

The Vals AI RSI Index indicates that the Opus 5.5 AI model has beaten the published human baseline on one of five tasks, shifting the predicted date for achieving full RSI from August 2027 to July 2027.

0 favorites 0 likes
#model-performance

@rauchg: We ran fresh Next.js evals. The tally: ① Opus 5.5 [𝟿𝟽%] ② GPT 6 Sol [𝟿𝟽%] ③ Fable 5.1 [𝟿𝟽%] ④ Grok 4.7 [𝟿𝟺%] No…

X AI KOLs Timeline ↗ · 2026-09-22 Cached

Fresh evaluations of AI models on Next.js reveal Claude Opus 5.5, GPT-6 Sol, and Fable 5.1 tying at 97% success rates, with Grok 4.7 at 94% but offering lower costs.

0 favorites 0 likes
#model-performance

@dotey: Every time OpenAI releases a new model, the first-week experience is always particularly great, and then it seems to tu…

X AI KOLs Timeline ↗ · 2026-09-22 Cached

The tweet compares the consistency of AI model performance over time, suggesting that OpenAI models degrade after initial releases while Anthropic's Claude remains stable.

0 favorites 0 likes
#model-performance

The Inference Gap (56 minute read)

TLDR AI ↗ · 2026-09-21 Cached

The article investigates how changes in the inference regime for Anthropic's Fable 5 model led to performance degradation, emphasizing that inference quality is crucial for realizing frontier AI capabilities.

0 favorites 0 likes
#model-performance

Laya (OS Jev) on Mac M4 CoreML Offline (45 decisions per second)

Hacker News Top ↗ · 2026-09-20

The Laya model runs offline on Apple's M4 chip using CoreML, achieving 45 decisions per second in inference.

0 favorites 0 likes
#model-performance

@lateinteraction: i don't see enough of this, so here again: we're all wondering what the future of work looks like with AI progress, but…

X AI KOLs Timeline ↗ · 2026-09-19 Cached

The author expresses frustration with the inadequacy of current AI models for extracting quality work, highlighting their limitations in adaptive intelligence up to 2026.

0 favorites 0 likes
#model-performance

@kafkaup: At the end of last year, our team was working on a classification model, and the performance had been stuck at 78%. One…

X AI KOLs Timeline ↗ · 2026-09-16

An intern boosted a classification model's performance to 99% using label hashing, which turned out to be data leakage, leading to ethical discussions and a review of the team's practices.

0 favorites 0 likes
#model-performance

DeepSeek v4.1 Flash Is Now Our Best Hacking Model

Hacker News Top ↗ · 2026-09-16 Cached

DeepSeek V4.1 Flash achieved a perfect score in an AI hacking benchmark by executing code on all vulnerable targets while keeping fixed ones secure, at a cost of only $4.65.

0 favorites 0 likes
#model-performance

@FinanceYF5: Last week's two chart-toppers on OpenRouter, completely different: The one that spent the most money was GPT-6 Astra. T…

X AI KOLs Timeline ↗ · 2026-09-16

The tweet reports that GPT-6 Astra had the highest spending on OpenRouter last week, while GPT-5.6 Luna used the most tokens, leading by a wide margin.

0 favorites 0 likes
#model-performance

@bnjmn_marie: If you retry a lot, Qwen3.8 27B can reach 92.04% on DeepSWE 1.1, ~18 pts above GPT-6 Astra’s reported ~74%. I ran 20 co…

X AI KOLs Timeline ↗ · 2026-09-15 Cached

Qwen3.8 27B achieves 92.04% on DeepSWE 1.1 with retries, outperforming GPT-6 Astra's 74%, demonstrating smaller models' potential with reliability strategies.

0 favorites 0 likes
#model-performance

@_jasonwei: very cool result showing how wet lab data enables a specialized model to beat gpt-6 astra at a task at the frontier of …

X AI KOLs Timeline ↗ · 2026-09-15 Cached

The article highlights how wet lab data enables a specialized model to outperform GPT-6 Astra in scientific tasks, underscoring the growing importance of domain-specific data for advancing AI at the frontiers of science.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback