Fable 5 benchmark with remotion video

Reddit r/singularity News

Summary

Fable 5 shows overall improvement over Opus 4.8 in video generation benchmarks, but Gemini 3.1 Pro demonstrates more artistic vision despite issues with tool calls and buggy code.

Overall an improvement over Opus 4.8, but I'd still say Gemini 3.1 Pro has more of an artistic vision even tho it fails tool calls and writes buggy code sometimes. Ik almost everyone is interested just in the SWE stuff, but this has been a good eval for me to think about how big the model is, how "creative" it is for generating new ideas etc. More results from fable, with comparisions for Gemini, opus and some open source models: [https://mesmer.tools/benchmarks/ai-video-generation](https://mesmer.tools/benchmarks/ai-video-generation)
Original Article

Similar Articles

Fable 5 below even Gemini 3.1 on Livebench

Reddit r/singularity

A discussion on LiveBench results showing Fable 5 performing below Gemini 3.1, questioning whether the benchmark is flawed or Anthropic is optimizing for benchmarks.

@robinebers: Fable 5 Low > Opus 4.8 Max

X AI KOLs Following

A user posts a comparison suggesting Fable 5 Low outperforms Opus 4.8 Max, with another user commenting that Fable 5 is back but being used incorrectly.