Fable 5 benchmark with remotion video

Reddit r/singularity News
benchmark video-generation ai-models fable gemini opus

Summary

Fable 5 shows overall improvement over Opus 4.8 in video generation benchmarks, but Gemini 3.1 Pro demonstrates more artistic vision despite issues with tool calls and buggy code.

Overall an improvement over Opus 4.8, but I'd still say Gemini 3.1 Pro has more of an artistic vision even tho it fails tool calls and writes buggy code sometimes. Ik almost everyone is interested just in the SWE stuff, but this has been a good eval for me to think about how big the model is, how "creative" it is for generating new ideas etc. More results from fable, with comparisions for Gemini, opus and some open source models: [https://mesmer.tools/benchmarks/ai-video-generation](https://mesmer.tools/benchmarks/ai-video-generation)
Original Article

Similar Articles

Fable 5.1 is different!

Reddit r/AI_Agents

Fable 5.1 is exceptional for scientific work, surpassing GPT 5.6 and Opus 5 based on user experience.

Fable 5 below even Gemini 3.1 on Livebench

Reddit r/singularity

A discussion on LiveBench results showing Fable 5 performing below Gemini 3.1, questioning whether the benchmark is flawed or Anthropic is optimizing for benchmarks.