0

Creative Story-Writing Benchmark

Saturated

Each model writes a short story that must incorporate 10 assigned elements (characters, objects, concepts, attributes, motivations). A panel of LLM judges grades element use, prose, coherence, character and originality. Published by Lech Mazur.

Domain
Writing
Format
Custom
Published
Jan 2025
Official leaderboard
github.com/lechmazur/writing

Cite

Notes

Only stored in your browser.

Attribution

Leaderboard scores
Lech Mazur
Attribution policy →

Top score 96.0% by GPT-6.2 Astra - 61 models reporting (23 frontier)

Score history

58
0%25%50%75%100%Aug 25Dec 25Apr 26Aug 26gpt-oss-120bGPT-5.2Claude Opus 4.6GPT-5.5Claude Fable 5Claude Opus 5Claude Fable 5.2GPT-6.2 Astra

Top models

61
Creative Story-Writing BenchmarkBar chart with 21 bars. Highest value: GPT-6.2 Astra at 96.
21 models

Where it's ranked

1

FAQ

What is Creative Story-Writing Benchmark?
Each model writes a short story that must incorporate 10 assigned elements (characters, objects, concepts, attributes, motivations). A panel of LLM judges grades element use, prose, coherence, character and originality. Published by Lech Mazur.
What is the current top score on Creative Story-Writing Benchmark?
The top reported score is 96.0% by GPT-6.2 Astra, across 61 models reporting (23 from frontier labs).