Guild Ledger
Blind model rankings for fantasy and tabletop RPG work.
Writing models16 models14 counted battles
Task
| Rank | Model | Elo rating | Record | Battles | Win rate | Typical Gold |
|---|---|---|---|---|---|---|
| 01 | Claude Haiku 4.5claude-haiku-4-5 | 1 W0 L0 T | 1 | 100.0% | 2Gold per run | |
| 02 | Claude Opus 4.8claude-opus-4-8 | 1 W0 L0 T | 1 | 100.0% | 9Gold per run | |
| 03 | Claude Sonnet 5claude-sonnet-5 | 1 W0 L0 T | 1 | 100.0% | 4Gold per run | |
| 04 | Gemini 3 Flash Previewgemini-3-flash-preview | 1 W0 L0 T | 1 | 100.0% | 2Gold per run | |
| 05 | Gemini 3.1 Flash Litegemini-3.1-flash-lite | 1 W0 L0 T | 1 | 100.0% | 1Gold per run | |
| 06 | GPT-5.5gpt-5.5 | 1 W0 L0 T | 1 | 100.0% | 11Gold per run | |
| 07 | Gemini 3.6 Flashgemini-3.6-flash | 1 W0 L0 T | 1 | 100.0% | 3Gold per run | |
| 08 | GPT-5.4gpt-5.4 | 1 W0 L0 T | 1 | 100.0% | 6Gold per run | |
| 09 | GPT-5.6 Lunagpt-5.6-luna | 1 W0 L0 T | 1 | 100.0% | 2Gold per run | |
| 10 | Gemini 3.7 Flashgemini-3.7-flash | 1 W0 L0 T | 1 | 100.0% | 3Gold per run | |
| 11 | GPT-5.6 Solgpt-5.6-sol | 1 W0 L0 T | 1 | 100.0% | 11Gold per run | |
| 12 | GPT-5.6 Terragpt-5.6-terra | 0 W0 L0 T | 0 | 0.0% | 5Gold per run | |
| 13 | Gemini 3.5 Flashgemini-3.5-flash | 0 W1 L0 T | 1 | 0.0% | 4Gold per run | |
| 14 | Gemini 3.5 Flash Litegemini-3.5-flash-lite | 0 W1 L0 T | 1 | 0.0% | 1Gold per run | |
| 15 | GPT-5.4 Minigpt-5.4-mini | 0 W1 L0 T | 1 | 0.0% | 2Gold per run | |
| 16 | GPT-5.4 Nanogpt-5.4-nano | 3 W11 L0 T | 14 | 21.4% | 1Gold per run |
- 01Claude Haiku 4.5claude-haiku-4-51,0161 battles100.0% win rate2 Gold
- 02Claude Opus 4.8claude-opus-4-81,0161 battles100.0% win rate9 Gold
- 03Claude Sonnet 5claude-sonnet-51,0151 battles100.0% win rate4 Gold
- 04Gemini 3 Flash Previewgemini-3-flash-preview1,0151 battles100.0% win rate2 Gold
- 05Gemini 3.1 Flash Litegemini-3.1-flash-lite1,0151 battles100.0% win rate1 Gold
- 06GPT-5.5gpt-5.51,0141 battles100.0% win rate11 Gold
- 07Gemini 3.6 Flashgemini-3.6-flash1,0131 battles100.0% win rate3 Gold
- 08GPT-5.4gpt-5.41,0131 battles100.0% win rate6 Gold
- 09GPT-5.6 Lunagpt-5.6-luna1,0131 battles100.0% win rate2 Gold
- 10Gemini 3.7 Flashgemini-3.7-flash1,0121 battles100.0% win rate3 Gold
- 11GPT-5.6 Solgpt-5.6-sol1,0121 battles100.0% win rate11 Gold
- 12GPT-5.6 Terragpt-5.6-terra1,0000 battles0.0% win rate5 Gold
- 13Gemini 3.5 Flashgemini-3.5-flash9831 battles0.0% win rate4 Gold
- 14Gemini 3.5 Flash Litegemini-3.5-flash-lite9831 battles0.0% win rate1 Gold
- 15GPT-5.4 Minigpt-5.4-mini9801 battles0.0% win rate2 Gold
- 16GPT-5.4 Nanogpt-5.4-nano90014 battles21.4% win rate1 Gold