Fiction.LiveBench
Each model’s result as Epoch AI’s Benchmarking Hub publishes it, run by Epoch or collected from the source it cites. Facthory has not run them.
Data: Epoch AI, ‘Capabilities & benchmarking’, epoch.ai/benchmarks, licensed CC BY 4.0. Read on 16 Nov 2026.
The chart shows the 25 best of 61 results; the table lists them all.
| # | Model | Organization | Result | Evidence |
|---|---|---|---|---|
| 1 | GPT-5 (medium) API access | OpenAI | 97.2% | Log or source |
| 2 | o3-pro-2025-06-10_medium API access | OpenAI | 97.2% | Log or source |
| 3 | grok-4-0709 API access | xAI | 94.4% | Log or source |
| 4 | grok-4-fast API access | xAI | 94.4% | Log or source |
| 5 | Gemini 2.5 Pro Preview (Jun 2025) API access | Google DeepMind | 91.7% | Log or source |
| 6 | o3 (medium) API access | OpenAI | 88.9% | Log or source |
| 7 | Kimi K2.5 Open weights (unrestricted) | Moonshot | 86.1% | Log or source |
| 8 | DeepSeek-V3.2-Exp_high Open weights (unrestricted) | DeepSeek | 83.3% | Log or source |
| 9 | chutes/QwQ-32B Open weights (unrestricted) | Alibaba | 83.3% | Log or source |
| 10 | Claude 3.7 Sonnet (8k thinking) API access | Anthropic | 83.3% | Log or source |
| 11 | o1 (medium) API access | OpenAI | 83.3% | Log or source |
| 12 | gemini-2.5-flash-preview-05-20 API access | Google DeepMind | 77.8% | Log or source |
| 13 | o4-mini (medium) API access | OpenAI | 77.8% | Log or source |
| 14 | DeepSeek-R1 (May 2025) Open weights (unrestricted) | DeepSeek | 75% | Log or source |
| 15 | chutes/Qwen3-235B-A22B-Thinking-2507 Open weights (unrestricted) | Alibaba | 75% | Log or source |
| 16 | chutes/Qwen3-32B Open weights (unrestricted) | Alibaba | 74.2% | Log or source |
| 17 | DeepSeek-R1 Open weights (unrestricted) | DeepSeek | 69.4% | Log or source |
| 18 | MiniMax-M1-80k Open weights (unrestricted) | MiniMax | 69.4% | Log or source |
| 19 | GPT-5 mini (medium) API access | OpenAI | 69.4% | Log or source |
| 20 | chutes/Qwen3-235B-A22B Open weights (unrestricted) | Alibaba | 67.7% | Log or source |
| 21 | chatgpt-4o-01-29-2025 API access | OpenAI | 66.7% | Log or source |
| 22 | Kimi K2 Instruct (0905) Open weights (restricted use) | Moonshot | 66.7% | Log or source |
| 23 | Gemini 2.5 Pro Exp (Mar 2025) API access | Google DeepMind | 66.7% | Log or source |
| 24 | Gemini 2.5 Pro Preview (Mar 2025) API access | Google DeepMind | 66.7% | Log or source |
| 25 | Gemini 2.5 Pro Preview (Jun 2025) API access | Google DeepMind | 66.7% | Log or source |
| 26 | grok-3-mini-beta_medium API access | xAI | 66.7% | Log or source |
| 27 | qwen-max-2025-01-25 API access | Alibaba | 66.7% | Log or source |
| 28 | Qwen3-Max-Instruct API access | Alibaba | 66.7% | Log or source |
| 29 | GPT-4.1 API access | OpenAI | 63.9% | Log or source |
| 30 | GPT-4.5 Preview (Feb 2025) API access | OpenAI | 63.9% | Log or source |
| 31 | chutes/Qwen3-14B Open weights (unrestricted) | Alibaba | 62.5% | Log or source |
| 32 | chutes/Qwen3-8B Open weights (unrestricted) | Alibaba | 62.1% | Log or source |
| 33 | Kimi K2 Instruct Open weights (restricted use) | Moonshot | 61.1% | Log or source |
| 34 | Claude Opus 4 API access | Anthropic | 61.1% | Log or source |
| 35 | Gemini 2.0 Flash (Feb 2025) API access | Google DeepMind,Google | 61.1% | Log or source |
| 36 | chutes/GLM-4.5-FP8 | – | 58.3% | Log or source |
| 37 | grok-3-beta API access | xAI | 58.3% | Log or source |
| 38 | deepinfra/Qwen3-Next-80B-A3B-Instruct | – | 55.6% | Log or source |
| 39 | parasail-qwen3-235b-a22b-instruct-2507 Open weights (unrestricted) | Alibaba | 52.9% | Log or source |
| 40 | DeepSeek-V3.1 Open weights (unrestricted) | DeepSeek | 52.8% | Log or source |
| 41 | DeepSeek-V3.2-Exp Open weights (unrestricted) | DeepSeek | 52.8% | Log or source |
| 42 | Gemini 2.0 Flash Thinking Exp API access | Google DeepMind,Google | 52.8% | Log or source |
| 43 | DeepSeek-V3 (Mar 2025) Open weights (restricted use) | DeepSeek | 50% | Log or source |
| 44 | claude-3-7-sonnet-20250219 API access | Anthropic | 50% | Log or source |
| 45 | o3-mini (medium) API access | OpenAI | 50% | Log or source |
| 46 | gemini-2.5-flash-lite-preview-06-17 (Default thinking length) API access | Google DeepMind | 47.2% | Log or source |
| 47 | Gemini 2.5 Flash Preview (Apr 2025) API access | Google DeepMind | 47.2% | Log or source |
| 48 | claude-sonnet-4-20250514 API access | Anthropic | 46.9% | Log or source |
| 49 | chutes/Llama-4-Maverick-17B-128E-Instruct Open weights (restricted use) | Meta AI | 46.2% | Log or source |
| 50 | chutes/gpt-oss-120b_high Open weights (unrestricted) | OpenAI | 44.4% | Log or source |
| 51 | GPT-4.1 mini API access | OpenAI | 44.4% | Log or source |
| 52 | GPT-5 nano (medium) API access | OpenAI | 44.4% | Log or source |
| 53 | chutes/Qwen3-Next-80B-A3B-Instruct | – | 41.7% | Log or source |
| 54 | Gemini 2.0 Pro Exp (Feb 2025) Hosted access (no API) | Google DeepMind | 41.7% | Log or source |
| 55 | chutes/Qwen3-30B-A3B Open weights (unrestricted) | Alibaba | 40.6% | Log or source |
| 56 | chutes/gpt-oss-120b Open weights (unrestricted) | OpenAI | 36.1% | Log or source |
| 57 | chutes/Llama-4-Scout-17B-16E Instruct Open weights (restricted use) | Meta AI | 36% | Log or source |
| 58 | Llama-3.3-70B-Instruct Open weights (restricted use) | Meta AI | 33.3% | Log or source |
| 59 | chutes/Gemma-3-27b-It Open weights (restricted use) | Google DeepMind | 33.3% | Log or source |
| 60 | GPT-4.1 nano API access | OpenAI | 25% | Log or source |
| 61 | nvidia-nemotron-nano-9b-v2 | – | 25% | Log or source |
