TriviaQA
Each model’s result as Epoch AI’s Benchmarking Hub publishes it, run by Epoch or collected from the source it cites. Facthory has not run them.
Data: Epoch AI, ‘Capabilities & benchmarking’, epoch.ai/benchmarks, licensed CC BY 4.0. Read on 16 Nov 2026.
The chart shows the 25 best of 39 results; the table lists them all.
| # | Model | Organization | Result | Evidence |
|---|---|---|---|---|
| 1 | claude-2.0 API access | Anthropic | 87.5% | Log or source |
| 2 | claude-1.3 API access | Anthropic | 86.7% | Log or source |
| 3 | PaLM 2-L | – | 86.1% | Log or source |
| 4 | GPT-3.5 Turbo (Nov 2023) API access | OpenAI | 85.8% | – |
| 5 | Llama-2-70b-hf Open weights (restricted use) | Meta AI | 85% | Log or source |
| 6 | GPT-4 (Jun 2023) API access | OpenAI | 84.8% | Log or source |
| 7 | DeepSeek-V3 Open weights (restricted use) | DeepSeek | 82.9% | Log or source |
| 8 | Llama-3.1-405B Open weights (restricted use) | Meta AI | 82.7% | Log or source |
| 9 | Mixtral-8x7B-v0.1 Open weights (unrestricted) | Mistral AI | 82.2% | – |
| 10 | LLaMA-65B Open weights (non-commercial) | Meta AI | 81.7% | – |
| 11 | PaLM 2-M | – | 81.7% | Log or source |
| 12 | Llama-2-34b Unreleased | Meta AI | 81% | – |
| 13 | DeepSeek-V2 Open weights (restricted use) | DeepSeek | 80% | Log or source |
| 14 | Llama-2-13b Open weights (restricted use) | Meta AI | 79.6% | Log or source |
| 15 | claude-instant-1.1 API access | Anthropic | 78.9% | Log or source |
| 16 | LLaMA-33B Open weights (non-commercial) | Meta AI | 78.7% | – |
| 17 | claude-instant-1.2 API access | Anthropic | 78.7% | Log or source |
| 18 | PaLM 540B Unreleased | Google Research | 76.9% | Log or source |
| 19 | PaLM 2-S | – | 75.2% | Log or source |
| 20 | falcon-40b Open weights (unrestricted) | Technology Innovation Institute | 74.6% | – |
| 21 | Phi-3-medium-128k-instruct Open weights (unrestricted) | Microsoft | 73.9% | – |
| 22 | Llama-2-7b Open weights (restricted use) | Meta AI | 72.1% | Log or source |
| 23 | Qwen2.5-72B Open weights (unrestricted) | Alibaba | 71.9% | Log or source |
| 24 | GLaM (MoE) Unreleased | 71.3% | – | |
| 25 | text-davinci-001 API access | OpenAI | 71.2% | Log or source |
| 26 | LLaMA-13B Open weights (non-commercial) | Meta AI | 70.1% | – |
| 27 | mpt-30b Open weights (unrestricted) | MosaicML | 68% | – |
| 28 | Meta-Llama-3-8B-Instruct Open weights (restricted use) | Meta AI | 67.7% | – |
| 29 | Phi-3-mini-4k-instruct Open weights (unrestricted) | Microsoft | 64% | – |
| 30 | gemma-7b Open weights (restricted use) | Google DeepMind | 63.4% | Log or source |
| 31 | LLaMA-7B Open weights (non-commercial) | Meta AI | 63.3% | – |
| 32 | Mistral-7B-v0.1 Open weights (unrestricted) | Mistral AI | 62.5% | Log or source |
| 33 | Phi-3-small-8k-instruct Open weights (unrestricted) | Microsoft | 58.1% | – |
| 34 | Gopher (280B) Unreleased | DeepMind | 57.1% | – |
| 35 | mpt-7b Open weights (unrestricted) | MosaicML | 55.7% | – |
| 36 | Chinchilla (70B) Unreleased | DeepMind | 55.4% | – |
| 37 | gemma-2b Open weights (restricted use) | Google DeepMind | 53.2% | Log or source |
| 38 | falcon-7b Open weights (unrestricted) | Technology Innovation Institute | 52.6% | – |
| 39 | phi-2 Open weights (unrestricted) | Microsoft | 45.2% | – |
