We value your privacy

We use cookies to enhance your browsing experience, serve personalized content and analyze our traffic. By clicking “Accept all” you consent to our use of cookies. Cookie Policy

More options
Skip to content
FacthoryFacthory
FacthoryFacthory
    • Workspace
    • Agent
    • Knowledge
    • Analytics
    • Office apps
    • Desktop
    All features
    What’s new
    Download
  • By work

    • Organizational Knowledge Risk & Gap Intelligence
    • Scientific Research & Experimentation
    • Autonomous Analytics & Insight Discovery
    • Workforce Readiness & Adaptive Learning
    • SOP Governance & Operational Standardization
    • Process Discovery & Continuous Optimization
    • All solutions

    By industry

    • Manufacturing
    • Automotive
    • Construction & Infrastructure
    • Real Estate
    • Public Sector
    • Life Sciences
    • All industries
  • Facthory for

    • Regulated industries
    • On-premises
    • Developers

    Discover

    • What’s new
    • Blog
    • Case studies
    • Webinars
    • Models

    Learn

    • Documentation
    • Help centre
  • Pricing
  • Download
Sign inGet started
All benchmarksIndependent evaluation · Epoch AI

MMLU

Each model’s result as Epoch AI’s Benchmarking Hub publishes it, run by Epoch or collected from the source it cites. Facthory has not run them.

Data: Epoch AI, ‘Capabilities & benchmarking’, epoch.ai/benchmarks, licensed CC BY 4.0. Read on 16 Nov 2026.

The chart shows the 25 best and the table the 100 best of 136 results.

#ModelOrganizationResultEvidence
1

GPT-4o (Nov 2024)

API access
OpenAI88.1%–
2

Claude 3.5 Sonnet (Oct 2024)

API access
Anthropic87.3%Log or source
3

DeepSeek-V3

Open weights (restricted use)
DeepSeek87.2%Log or source
4

gemini-1.5-pro-002

API access
Google DeepMind86.9%Log or source
5

Claude 3.5 Sonnet (Jun 2024)

API access
Anthropic86.5%Log or source
6

GPT-4 (Mar 2023)

API access
OpenAI86.4%Log or source
7

gemini-1.5-pro-001

API access
Google DeepMind85.9%Log or source
8

qwen2.5-72b-instruct

Open weights (unrestricted)
Alibaba85.3%–
9

Qwen2.5-72B

Open weights (unrestricted)
Alibaba85%Log or source
10

phi-4

Open weights (unrestricted)
Microsoft Research84.8%–
11

claude-3-opus-20240229

API access
Anthropic84.6%Log or source
12

Llama-3.1-405B-Instruct

Open weights (restricted use)
Meta AI84.5%Log or source
13

Llama-3.1-405B

Open weights (restricted use)
Meta AI84.4%Log or source
14

GPT-4o (Aug 2024)

API access
OpenAI84.3%Log or source
15

GPT-4o (May 2024)

API access
OpenAI84.2%Log or source
16

gemini-1.5-pro-001-feb24

API access
Google DeepMind82.7%Log or source
17

GPT-4 (Jun 2023)

API access
OpenAI82.4%Log or source
18

qwen2-72b-instruct

Open weights (unrestricted)
Alibaba82.4%Log or source
19

amazon.nova-pro-v1:0

API access
Amazon82%Log or source
20

gpt-4o-mini-2024-07-18

API access
OpenAI81.8%–
21

gpt-4-turbo-2024-04-09

API access
OpenAI81.3%Log or source
22

Llama-3.2-90B-Vision-Instruct

Open weights (restricted use)
Meta AI80.3%Log or source
23

Llama-3.1-70B-Instruct

Open weights (restricted use)
Meta AI80.1%Log or source
24

mistral-large-2407

Open weights (non-commercial)
Mistral AI80%Log or source
25

qwen2.5-14b-instruct

Open weights (unrestricted)
Alibaba79.9%–
26

gemini-2.0-flash-exp

API access
Google DeepMind,Google79.7%Log or source
27

gpt-4-turbo

API access
OpenAI79.6%Log or source
28

Meta-Llama-3-70B-Instruct

Open weights (restricted use)
Meta AI79.3%Log or source
29

Yi-large

API access
01.AI79.3%Log or source
30

Llama-3.3-70B-Instruct

Open weights (restricted use)
Meta AI79.1%Log or source
31

claude-2.0

API access
Anthropic78.5%Log or source
32

DeepSeek-V2

Open weights (restricted use)
DeepSeek78.4%Log or source
33

Gemini 1.5 Flash (May 2024)

API access
Google DeepMind77.9%Log or source
34

Mixtral-8x22B-v0.1

Open weights (unrestricted)
Mistral AI77.8%Log or source
35

gemini-1.5-flash-0514

API access
Google DeepMind77.8%Log or source
36

Phi-3-medium-128k-instruct

Open weights (unrestricted)
Microsoft77.5%Log or source
37

amazon.nova-lite-v1:0

API access
Amazon77%Log or source
38

claude-1.3

API access
Anthropic77%Log or source
39

Yi-34B

Open weights (restricted use)
01.AI76.2%Log or source
40

claude-3-sonnet-20240229

API access
Anthropic75.9%Log or source
41

Phi-3-small-8k-instruct

Open weights (unrestricted)
Microsoft75.7%–
42

gemma-2-27b-it

Open weights (restricted use)
Google DeepMind75.7%Log or source
43

Qwen2.5-Coder-14B

–75.2%–
44

qwen1.5-32B

Open weights (restricted use)
Alibaba74.4%Log or source
45

Claude 3.5 Haiku (Oct 2024)

API access
Anthropic74.3%Log or source
46

gemini-1.5-flash-002

API access
Google DeepMind73.9%Log or source
47

claude-3-haiku-20240307

API access
Anthropic73.8%Log or source
48

claude-2.1

API access
Anthropic73.5%Log or source
49

claude-instant-1.1

API access
Anthropic73.4%Log or source
50

qwen2.5-7b-instruct

Open weights (unrestricted)
Alibaba72.9%Log or source
51

Inflection-1

Hosted access (no API)
Inflection AI72.7%Log or source
52

gemma-2-9b-it

Open weights (restricted use)
Google DeepMind72.1%Log or source
53

GPT-3.5 Turbo (Nov 2023)

API access
OpenAI71.4%–
54

amazon.nova-micro-v1:0

API access
Amazon70.8%Log or source
55

Mixtral-8x7B-v0.1

Open weights (unrestricted)
Mistral AI70.6%Log or source
56

falcon-180B

Open weights (restricted use)
Technology Innovation Institute70.6%–
57

gemini-1.0-pro-001

API access
Google DeepMind70%Log or source
58

text-davinci-002

API access
OpenAI70%Log or source
59

Llama-2-70b-hf

Open weights (restricted use)
Meta AI69.5%Log or source
60

c4ai-command-r-plus-08-2024

Open weights (non-commercial)
Cohere,Cohere Labs (formerly Cohere for AI)69.4%Log or source
61

PaLM 540B

Unreleased
Google Research69.3%–
62

GPT-3.5 Turbo (June 2023)

API access
OpenAI68.9%Log or source
63

Meta-Llama-3-8B-Instruct

Open weights (restricted use)
Meta AI68.8%Log or source
64

Phi-3-mini-4k-instruct

Open weights (unrestricted)
Microsoft68.8%–
65

claude-instant-1.2

API access
Anthropic68.8%Log or source
66

mistral-large-2402

API access
Mistral AI68.8%Log or source
67

mistral-small-2402

–68.7%Log or source
68

StableBeluga2

Open weights (non-commercial)
Stability AI68.6%Log or source
69

qwen1.5-14B

Open weights (unrestricted)
Alibaba68.6%Log or source
70

Yi-9B

–68.4%–
71

Qwen2.5-Coder-7B

Open weights (unrestricted)
Alibaba68%–
72

Yi-34B-Chat

Open weights (restricted use)
01.AI67.6%–
73

Chinchilla (70B)

Unreleased
DeepMind67.5%–
74

GPT-3.5 Turbo (Jan 2024)

API access
OpenAI67.3%Log or source
75

Qwen-14B

Open weights (restricted use)
Alibaba66.3%–
76

gemma-7b

Open weights (restricted use)
Google DeepMind66.1%Log or source
77

c4ai-command-r-08-2024

–65.2%Log or source
78

starcoder2-15b

Open weights (restricted use)
Hugging Face,ServiceNow,Nvidia,BigCode64.1%–
79

Qwen-14B-Chat

Open weights (restricted use)
Alibaba64%–
80

Yi-6B

Open weights (restricted use)
01.AI64%Log or source
81

LLaMA-65B

Open weights (non-commercial)
Meta AI63.4%–
82

Llama-2-34b

Unreleased
Meta AI62.6%–
83

Qwen1.5-7B

Open weights (unrestricted)
Alibaba62.6%Log or source
84

Mistral-7B-Instruct-v0.2

Open weights (unrestricted)
Mistral AI62.5%Log or source
85

Mistral-7B-v0.1

Open weights (unrestricted)
Mistral AI62.5%Log or source
86

Qwen2.5-Coder-32B

Open weights (unrestricted)
Alibaba61.2%–
87

DeepSeek-Coder-V2-Lite-Base

–60.5%–
88

Gopher (280B)

Unreleased
DeepMind60%–
89

Mistral-7B-Instruct-v0.3

Open weights (unrestricted)
Mistral AI59.9%Log or source
90

Llama-2-70b-chat

Open weights (restricted use)
Meta AI59.4%–
91

Baichuan-2-13B-Base

Open weights (restricted use)
Baichuan59.2%–
92

Nemotron-4 15B

Unreleased
Nvidia58.7%–
93

Falcon 2-11B

Open weights (restricted use)
Technology Innovation Institute58.4%–
94

phi-2

Open weights (unrestricted)
Microsoft58.4%Log or source
95

Yi-6B-Chat

Open weights (restricted use)
01.AI58.2%–
96

LLaMA-33B

Open weights (non-commercial)
Meta AI57.8%–
97

falcon-40b

Open weights (unrestricted)
Technology Innovation Institute56.9%–
98

Llama-3.2-11B-Vision-Instruct

Open weights (restricted use)
Meta AI56.5%Log or source
99

Llama-3.1-8B-Instruct

Open weights (restricted use)
Meta AI56.1%Log or source
100

internlm-chat-20b

–55.6%–

A workspace for what your organization knows, with an agent that works on it.

Product

  • All features
  • Workspace
  • Agent
  • Knowledge
  • Analytics
  • Office apps
  • Desktop
  • Download
  • Pricing

Solutions

  • Organizational Knowledge Risk & Gap Intelligence
  • Scientific Research & Experimentation
  • Autonomous Analytics & Insight Discovery
  • Workforce Readiness & Adaptive Learning
  • SOP Governance & Operational Standardization
  • Process Discovery & Continuous Optimization
  • All solutions
  • All industries

Resources

  • Blog
  • Case studies
  • Webinars
  • Documentation
  • Help centre
  • Models
  • ROI calculator

Company

  • Who we are
  • Careers
  • Press hub
  • Brand kit
  • Philosophy
  • Contact us

Join our newsletter

Product news from Facthory, by email.

​

© 2026 Facthory. All rights reserved.
  • Privacy policy
  • Cookie policy
  • Terms and conditions
  • Imprint
  • Cookie settings