We value your privacy

We use cookies to enhance your browsing experience, serve personalized content and analyze our traffic. By clicking “Accept all” you consent to our use of cookies. Cookie Policy

More options
Skip to content
FacthoryFacthory
FacthoryFacthory
    • Workspace
    • Agent
    • Knowledge
    • Analytics
    • Office apps
    • Desktop
    All features
    What’s new
    Download
  • By work

    • Organizational Knowledge Risk & Gap Intelligence
    • Scientific Research & Experimentation
    • Autonomous Analytics & Insight Discovery
    • Workforce Readiness & Adaptive Learning
    • SOP Governance & Operational Standardization
    • Process Discovery & Continuous Optimization
    • All solutions

    By industry

    • Manufacturing
    • Automotive
    • Construction & Infrastructure
    • Real Estate
    • Public Sector
    • Life Sciences
    • All industries
  • Facthory for

    • Regulated industries
    • On-premises
    • Developers

    Discover

    • What’s new
    • Blog
    • Case studies
    • Webinars
    • Models

    Learn

    • Documentation
    • Help centre
  • Pricing
  • Download
Sign inGet started
All benchmarksIndependent evaluation · Epoch AI

ARC AI2

Each model’s result as Epoch AI’s Benchmarking Hub publishes it, run by Epoch or collected from the source it cites. Facthory has not run them.

Data: Epoch AI, ‘Capabilities & benchmarking’, epoch.ai/benchmarks, licensed CC BY 4.0. Read on 16 Nov 2026.

The chart shows the 25 best of 77 results; the table lists them all.

#ModelOrganizationResultEvidence
1

DeepSeek-V3

Open weights (restricted use)
DeepSeek95.3%–
2

Llama-3.1-405B

Open weights (restricted use)
Meta AI95.3%–
3

Qwen2.5-72B

Open weights (unrestricted)
Alibaba94.5%–
4

DeepSeek-V2

Open weights (restricted use)
DeepSeek92.2%–
5

Phi-3-medium-128k-instruct

Open weights (unrestricted)
Microsoft91.6%–
6

Phi-3-small-8k-instruct

Open weights (unrestricted)
Microsoft90.7%–
7

GPT-3.5 Turbo (Nov 2023)

API access
OpenAI87.4%–
8

claude-instant-1.2

API access
Anthropic86.3%Log or source
9

StableBeluga2

Open weights (non-commercial)
Stability AI86.1%Log or source
10

claude-instant-1.1

API access
Anthropic85.7%Log or source
11

text-davinci-002

API access
OpenAI85.2%–
12

Phi-3-mini-4k-instruct

Open weights (unrestricted)
Microsoft84.9%–
13

Qwen-14B

Open weights (restricted use)
Alibaba84.4%Log or source
14

Meta-Llama-3-8B-Instruct

Open weights (restricted use)
Meta AI82.8%–
15

internlm-20b

–81.7%Log or source
16

phi-2

Open weights (unrestricted)
Microsoft75.9%–
17

Qwen-7B

Open weights (restricted use)
Alibaba75.3%Log or source
18

Qwen2.5-Coder-32B

Open weights (unrestricted)
Alibaba70.5%–
19

LLaMA-65B

Open weights (non-commercial)
Meta AI69.5%Log or source
20

internlm-7b

–69.5%Log or source
21

PaLM 2-L

–69.2%–
22

falcon-180B

Open weights (restricted use)
Technology Innovation Institute67.8%–
23

LLaMA-33B

Open weights (non-commercial)
Meta AI67.5%Log or source
24

Qwen2.5-Coder-14B

–66%–
25

PaLM 2-M

–64.9%–
26

DeepSeek-Coder-V2-Base

Open weights (restricted use)
DeepSeek64.3%–
27

chatglm2-6b

–61%Log or source
28

Qwen2.5-Coder-7B

Open weights (unrestricted)
Alibaba60.9%–
29

PaLM 540B

Unreleased
Google Research60.1%–
30

Mixtral-8x7B-v0.1

Open weights (unrestricted)
Mistral AI59.7%–
31

PaLM 2-S

–59.6%–
32

Llama-2-70b-hf

Open weights (restricted use)
Meta AI57.4%–
33

DeepSeek-Coder-V2-Lite-Base

–57.3%–
34

falcon-40b

Open weights (unrestricted)
Technology Innovation Institute56.7%–
35

Yi-9B

–55.6%–
36

Mistral-7B-v0.1

Open weights (unrestricted)
Mistral AI55.5%–
37

Nemotron-4 15B

Unreleased
Nvidia55.5%–
38

INTELLECT-1-Instruct

Prime Intellect,Hugging Face,Arcee AI54.5%Log or source
39

Llama-2-34b

Unreleased
Meta AI54.5%–
40

Qwen-1.8B

–53.2%Log or source
41

gemma-7b

Open weights (restricted use)
Google DeepMind53.2%–
42

Qwen2.5-Coder-3B

–52.9%–
43

LLaMA-13B

Open weights (non-commercial)
Meta AI52.7%Log or source
44

PaLM 62B

–52.5%–
45

text-davinci-001

API access
OpenAI51.4%–
46

mpt-30b

Open weights (unrestricted)
MosaicML50.6%–
47

Yi-6B

Open weights (restricted use)
01.AI50.3%–
48

Llama-2-13b

Open weights (restricted use)
Meta AI49.4%–
49

LLaMA-7B

Open weights (non-commercial)
Meta AI47.6%Log or source
50

starcoder2-15b

Open weights (restricted use)
Hugging Face,ServiceNow,Nvidia,BigCode47.2%–
51

Llama-2-7b

Open weights (restricted use)
Meta AI45.9%–
52

Qwen2.5-Coder-1.5B

Open weights (unrestricted)
Alibaba45.2%–
53

falcon-7b

Open weights (unrestricted)
Technology Innovation Institute44.5%–
54

phi-1_5

Open weights (unrestricted)
Microsoft44.4%–
55

vicuna-13b-v1.1

–43.2%–
56

mpt-7b

Open weights (unrestricted)
MosaicML42.6%Log or source
57

deepseek-coder-33b-base

Open weights (restricted use)
DeepSeek,Peking University42.2%–
58

gemma-2b

Open weights (restricted use)
Google DeepMind42.1%–
59

xgen-7b-8k-base

Open weights (unrestricted)
Salesforce41.2%–
60

gpt-neox-20b

Open weights (unrestricted)
EleutherAI41.1%–
61

dolly-v2-12b

Open weights (unrestricted)
Databricks39.6%–
62

RedPajama-INCITE-7B-Base

–39.1%–
63

open_llama_7b

–38.7%–
64

starcoder2-7b

Open weights (restricted use)
Hugging Face,ServiceNow,Nvidia,BigCode38.7%–
65

Baichuan-2-13B-Base

Open weights (restricted use)
Baichuan38%Log or source
66

deepseek-coder-6.7b-base

Open weights (restricted use)
DeepSeek,Peking University36.4%–
67

gpt-j-6b

Open weights (unrestricted)
EleutherAI,LAION36.3%–
68

opt-13b

–35.8%–
69

CodeQwen1.5-7B

–35.7%–
70

Qwen2.5-Coder-0.5B

–34.4%–
71

starcoder2-3b

Open weights (restricted use)
Hugging Face,ServiceNow,Nvidia,BigCode34.2%–
72

Baichuan-2-7B-Base

Open weights (restricted use)
Baichuan32.5%Log or source
73

Cerebras-GPT-13B

Open weights (unrestricted)
Cerebras Systems32.4%–
74

stablelm-tuned-alpha-7b

–27%–
75

deepseek-coder-1.3b-base

Open weights (restricted use)
DeepSeek,Peking University25.4%–
76

gpt2-xl

Open weights (unrestricted)
OpenAI25%–
77

opt-1.3b

Open weights (non-commercial)
Meta AI23.2%–

A workspace for what your organization knows, with an agent that works on it.

Product

  • All features
  • Workspace
  • Agent
  • Knowledge
  • Analytics
  • Office apps
  • Desktop
  • Download
  • Pricing

Solutions

  • Organizational Knowledge Risk & Gap Intelligence
  • Scientific Research & Experimentation
  • Autonomous Analytics & Insight Discovery
  • Workforce Readiness & Adaptive Learning
  • SOP Governance & Operational Standardization
  • Process Discovery & Continuous Optimization
  • All solutions
  • All industries

Resources

  • Blog
  • Case studies
  • Webinars
  • Documentation
  • Help centre
  • Models
  • ROI calculator

Company

  • Who we are
  • Careers
  • Press hub
  • Brand kit
  • Philosophy
  • Contact us

Join our newsletter

Product news from Facthory, by email.

​

© 2026 Facthory. All rights reserved.
  • Privacy policy
  • Cookie policy
  • Terms and conditions
  • Imprint
  • Cookie settings