We value your privacy

We use cookies to enhance your browsing experience, serve personalized content and analyze our traffic. By clicking “Accept all” you consent to our use of cookies. Cookie Policy

More options
Skip to content
FacthoryFacthory
FacthoryFacthory
    • Workspace
    • Agent
    • Knowledge
    • Analytics
    • Office apps
    • Desktop
    All features
    What’s new
    Download
  • By work

    • Organizational Knowledge Risk & Gap Intelligence
    • Scientific Research & Experimentation
    • Autonomous Analytics & Insight Discovery
    • Workforce Readiness & Adaptive Learning
    • SOP Governance & Operational Standardization
    • Process Discovery & Continuous Optimization
    • All solutions

    By industry

    • Manufacturing
    • Automotive
    • Construction & Infrastructure
    • Real Estate
    • Public Sector
    • Life Sciences
    • All industries
  • Facthory for

    • Regulated industries
    • On-premises
    • Developers

    Discover

    • What’s new
    • Blog
    • Case studies
    • Webinars
    • Models

    Learn

    • Documentation
    • Help centre
  • Pricing
  • Download
Sign inGet started
All benchmarksIndependent evaluation · Epoch AI

Winogrande

Each model’s result as Epoch AI’s Benchmarking Hub publishes it, run by Epoch or collected from the source it cites. Facthory has not run them.

Data: Epoch AI, ‘Capabilities & benchmarking’, epoch.ai/benchmarks, licensed CC BY 4.0. Read on 16 Nov 2026.

The chart shows the 25 best of 80 results; the table lists them all.

#ModelOrganizationResultEvidence
1

Llama-3.1-405B

Open weights (restricted use)
Meta AI89.2%Log or source
2

claude-3-opus-20240229

API access
Anthropic88.5%Log or source
3

GPT-4 (Mar 2023)

API access
OpenAI87.5%Log or source
4

gpt-4-32k-0314

API access
OpenAI87.5%–
5

falcon-180B

Open weights (restricted use)
Technology Innovation Institute87.1%–
6

DeepSeek-V2

Open weights (restricted use)
DeepSeek86.3%Log or source
7

DeepSeek-V3

Open weights (restricted use)
DeepSeek85.2%Log or source
8

PaLM 540B

Unreleased
Google Research85.1%Log or source
9

DeepSeek-Coder-V2-Base

Open weights (restricted use)
DeepSeek83.7%Log or source
10

Meta-Llama-3-70B

Open weights (restricted use)
Meta AI83.5%Log or source
11

PaLM 2-L

–83%Log or source
12

Qwen2.5-72B

Open weights (unrestricted)
Alibaba82.3%Log or source
13

Llama-3.1-405B-Instruct

Open weights (restricted use)
Meta AI82.2%Log or source
14

GPT-3.5 Turbo (June 2023)

API access
OpenAI81.6%–
15

text-davinci-002

API access
OpenAI81.6%Log or source
16

Phi-3-medium-128k-instruct

Open weights (unrestricted)
Microsoft81.5%–
17

Phi-3-small-8k-instruct

Open weights (unrestricted)
Microsoft81.5%–
18

Qwen2.5-Coder-32B

Open weights (unrestricted)
Alibaba80.8%Log or source
19

Llama-2-70b-hf

Open weights (restricted use)
Meta AI80.2%Log or source
20

PaLM 2-M

–79.2%Log or source
21

gemma-7b

Open weights (restricted use)
Google DeepMind79%Log or source
22

Megatron-Turing NLG 530B

Unreleased
Microsoft,Nvidia78.9%–
23

Falcon 2-11B

Open weights (restricted use)
Technology Innovation Institute78.3%–
24

Nemotron-4 15B

Unreleased
Nvidia78%–
25

PaLM 2-S

–77.9%Log or source
26

Mixtral-8x7B-v0.1

Open weights (unrestricted)
Mistral AI77.2%Log or source
27

LLaMA-65B

Open weights (non-commercial)
Meta AI77%Log or source
28

PaLM 62B

–77%Log or source
29

falcon-40b

Open weights (unrestricted)
Technology Innovation Institute76.9%Log or source
30

Qwen2.5-Coder-14B

–76.8%Log or source
31

Llama-2-34b

Unreleased
Meta AI76.7%Log or source
32

LLaMA-33B

Open weights (non-commercial)
Meta AI76%Log or source
33

Meta-Llama-3-8B

Open weights (restricted use)
Meta AI75.7%Log or source
34

Mistral-7B-v0.1

Open weights (unrestricted)
Mistral AI75.3%Log or source
35

claude-3-sonnet-20240229

API access
Anthropic75.1%Log or source
36

Chinchilla (70B)

Unreleased
DeepMind74.9%Log or source
37

claude-3-haiku-20240307

API access
Anthropic74.2%Log or source
38

GLaM (MoE)

Unreleased
Google73.5%–
39

phi-1_5

Open weights (unrestricted)
Microsoft73.4%–
40

LLaMA-13B

Open weights (non-commercial)
Meta AI73%Log or source
41

Yi-9B

–73%–
42

DeepSeek-Coder-V2-Lite-Base

–72.9%Log or source
43

Qwen2.5-Coder-7B

Open weights (unrestricted)
Alibaba72.9%Log or source
44

Llama-2-13b

Open weights (restricted use)
Meta AI72.8%Log or source
45

Yi-6B

Open weights (restricted use)
01.AI71.3%–
46

mpt-30b

Open weights (unrestricted)
MosaicML71%Log or source
47

Phi-3-mini-4k-instruct

Open weights (unrestricted)
Microsoft70.8%–
48

vicuna-13b-v1.1

–70.8%–
49

text-davinci-001

API access
OpenAI70.2%Log or source
50

Gopher (280B)

Unreleased
DeepMind70.1%Log or source
51

LLaMA-7B

Open weights (non-commercial)
Meta AI70.1%Log or source
52

Llama-2-7b

Open weights (restricted use)
Meta AI69.2%Log or source
53

GPT-3.5 Turbo (Nov 2023)

API access
OpenAI68.8%–
54

mpt-7b

Open weights (unrestricted)
MosaicML68.3%Log or source
55

Qwen2.5-Coder-3B

–67.4%Log or source
56

open_llama_7b

–67%–
57

falcon-7b

Open weights (unrestricted)
Technology Innovation Institute66.3%Log or source
58

gpt-neox-20b

Open weights (unrestricted)
EleutherAI66.1%–
59

INTELLECT-1-Instruct

Prime Intellect,Hugging Face,Arcee AI65.8%Log or source
60

gemma-2b

Open weights (restricted use)
Google DeepMind65.4%Log or source
61

Meta-Llama-3-8B-Instruct

Open weights (restricted use)
Meta AI65%–
62

xgen-7b-8k-base

Open weights (unrestricted)
Salesforce64.9%–
63

opt-13b

–64.7%–
64

gpt-j-6b

Open weights (unrestricted)
EleutherAI,LAION64.5%–
65

starcoder2-15b

Open weights (restricted use)
Hugging Face,ServiceNow,Nvidia,BigCode64.3%Log or source
66

RedPajama-INCITE-7B-Base

–63.8%–
67

deepseek-coder-33b-base

Open weights (restricted use)
DeepSeek,Peking University62%Log or source
68

dolly-v2-12b

Open weights (unrestricted)
Databricks61.8%–
69

opt-1.3b

Open weights (non-commercial)
Meta AI61%–
70

Cerebras-GPT-13B

Open weights (unrestricted)
Cerebras Systems60.8%–
71

Qwen2.5-Coder-1.5B

Open weights (unrestricted)
Alibaba60.7%Log or source
72

CodeQwen1.5-7B

–59.8%Log or source
73

gpt2-xl

Open weights (unrestricted)
OpenAI58.3%–
74

deepseek-coder-6.7b-base

Open weights (restricted use)
DeepSeek,Peking University57.6%Log or source
75

starcoder2-3b

Open weights (restricted use)
Hugging Face,ServiceNow,Nvidia,BigCode57.1%Log or source
76

starcoder2-7b

Open weights (restricted use)
Hugging Face,ServiceNow,Nvidia,BigCode57.1%Log or source
77

Qwen2.5-Coder-0.5B

–54.8%Log or source
78

phi-2

Open weights (unrestricted)
Microsoft54.7%–
79

deepseek-coder-1.3b-base

Open weights (restricted use)
DeepSeek,Peking University53.3%Log or source
80

stablelm-tuned-alpha-7b

–51.5%–

A workspace for what your organization knows, with an agent that works on it.

Product

  • All features
  • Workspace
  • Agent
  • Knowledge
  • Analytics
  • Office apps
  • Desktop
  • Download
  • Pricing

Solutions

  • Organizational Knowledge Risk & Gap Intelligence
  • Scientific Research & Experimentation
  • Autonomous Analytics & Insight Discovery
  • Workforce Readiness & Adaptive Learning
  • SOP Governance & Operational Standardization
  • Process Discovery & Continuous Optimization
  • All solutions
  • All industries

Resources

  • Blog
  • Case studies
  • Webinars
  • Documentation
  • Help centre
  • Models
  • ROI calculator

Company

  • Who we are
  • Careers
  • Press hub
  • Brand kit
  • Philosophy
  • Contact us

Join our newsletter

Product news from Facthory, by email.

​

© 2026 Facthory. All rights reserved.
  • Privacy policy
  • Cookie policy
  • Terms and conditions
  • Imprint
  • Cookie settings