We value your privacy

We use cookies to enhance your browsing experience, serve personalized content and analyze our traffic. By clicking “Accept all” you consent to our use of cookies. Cookie Policy

More options
Skip to content
FacthoryFacthory
FacthoryFacthory
    • Workspace
    • Agent
    • Knowledge
    • Analytics
    • Office apps
    • Desktop
    All features
    What’s new
    Download
  • By work

    • Organizational Knowledge Risk & Gap Intelligence
    • Scientific Research & Experimentation
    • Autonomous Analytics & Insight Discovery
    • Workforce Readiness & Adaptive Learning
    • SOP Governance & Operational Standardization
    • Process Discovery & Continuous Optimization
    • All solutions

    By industry

    • Manufacturing
    • Automotive
    • Construction & Infrastructure
    • Real Estate
    • Public Sector
    • Life Sciences
    • All industries
  • Facthory for

    • Regulated industries
    • On-premises
    • Developers

    Discover

    • What’s new
    • Blog
    • Case studies
    • Webinars
    • Models

    Learn

    • Documentation
    • Help centre
  • Pricing
  • Download
Sign inGet started
All benchmarksIndependent evaluation · Epoch AI

OpenBookQA

Each model’s result as Epoch AI’s Benchmarking Hub publishes it, run by Epoch or collected from the source it cites. Facthory has not run them.

Data: Epoch AI, ‘Capabilities & benchmarking’, epoch.ai/benchmarks, licensed CC BY 4.0. Read on 16 Nov 2026.

The chart shows the 25 best of 42 results; the table lists them all.

#ModelOrganizationResultEvidence
1

Phi-3-mini-4k-instruct

Open weights (unrestricted)
Microsoft88%–
2

Phi-3-small-8k-instruct

Open weights (unrestricted)
Microsoft88%–
3

Phi-3-medium-128k-instruct

Open weights (unrestricted)
Microsoft87.4%–
4

GPT-3.5 Turbo (Nov 2023)

API access
OpenAI86%–
5

Mixtral-8x7B-v0.1

Open weights (unrestricted)
Mistral AI85.8%–
6

Meta-Llama-3-8B-Instruct

Open weights (restricted use)
Meta AI82.6%–
7

Mistral-7B-v0.1

Open weights (unrestricted)
Mistral AI79.8%–
8

gemma-7b

Open weights (restricted use)
Google DeepMind78.6%–
9

phi-2

Open weights (unrestricted)
Microsoft73.6%–
10

PaLM 540B

Unreleased
Google Research68%Log or source
11

text-davinci-001

API access
OpenAI65.4%–
12

falcon-180B

Open weights (restricted use)
Technology Innovation Institute64.2%–
13

GLaM (MoE)

Unreleased
Google63%–
14

LLaMA-65B

Open weights (non-commercial)
Meta AI60.2%–
15

Llama-2-70b-hf

Open weights (restricted use)
Meta AI60.2%–
16

LLaMA-33B

Open weights (non-commercial)
Meta AI58.6%–
17

Llama-2-7b

Open weights (restricted use)
Meta AI58.6%–
18

Llama-2-34b

Unreleased
Meta AI58.2%–
19

PaLM 2-M

–57.4%Log or source
20

LLaMA-7B

Open weights (non-commercial)
Meta AI57.2%–
21

Llama-2-13b

Open weights (restricted use)
Meta AI57%–
22

falcon-40b

Open weights (unrestricted)
Technology Innovation Institute56.6%–
23

LLaMA-13B

Open weights (non-commercial)
Meta AI56.4%–
24

PaLM 2-S

–56.2%Log or source
25

mpt-30b

Open weights (unrestricted)
MosaicML52%–
26

falcon-7b

Open weights (unrestricted)
Technology Innovation Institute51.6%–
27

mpt-7b

Open weights (unrestricted)
MosaicML51.4%–
28

PaLM 62B

–50.4%–
29

xgen-7b-8k-base

Open weights (unrestricted)
Salesforce40.2%–
30

RedPajama-INCITE-7B-Base

–40%–
31

opt-13b

–39.8%–
32

dolly-v2-12b

Open weights (unrestricted)
Databricks39.2%–
33

open_llama_7b

–39%–
34

gpt-neox-20b

Open weights (unrestricted)
EleutherAI38.8%–
35

gpt-j-6b

Open weights (unrestricted)
EleutherAI,LAION38.2%–
36

phi-1_5

Open weights (unrestricted)
Microsoft37.2%–
37

Cerebras-GPT-13B

Open weights (unrestricted)
Cerebras Systems35.8%–
38

vicuna-13b-v1.1

–33%–
39

stablelm-tuned-alpha-7b

–32.4%–
40

opt-1.3b

Open weights (non-commercial)
Meta AI24%–
41

gpt-neo-2.7B

Open weights (unrestricted)
EleutherAI23.2%–
42

gpt2-xl

Open weights (unrestricted)
OpenAI22.4%–

A workspace for what your organization knows, with an agent that works on it.

Product

  • All features
  • Workspace
  • Agent
  • Knowledge
  • Analytics
  • Office apps
  • Desktop
  • Download
  • Pricing

Solutions

  • Organizational Knowledge Risk & Gap Intelligence
  • Scientific Research & Experimentation
  • Autonomous Analytics & Insight Discovery
  • Workforce Readiness & Adaptive Learning
  • SOP Governance & Operational Standardization
  • Process Discovery & Continuous Optimization
  • All solutions
  • All industries

Resources

  • Blog
  • Case studies
  • Webinars
  • Documentation
  • Help centre
  • Models
  • ROI calculator

Company

  • Who we are
  • Careers
  • Press hub
  • Brand kit
  • Philosophy
  • Contact us

Join our newsletter

Product news from Facthory, by email.

​

© 2026 Facthory. All rights reserved.
  • Privacy policy
  • Cookie policy
  • Terms and conditions
  • Imprint
  • Cookie settings