Ihre Privatsphäre ist uns wichtig

Wir verwenden Cookies, um Ihr Surferlebnis zu verbessern, Inhalte zu personalisieren und unseren Datenverkehr zu analysieren. Mit einem Klick auf „Alle akzeptieren“ stimmen Sie der Verwendung von Cookies zu. Cookie-Richtlinie

Weitere Optionen
Zum Inhalt springen
FacthoryFacthory
FacthoryFacthory
    • Arbeitsbereich
    • Agent
    • Wissen
    • Analysen
    • Office-Apps
    • Desktop
    Alle Funktionen
    Neuigkeiten
    Herunterladen
  • Nach Aufgabe

    • Wissensrisiko & Wissenslücken im Unternehmen
    • Wissenschaftliche Forschung & Experimente
    • Autonome Analytik & Erkenntnisgewinnung
    • Einsatzbereitschaft der Belegschaft & adaptives Lernen
    • SOP-Governance & betriebliche Standardisierung
    • Prozesserkennung und kontinuierliche Optimierung
    • Alle Lösungen

    Nach Branche

    • Fertigung
    • Automobil
    • Bau & Infrastruktur
    • Immobilien
    • Öffentlicher Sektor
    • Life Sciences
    • Alle Branchen
  • Facthory für

    • Regulierte Branchen
    • On-Premises
    • Entwickler

    Entdecken

    • Neuigkeiten
    • Blog
    • Fallstudien
    • Webinare
    • Modelle

    Lernen

    • Dokumentation
    • Hilfecenter
  • Preise
  • Download
AnmeldenJetzt starten
Modelle

Benchmarks

Die Benchmarks, für die zwei oder mehr Modelle des Katalogs Ergebnisse angeben, so, wie ihre Modellkarten sie veröffentlichen. Facthory hat sie nicht selbst gemessen; jedes Ergebnis nennt seine Quelle.

Unabhängige Evaluierungen

Ergebnisse, die Epoch AI selbst gemessen oder aus veröffentlichten Quellen gesammelt hat, für offene und geschlossene Modelle, jeweils mit Nachweis.

Daten: Epoch AI, „Capabilities & benchmarking“, epoch.ai/benchmarks, lizenziert unter CC BY 4.0.

BenchmarkVeröffentlichtModelle
GPQA diamond20.11.2023339
OTIS Mock AIME 2024-202519.12.2024316
ARC-AGI05.11.2019287
ARC-AGI-224.03.2025275
DTBench12.08.2026241
LMCA12.08.2026203
WeirdML16.01.2025172
Chess Puzzles10.12.2025164
Mystery Game Puzzles30.07.2026146
MMLU07.09.2020136
FrontierMath-Tiers-1-3-v2-Private12.06.2026125
SimpleBench31.10.2024124
MATH level 505.03.2021108
SimpleQA Verified09.09.2025103
GSM8K27.10.202193
ProofBench30.01.202685
FrontierMath-Tier-4-v2-Private12.06.202681
Winogrande24.07.201980
ARC AI214.03.201877
HellaSwag19.05.201976
Aider polyglot21.12.202471
APEX-Agents21.01.202665
Fiction.LiveBench21.02.202561
PIQA26.11.201960
Terminal Bench19.05.202559
BBH17.10.202250
GeoBench01.03.202549
FrontierCode08.06.202646
METR Time Horizons19.03.202546
MirrorCode26.06.202646
GSO-Bench29.05.202542
OpenBookQA08.09.201842
DeepResearch Bench13.06.202541
Balrog20.11.202440
Furniture Assembly23.09.202639
TriviaQA09.05.201739
VPCT30.01.202538
EBR-bench01.07.202631
Surface Evolver Bench19.06.202629
LAMBADA20.06.201626
WeirdML v318.09.202626
CL-bench03.02.202623
FrontierSWE02.09.202623
Cybench15.08.202422
PostTrainBench11.03.202620
Remote Labor Index29.10.202519
CL-bench Life29.04.202617
CadEval22.04.202515
OSWorld 2.026.06.202614
The Agent Company18.12.202414
ANLI31.10.201911
GDPval25.09.202511
ExploitBench13.05.20269
OSWorld11.04.20249
SpireClimb14.10.20269
SuperGLUE02.05.20198
FrontierMath-2025-02-28-Private
abgelöst
28.02.2025101
FrontierMath-Tier-4-2025-07-01-Private
abgelöst
11.07.202572

Selbst angegeben in Modellkarten

Ergebnisse, die die Anbieter in ihren Modellkarten angeben. Getrennt von den unabhängigen Evaluierungen, da die Aufbauten verschieden sind.

BenchmarkMetrikModelle
LibriSpeech (clean)
other
Test WER9
LibriSpeech (clean)
clean
Test WER7
Common Voice 11.0
hi
Test WER5
MTEB AmazonCounterfactualClassification (en)
en
accuracy5
MTEB AmazonCounterfactualClassification (en)
en
ap5
MTEB AmazonCounterfactualClassification (en)
en
f15
MTEB AmazonPolarityClassification
default
accuracy5
MTEB AmazonPolarityClassification
default
ap5
MTEB AmazonPolarityClassification
default
f15
MTEB AmazonReviewsClassification (en)
en
accuracy5
MTEB AmazonReviewsClassification (en)
en
f15
GIFT-EvalCRPS4
GIFT-EvalMASE4
TIMECRPS4
TIMEMASE4
fev-benchSQL skill score4
BBH (3-Shot)normalized accuracy3
FLEURS
de_de
Test WER (De)3
FLEURS
en_us
Test WER (En)3
FLEURS
es_419
Test WER (Es)3
FLEURS
fr_fr
Test WER (Fr)3
FLEURS
it_it
Test WER (It)3
FLEURS
pt_br
Test WER (Pt)3
GPQA (0-shot)acc_norm3
IFEval (0-Shot)strict accuracy3
MATH Lvl 5 (4-Shot)exact match3
MMLU-PRO (5-shot)
main
accuracy3
MTEB AmazonCounterfactualClassification (en)
en
ap_weighted3
MTEB AmazonCounterfactualClassification (en)
en
f1_weighted3
MTEB AmazonCounterfactualClassification (en)
en
main_score3
MTEB AmazonCounterfactualClassification (en-ext)
en-ext
accuracy3
MTEB AmazonCounterfactualClassification (en-ext)
en-ext
ap3
MTEB AmazonCounterfactualClassification (en-ext)
en-ext
ap_weighted3
MTEB AmazonCounterfactualClassification (en-ext)
en-ext
f13
MTEB AmazonCounterfactualClassification (en-ext)
en-ext
f1_weighted3
MTEB AmazonCounterfactualClassification (en-ext)
en-ext
main_score3
MTEB AmazonPolarityClassification (default)
default
ap_weighted3
MTEB AmazonPolarityClassification (default)
default
f1_weighted3
MTEB AmazonPolarityClassification (default)
default
main_score3
MTEB AmazonReviewsClassification (en)
en
f1_weighted3
MTEB AmazonReviewsClassification (en)
en
main_score3
MTEB AppsRetrieval (default)
default
main_score3
MTEB AppsRetrieval (default)
default
map_at_13
MTEB AppsRetrieval (default)
default
map_at_103
MTEB AppsRetrieval (default)
default
map_at_1003
MTEB AppsRetrieval (default)
default
map_at_10003
MTEB AppsRetrieval (default)
default
map_at_203
MTEB AppsRetrieval (default)
default
map_at_33
MTEB AppsRetrieval (default)
default
map_at_53
MTEB AppsRetrieval (default)
default
mrr_at_13
MTEB AppsRetrieval (default)
default
mrr_at_103
MTEB AppsRetrieval (default)
default
mrr_at_1003
MTEB AppsRetrieval (default)
default
mrr_at_10003
MTEB AppsRetrieval (default)
default
mrr_at_203
MTEB AppsRetrieval (default)
default
mrr_at_33
MTEB AppsRetrieval (default)
default
mrr_at_53
MTEB AppsRetrieval (default)
default
nauc_map_at_1000_diff13
MTEB AppsRetrieval (default)
default
nauc_map_at_1000_max3
MTEB AppsRetrieval (default)
default
nauc_map_at_1000_std3
MTEB AppsRetrieval (default)
default
nauc_map_at_100_diff13
MTEB AppsRetrieval (default)
default
nauc_map_at_100_max3
MTEB AppsRetrieval (default)
default
nauc_map_at_100_std3
MTEB AppsRetrieval (default)
default
nauc_map_at_10_diff13
MTEB AppsRetrieval (default)
default
nauc_map_at_10_max3
MTEB AppsRetrieval (default)
default
nauc_map_at_10_std3
MTEB AppsRetrieval (default)
default
nauc_map_at_1_diff13
MTEB AppsRetrieval (default)
default
nauc_map_at_1_max3
MTEB AppsRetrieval (default)
default
nauc_map_at_1_std3
MTEB AppsRetrieval (default)
default
nauc_map_at_20_diff13
MTEB AppsRetrieval (default)
default
nauc_map_at_20_max3
MTEB AppsRetrieval (default)
default
nauc_map_at_20_std3
MTEB AppsRetrieval (default)
default
nauc_map_at_3_diff13
MTEB AppsRetrieval (default)
default
nauc_map_at_3_max3
MTEB AppsRetrieval (default)
default
nauc_map_at_3_std3
MTEB AppsRetrieval (default)
default
nauc_map_at_5_diff13
MTEB AppsRetrieval (default)
default
nauc_map_at_5_max3
MTEB AppsRetrieval (default)
default
nauc_map_at_5_std3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_1000_diff13
MTEB AppsRetrieval (default)
default
nauc_mrr_at_1000_max3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_1000_std3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_100_diff13
MTEB AppsRetrieval (default)
default
nauc_mrr_at_100_max3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_100_std3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_10_diff13
MTEB AppsRetrieval (default)
default
nauc_mrr_at_10_max3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_10_std3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_1_diff13
MTEB AppsRetrieval (default)
default
nauc_mrr_at_1_max3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_1_std3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_20_diff13
MTEB AppsRetrieval (default)
default
nauc_mrr_at_20_max3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_20_std3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_3_diff13
MTEB AppsRetrieval (default)
default
nauc_mrr_at_3_max3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_3_std3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_5_diff13
MTEB AppsRetrieval (default)
default
nauc_mrr_at_5_max3
MTEB AppsRetrieval (default)
default
nauc_mrr_at_5_std3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_1000_diff13
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_1000_max3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_1000_std3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_100_diff13
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_100_max3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_100_std3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_10_diff13
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_10_max3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_10_std3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_1_diff13
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_1_max3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_1_std3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_20_diff13
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_20_max3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_20_std3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_3_diff13
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_3_max3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_3_std3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_5_diff13
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_5_max3
MTEB AppsRetrieval (default)
default
nauc_ndcg_at_5_std3
MTEB AppsRetrieval (default)
default
nauc_precision_at_1000_diff13
MTEB AppsRetrieval (default)
default
nauc_precision_at_1000_max3
MTEB AppsRetrieval (default)
default
nauc_precision_at_1000_std3
MTEB AppsRetrieval (default)
default
nauc_precision_at_100_diff13
MTEB AppsRetrieval (default)
default
nauc_precision_at_100_max3
MTEB AppsRetrieval (default)
default
nauc_precision_at_100_std3
MTEB AppsRetrieval (default)
default
nauc_precision_at_10_diff13
MTEB AppsRetrieval (default)
default
nauc_precision_at_10_max3
MTEB AppsRetrieval (default)
default
nauc_precision_at_10_std3
MTEB AppsRetrieval (default)
default
nauc_precision_at_1_diff13
MTEB AppsRetrieval (default)
default
nauc_precision_at_1_max3
MTEB AppsRetrieval (default)
default
nauc_precision_at_1_std3
MTEB AppsRetrieval (default)
default
nauc_precision_at_20_diff13
MTEB AppsRetrieval (default)
default
nauc_precision_at_20_max3
MTEB AppsRetrieval (default)
default
nauc_precision_at_20_std3
MTEB AppsRetrieval (default)
default
nauc_precision_at_3_diff13
MTEB AppsRetrieval (default)
default
nauc_precision_at_3_max3
MTEB AppsRetrieval (default)
default
nauc_precision_at_3_std3
MTEB AppsRetrieval (default)
default
nauc_precision_at_5_diff13
MTEB AppsRetrieval (default)
default
nauc_precision_at_5_max3
MTEB AppsRetrieval (default)
default
nauc_precision_at_5_std3
MTEB AppsRetrieval (default)
default
nauc_recall_at_1000_diff13
MTEB AppsRetrieval (default)
default
nauc_recall_at_1000_max3
MTEB AppsRetrieval (default)
default
nauc_recall_at_1000_std3
MTEB AppsRetrieval (default)
default
nauc_recall_at_100_diff13
MTEB AppsRetrieval (default)
default
nauc_recall_at_100_max3
MTEB AppsRetrieval (default)
default
nauc_recall_at_100_std3
MTEB AppsRetrieval (default)
default
nauc_recall_at_10_diff13
MTEB AppsRetrieval (default)
default
nauc_recall_at_10_max3
MTEB AppsRetrieval (default)
default
nauc_recall_at_10_std3
MTEB AppsRetrieval (default)
default
nauc_recall_at_1_diff13
MTEB AppsRetrieval (default)
default
nauc_recall_at_1_max3
MTEB AppsRetrieval (default)
default
nauc_recall_at_1_std3
MTEB AppsRetrieval (default)
default
nauc_recall_at_20_diff13
MTEB AppsRetrieval (default)
default
nauc_recall_at_20_max3
MTEB AppsRetrieval (default)
default
nauc_recall_at_20_std3
MTEB AppsRetrieval (default)
default
nauc_recall_at_3_diff13
MTEB AppsRetrieval (default)
default
nauc_recall_at_3_max3
MTEB AppsRetrieval (default)
default
nauc_recall_at_3_std3
MTEB AppsRetrieval (default)
default
nauc_recall_at_5_diff13
MTEB AppsRetrieval (default)
default
nauc_recall_at_5_max3
MTEB AppsRetrieval (default)
default
nauc_recall_at_5_std3
MTEB AppsRetrieval (default)
default
ndcg_at_13
MTEB AppsRetrieval (default)
default
ndcg_at_103
MTEB AppsRetrieval (default)
default
ndcg_at_1003
MTEB AppsRetrieval (default)
default
ndcg_at_10003
MTEB AppsRetrieval (default)
default
ndcg_at_203
MTEB AppsRetrieval (default)
default
ndcg_at_33
MTEB AppsRetrieval (default)
default
ndcg_at_53
MTEB AppsRetrieval (default)
default
precision_at_13
MTEB AppsRetrieval (default)
default
precision_at_103
MTEB AppsRetrieval (default)
default
precision_at_1003
MTEB AppsRetrieval (default)
default
precision_at_10003
MTEB AppsRetrieval (default)
default
precision_at_203
MTEB AppsRetrieval (default)
default
precision_at_33
MTEB AppsRetrieval (default)
default
precision_at_53
MTEB AppsRetrieval (default)
default
recall_at_13
MTEB AppsRetrieval (default)
default
recall_at_103
MTEB AppsRetrieval (default)
default
recall_at_1003
MTEB AppsRetrieval (default)
default
recall_at_10003
MTEB AppsRetrieval (default)
default
recall_at_203
MTEB AppsRetrieval (default)
default
recall_at_33
MTEB AppsRetrieval (default)
default
recall_at_53
MTEB ArguAna (default)
default
map_at_13
MTEB ArguAna (default)
default
map_at_103
MTEB ArguAna (default)
default
map_at_1003
MTEB ArguAna (default)
default
map_at_10003
MTEB ArguAna (default)
default
map_at_203
MTEB ArguAna (default)
default
map_at_33
MTEB ArguAna (default)
default
map_at_53
MTEB ArguAna (default)
default
mrr_at_13
MTEB ArguAna (default)
default
mrr_at_103
MTEB ArguAna (default)
default
mrr_at_1003
MTEB ArguAna (default)
default
mrr_at_10003
MTEB ArguAna (default)
default
mrr_at_203
MTEB ArguAna (default)
default
mrr_at_33
MTEB ArguAna (default)
default
mrr_at_53
MTEB ArguAna (default)
default
nauc_map_at_1000_diff13
MTEB ArguAna (default)
default
nauc_map_at_1000_max3
MTEB ArguAna (default)
default
nauc_map_at_1000_std3
MTEB ArguAna (default)
default
nauc_map_at_100_diff13

Ein Arbeitsbereich für das, was Ihre Organisation weiß, mit einem Agenten, der damit arbeitet.

Produkt

  • Alle Funktionen
  • Arbeitsbereich
  • Agent
  • Wissen
  • Analysen
  • Office-Apps
  • Desktop
  • Herunterladen
  • Preise

Lösungen

  • Wissensrisiko & Wissenslücken im Unternehmen
  • Wissenschaftliche Forschung & Experimente
  • Autonome Analytik & Erkenntnisgewinnung
  • Einsatzbereitschaft der Belegschaft & adaptives Lernen
  • SOP-Governance & betriebliche Standardisierung
  • Prozesserkennung und kontinuierliche Optimierung
  • Alle Lösungen
  • Alle Branchen

Ressourcen

  • Blog
  • Fallstudien
  • Webinare
  • Dokumentation
  • Hilfecenter
  • Modelle
  • ROI-Rechner

Unternehmen

  • Über uns
  • Karriere
  • Presse
  • Markenkit
  • Philosophie
  • Kontakt

Unser Newsletter

Neuigkeiten zu Facthory per E-Mail.

​

© 2026 Facthory. Alle Rechte vorbehalten.
  • Datenschutz
  • Cookie-Richtlinie
  • Allgemeine Geschäftsbedingungen
  • Impressum
  • Cookie-Einstellungen