We value your privacy

We use cookies to enhance your browsing experience, serve personalized content and analyze our traffic. By clicking “Accept all” you consent to our use of cookies. Cookie Policy

More options
Skip to content
FacthoryFacthory
FacthoryFacthory
    • Workspace
    • Agent
    • Knowledge
    • Analytics
    • Office apps
    • Desktop
    All features
    What’s new
    Download
  • By work

    • Organizational Knowledge Risk & Gap Intelligence
    • Scientific Research & Experimentation
    • Autonomous Analytics & Insight Discovery
    • Workforce Readiness & Adaptive Learning
    • SOP Governance & Operational Standardization
    • Process Discovery & Continuous Optimization
    • All solutions

    By industry

    • Manufacturing
    • Automotive
    • Construction & Infrastructure
    • Real Estate
    • Public Sector
    • Life Sciences
    • All industries
  • Facthory for

    • Regulated industries
    • On-premises
    • Developers

    Discover

    • What’s new
    • Blog
    • Case studies
    • Webinars
    • Models

    Learn

    • Documentation
    • Help centre
  • Pricing
  • Download
Sign inGet started

A workspace for what your organization knows, with an agent that works on it.

Product

  • All features
  • Workspace
  • Agent
  • Knowledge
  • Analytics
  • Office apps
  • Desktop
  • Download
  • Pricing

Solutions

  • Organizational Knowledge Risk & Gap Intelligence
  • Scientific Research & Experimentation
  • Autonomous Analytics & Insight Discovery
  • Workforce Readiness & Adaptive Learning
  • SOP Governance & Operational Standardization
  • Process Discovery & Continuous Optimization
  • All solutions
  • All industries

Resources

  • Blog
  • Case studies
  • Webinars
  • Documentation
  • Help centre
  • Models
  • ROI calculator

Company

  • Who we are
  • Careers
  • Press hub
  • Brand kit
  • Philosophy
  • Contact us

Join our newsletter

Product news from Facthory, by email.

​

© 2026 Facthory. All rights reserved.
  • Privacy policy
  • Cookie policy
  • Terms and conditions
  • Imprint
  • Cookie settings
All modelsibm-granite

granite-embedding-125m-english

sentence-similarity
124.6M parameters
apache-2.0
Scan not finished
View on Hugging FaceCompare with other models

Fact sheet

Parameters

124.6M

Context length

514 tokens

Architecture

RobertaModel

Shape

12 layers, hidden size 768, 12 attention heads, 12 key-value heads

Weights stored as

bfloat16

Task

sentence-similarity

Languages

en

Built on

–

Released

4 Dec 2024

Last updated

19 Aug 2025

Downloads (last 30 days)

208,091

Licence and access

Licence

apache-2.0

Access

Weights download without approval

Security

Hugging Face security scan

Scan not finished

Weight files by format

Safetensors: 1
Pickle-based: 1
GGUF: 0
Other formats: 1
Pickle-based files (.bin, .pt, .pth, .pkl, .ckpt) can run code when they are loaded; safetensors files cannot.

Facthory’s checks

Automated
Partly met
Safe weight formats

Safetensors or GGUF files beside pickle-based ones.

Not evidenced
The hub’s malware and pickle scan

The scan has not finished.

Met
A declared licence

The card declares its licence.

Not evidenced
Published safety evaluations

The model card is not public.

Rated by Facthory’s crawler from the published facts; a person has not reviewed it yet.

GPU calculator

How much memory this model needs to serve at a quantization, context and number of concurrent sequences, which GPUs hold it, and how fast it can generate. Estimates from the model’s published size and shape, with the assumptions below.

Weights

BF16 / FP16 (16 bit)
​

Context per sequence: 8K tokens

Concurrent sequences: 1

KV cache

Memory

0.6 GB

Weights: 0.2 GB

KV cache: 0.3 GB

Runtime: 0.1 GB

GPUMemoryGPUs neededPer sequenceAll sequences
NVIDIA L424 GB
1 ×
327 tokens/s327 tokens/s
NVIDIA L40S48 GB
1 ×
940 tokens/s940 tokens/s
NVIDIA RTX 6000 Ada48 GB
1 ×
1,045 tokens/s1,045 tokens/s
NVIDIA RTX PRO 6000 Blackwell96 GB
1 ×
1,950 tokens/s1,950 tokens/s
NVIDIA A100 80GB SXM80 GB
1 ×
2,219 tokens/s2,219 tokens/s
NVIDIA H100 SXM80 GB
1 ×
3,646 tokens/s3,646 tokens/s
NVIDIA H200 SXM141 GB
1 ×
5,224 tokens/s5,224 tokens/s
AMD Instinct MI300X192 GB
1 ×
5,768 tokens/s5,768 tokens/s
AMD Instinct MI325X256 GB
1 ×
6,530 tokens/s6,530 tokens/s
Assumptions
  • Runtime memory (activations, buffers) is 10% of weights and KV cache, plus 1 GB per GPU for the framework.
  • A GPU is filled to at most 90% of its memory; tensor parallelism uses 1, 2, 4 or 8 GPUs in one server.
  • Generation is limited by memory bandwidth at 60% of the vendor’s peak: each step reads the weights once and every sequence’s KV cache. A mixture-of-experts model reads only its active experts, so it runs faster than shown.
  • GPU memory and bandwidth are the vendors’ published figures.

Profile

Kind

Embedding model

Lineage

Original

Uses

Math
Science
Coding
Translation
Reasoning

In and out

Text → Embedding

Written on 11 Nov 2026 by Workers AI (@cf/zai-org/glm-4.7-flash) from the hub’s metadata: a reading of the publisher’s text, not checked by Facthory.

Published benchmarks

As the model card publishes them, with the source the card names. Facthory has not run them; results are self-reported unless the hub verified them.

BenchmarkMetricResultSourceCounts toward
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
accuracy63.4Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
ap26.89Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
ap_weighted26.89Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
f157.42

EU AI Act

What the EU AI Act asks of a general-purpose AI model depends on who places it on the EU market and how. These facts bear on it:

  • Licence: apache-2.0
  • Access: Weights download without approval
  • Parameters: 124.6M
Automated
Rated by Facthory’s crawler from the published facts; a person has not reviewed it yet.

General-purpose AI model (Article 3(63))

Not indicated. Its task (sentence-similarity) generates no text, audio, images or video, which the Commission’s indicative criterion asks for.

Articles 51 to 55, the obligations for general-purpose AI models, do not bind its provider.

Regulation (EU) 2024/1689, the EU AI Act · Source: General-Purpose AI Code of Practice, read 8 Nov 2026

Facthory’s EU AI Act score appears once a person has reviewed these checks. The articles we score against

Source: Read from Hugging Face on 19 Nov 2026, at commit 4ab61ff. huggingface.co/ibm-granite/granite-embedding-125m-english
How we rate
Model card
Not counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
f1_weighted66.97Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
main_score63.4Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
accuracy67.36Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
ap17.64Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
ap_weighted17.64Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
f155.08Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
f1_weighted73.55Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
main_score67.36Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
accuracy64.59Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
ap59.6Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
ap_weighted59.6Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
f164.33Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
f1_weighted64.33Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
main_score64.59Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
accuracy33.53Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
f132.54Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
f1_weighted32.54Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
main_score33.53Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
main_score11.79Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_16.93Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_1010Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_10010.64Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_100010.77Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_2010.3Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_38.94Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_59.51Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_16.93Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_1010Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_10010.64Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_100010.77Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_2010.3Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_38.94Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_59.51Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1000_diff126.72Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1000_max22.18Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1000_std10.34Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_100_diff126.72Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_100_max22.14Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_100_std10.27Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_10_diff127.39Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_10_max22.61Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_10_std10.01Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1_diff139.45Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1_max27.33Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1_std9.63Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_20_diff127.03Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_20_max22.24Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_20_std10.17Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_3_diff129.91Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_3_max23.7Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_3_std9.93Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_5_diff128.23Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_5_max22.92Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_5_std9.64Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1000_diff126.72Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1000_max22.18Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1000_std10.34Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_diff126.72Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_max22.14Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_std10.27Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_diff127.39Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_max22.61Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_std10.01Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_diff139.45Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_max27.33Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_std9.63Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_diff127.03Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_max22.24Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_std10.17Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_diff129.91Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_max23.7Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_std9.93Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_diff128.23Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_max22.92Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_std9.64Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_diff120.99Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_max20.61Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_std13Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_diff121.01Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_max19.42Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_std11.54Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_diff123.42Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_max21.1Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_std10.41Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_diff139.45Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_max27.33Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_std9.63Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_diff122.61Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_max20.06Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_std10.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_diff127.74Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_max22.91Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_std10.12Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_diff125.07Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_max21.7Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_std9.66Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_diff16.15Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_max19.73Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_std24.57Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_100_diff110.73Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_100_max14.28Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_100_std14.3Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_10_diff115.42Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_10_max18.07Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_10_std11.33Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1_diff139.45Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1_max27.33Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1_std9.63Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_20_diff114.51Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_20_max15.8Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_20_std12.46Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_3_diff122.75Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_3_max21.08Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_3_std10.61Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_5_diff118.14Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_5_max19.04Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_5_std9.7Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_diff16.15Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_max19.73Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_std24.57Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_100_diff110.73Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_100_max14.28Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_100_std14.3Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_10_diff115.42Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_10_max18.07Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_10_std11.33Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1_diff139.45Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1_max27.33Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1_std9.63Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_20_diff114.51Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_20_max15.8Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_20_std12.46Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_3_diff122.75Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_3_max21.08Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_3_std10.61Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_5_diff118.14Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_5_max19.04Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_5_std9.7Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_16.93Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_1011.79Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_10015.57Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_100019.77Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_2012.86Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_39.58Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_510.6Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_16.93Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_101.76Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_1000.37Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_10000.07Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_201.09Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_33.81Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_52.78Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_16.93Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_1017.56Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_10036.84Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_100071.71Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_2021.81Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_311.42Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_513.89Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_133.64Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_1049.72Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_10050.52Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_100050.52Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_2050.4Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_345.06Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_547.77Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_134.5Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_1050.04Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_10050.83Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_100050.83Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_2050.72Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_345.28Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_548.11Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1000_diff114.06Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1000_max-10.89Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1000_std-11.37Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_100_diff114.06Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_100_max-10.88Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_100_std-11.37Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_10_diff113.74Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_10_max-10.87Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_10_std-11.35Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1_diff118.22Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1_max-11.84Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1_std-11.89Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_20_diff114.04Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_20_max-10.73Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_20_std-11.31Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_3_diff113.76Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_3_max-11.65Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_3_std-12.1Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_5_diff113.32Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_5_max-11.35Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_5_std-11.43Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_diff111.65Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_max-11.98Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_std-11.32Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_diff111.39Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_max-11.94Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_std-11.32Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_diff115.72Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_max-12.01Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_std-11.73Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_diff111.66Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_max-11.83Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_std-11.27Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_diff111.23Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_max-12.97Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_std-12.2Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_diff111.08Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_max-12.32Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_std-11.36Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_diff113.55Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_max-10.41Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_std-10.94Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_diff113.58Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_max-10.28Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_std-10.86Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_diff112.32Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_max-9.76Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_std-10.63Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_diff118.22Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_max-11.84Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_std-11.89Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_diff113.53Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_max-9.07Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_std-10.44Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_diff112.43Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_max-11.67Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_std-12.24Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_diff111.43Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_max-11.23Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_std-10.99Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_diff1-17.64Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_max19.05Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_std67.98Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_100_diff13.1Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_100_max42.38Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_100_std55.21Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_10_diff13.48Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_10_max-0.91Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_10_std-4.97Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1_diff118.22Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1_max-11.84Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1_std-11.89Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_20_diff111.93Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_20_max29Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_20_std8.8Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_3_diff18.37Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_3_max-11.74Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_3_std-12.71Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_5_diff14.11Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_5_max-10.89Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_5_std-9.12Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_diff1-17.64Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_max19.05Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_std67.98Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_100_diff13.1Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_100_max42.38Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_100_std55.21Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_10_diff13.48Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_10_max-0.91Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_10_std-4.97Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1_diff118.22Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1_max-11.84Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1_std-11.89Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_20_diff111.93Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_20_max29Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_20_std8.8Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_3_diff18.37Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_3_max-11.74Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_3_std-12.71Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_5_diff14.11Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_5_max-10.89Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_5_std-9.12Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_133.64Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_1058.4Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_10061.57Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_100061.61Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_2060.78Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_348.83Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_553.69Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_133.64Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_108.61Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_1000.99Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_10000.1Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_204.76Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_319.92Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_514.3Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_133.64Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_1086.06Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_10099.36Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_100099.64Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_2095.24Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_359.74Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_571.48Model cardNot counted: not on our list

The capability score counts results the model’s authors publish, for the benchmarks our methodology lists, where at least two models in the catalog report the same benchmark, configuration and metric. Results a card attributes to the Open LLM Leaderboard are the leaderboard’s runs, and Epoch AI’s evaluations are Epoch’s: neither counts. How we score capability