We value your privacy

We use cookies to enhance your browsing experience, serve personalized content and analyze our traffic. By clicking “Accept all” you consent to our use of cookies. Cookie Policy

More options
Skip to content
FacthoryFacthory
FacthoryFacthory
    • Workspace
    • Agent
    • Knowledge
    • Analytics
    • Office apps
    • Desktop
    All features
    What’s new
    Download
  • By work

    • Organizational Knowledge Risk & Gap Intelligence
    • Scientific Research & Experimentation
    • Autonomous Analytics & Insight Discovery
    • Workforce Readiness & Adaptive Learning
    • SOP Governance & Operational Standardization
    • Process Discovery & Continuous Optimization
    • All solutions

    By industry

    • Manufacturing
    • Automotive
    • Construction & Infrastructure
    • Real Estate
    • Public Sector
    • Life Sciences
    • All industries
  • Facthory for

    • Regulated industries
    • On-premises
    • Developers

    Discover

    • What’s new
    • Blog
    • Case studies
    • Webinars
    • Models

    Learn

    • Documentation
    • Help centre
  • Pricing
  • Download
Sign inGet started

A workspace for what your organization knows, with an agent that works on it.

Product

  • All features
  • Workspace
  • Agent
  • Knowledge
  • Analytics
  • Office apps
  • Desktop
  • Download
  • Pricing

Solutions

  • Organizational Knowledge Risk & Gap Intelligence
  • Scientific Research & Experimentation
  • Autonomous Analytics & Insight Discovery
  • Workforce Readiness & Adaptive Learning
  • SOP Governance & Operational Standardization
  • Process Discovery & Continuous Optimization
  • All solutions
  • All industries

Resources

  • Blog
  • Case studies
  • Webinars
  • Documentation
  • Help centre
  • Models
  • ROI calculator

Company

  • Who we are
  • Careers
  • Press hub
  • Brand kit
  • Philosophy
  • Contact us

Join our newsletter

Product news from Facthory, by email.

​

© 2026 Facthory. All rights reserved.
  • Privacy policy
  • Cookie policy
  • Terms and conditions
  • Imprint
  • Cookie settings
All modelsibm-granite

granite-embedding-278m-multilingual

sentence-similarity
278M parameters
apache-2.0
Scan not finished
View on Hugging FaceCompare with other models

Fact sheet

Parameters

278M

Context length

514 tokens

Architecture

XLMRobertaModel

Shape

12 layers, hidden size 768, 12 attention heads, 12 key-value heads

Weights stored as

bfloat16

Task

sentence-similarity

Languages

en, ar, cs, de, es, fr, it, ja, ko, nl, pt, zh

Built on

–

Released

4 Dec 2024

Last updated

19 Aug 2025

Downloads (last 30 days)

153,858

Licence and access

Licence

apache-2.0

Access

Weights download without approval

Security

Hugging Face security scan

Scan not finished

Weight files by format

Safetensors: 1
Pickle-based: 1
GGUF: 0
Other formats: 1
Pickle-based files (.bin, .pt, .pth, .pkl, .ckpt) can run code when they are loaded; safetensors files cannot.

Facthory’s checks

Automated
Partly met
Safe weight formats

Safetensors or GGUF files beside pickle-based ones.

Not evidenced
The hub’s malware and pickle scan

The scan has not finished.

Met
A declared licence

The card declares its licence.

Not evidenced
Published safety evaluations

The model card is not public.

Rated by Facthory’s crawler from the published facts; a person has not reviewed it yet.

GPU calculator

How much memory this model needs to serve at a quantization, context and number of concurrent sequences, which GPUs hold it, and how fast it can generate. Estimates from the model’s published size and shape, with the assumptions below.

Weights

BF16 / FP16 (16 bit)
​

Context per sequence: 8K tokens

Concurrent sequences: 1

KV cache

Memory

0.9 GB

Weights: 0.6 GB

KV cache: 0.3 GB

Runtime: 0.1 GB

GPUMemoryGPUs neededPer sequenceAll sequences
NVIDIA L424 GB
1 ×
210 tokens/s210 tokens/s
NVIDIA L40S48 GB
1 ×
604 tokens/s604 tokens/s
NVIDIA RTX 6000 Ada48 GB
1 ×
671 tokens/s671 tokens/s
NVIDIA RTX PRO 6000 Blackwell96 GB
1 ×
1,253 tokens/s1,253 tokens/s
NVIDIA A100 80GB SXM80 GB
1 ×
1,426 tokens/s1,426 tokens/s
NVIDIA H100 SXM80 GB
1 ×
2,342 tokens/s2,342 tokens/s
NVIDIA H200 SXM141 GB
1 ×
3,356 tokens/s3,356 tokens/s
AMD Instinct MI300X192 GB
1 ×
3,706 tokens/s3,706 tokens/s
AMD Instinct MI325X256 GB
1 ×
4,195 tokens/s4,195 tokens/s
Assumptions
  • Runtime memory (activations, buffers) is 10% of weights and KV cache, plus 1 GB per GPU for the framework.
  • A GPU is filled to at most 90% of its memory; tensor parallelism uses 1, 2, 4 or 8 GPUs in one server.
  • Generation is limited by memory bandwidth at 60% of the vendor’s peak: each step reads the weights once and every sequence’s KV cache. A mixture-of-experts model reads only its active experts, so it runs faster than shown.
  • GPU memory and bandwidth are the vendors’ published figures.

Profile

Kind

Embedding model

Lineage

Not stated

Uses

Math
Translation
Retrieval
Coding
Conversation

In and out

Text → Embedding

Written on 11 Nov 2026 by Workers AI (@cf/zai-org/glm-4.7-flash) from the hub’s metadata: a reading of the publisher’s text, not checked by Facthory.

Published benchmarks

As the model card publishes them, with the source the card names. Facthory has not run them; results are self-reported unless the hub verified them.

BenchmarkMetricResultSourceCounts toward
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
accuracy71.81Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
ap34.05Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
ap_weighted34.05Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
f1

EU AI Act

What the EU AI Act asks of a general-purpose AI model depends on who places it on the EU market and how. These facts bear on it:

  • Licence: apache-2.0
  • Access: Weights download without approval
  • Parameters: 278M
Automated
Rated by Facthory’s crawler from the published facts; a person has not reviewed it yet.

General-purpose AI model (Article 3(63))

Not indicated. Its task (sentence-similarity) generates no text, audio, images or video, which the Commission’s indicative criterion asks for.

Articles 51 to 55, the obligations for general-purpose AI models, do not bind its provider.

Regulation (EU) 2024/1689, the EU AI Act · Source: General-Purpose AI Code of Practice, read 8 Nov 2026

Facthory’s EU AI Act score appears once a person has reviewed these checks. The articles we score against

Source: Read from Hugging Face on 19 Nov 2026, at commit a9cb533. huggingface.co/ibm-granite/granite-embedding-278m-multilingual
How we rate
65.65
Model card
Not counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
f1_weighted74.48Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
main_score71.81Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
accuracy73.43Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
ap23.35Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
ap_weighted23.35Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
f161.23Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
f1_weighted78.41Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
main_score73.43Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
accuracy67.59Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
ap62.04Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
ap_weighted62.04Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
f167.36Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
f1_weighted67.36Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
main_score67.59Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
accuracy37.28Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
f136.41Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
f1_weighted36.41Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
main_score37.28Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
main_score6.21Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_13.45Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_105.15Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_1005.54Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_10005.64Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_205.31Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_34.52Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_54.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_13.45Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_105.15Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_1005.54Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_10005.64Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_205.31Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_34.52Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_54.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1000_diff130.77Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1000_max28.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1000_std13Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_100_diff130.92Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_100_max28.97Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_100_std12.97Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_10_diff132.49Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_10_max30.1Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_10_std13.23Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1_diff146.23Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1_max37.17Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1_std15.31Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_20_diff131.83Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_20_max29.57Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_20_std12.84Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_3_diff136.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_3_max33.1Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_3_std14.41Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_5_diff134.35Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_5_max31.4Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_5_std13.6Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1000_diff130.77Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1000_max28.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1000_std13Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_diff130.92Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_max28.97Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_std12.97Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_diff132.49Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_max30.1Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_std13.23Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_diff146.23Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_max37.17Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_std15.31Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_diff131.83Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_max29.57Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_std12.84Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_diff136.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_max33.1Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_std14.41Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_diff134.35Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_max31.4Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_std13.6Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_diff119.67Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_max22.9Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_std13.22Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_diff121.69Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_max23.21Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_std12.48Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_diff127.37Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_max26.82Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_std12.34Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_diff146.23Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_max37.17Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_std15.31Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_diff125.71Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_max25.56Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_std11.38Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_diff134.72Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_max32.03Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_std14.3Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_diff130.84Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_max29.36Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_std13.04Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_diff14.43Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_max16.23Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_std15.27Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_100_diff19.27Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_100_max15.7Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_100_std12.65Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_10_diff118.37Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_10_max20.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_10_std10.77Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1_diff146.23Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1_max37.17Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1_std15.31Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_20_diff115.77Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_20_max18.94Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_20_std8.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_3_diff129.95Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_3_max29.65Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_3_std14.07Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_5_diff123.92Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_5_max25.25Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_5_std11.91Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_diff14.43Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_max16.23Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_std15.27Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_100_diff19.27Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_100_max15.7Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_100_std12.65Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_10_diff118.37Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_10_max20.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_10_std10.77Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1_diff146.23Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1_max37.17Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1_std15.31Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_20_diff115.77Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_20_max18.94Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_20_std8.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_3_diff129.95Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_3_max29.65Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_3_std14.07Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_5_diff123.92Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_5_max25.25Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_5_std11.91Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_13.45Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_106.21Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_1008.58Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_100012.22Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_206.81Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_34.88Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_55.56Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_13.45Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_100.97Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_1000.22Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_10000.05Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_200.6Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_31.98Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_51.53Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_13.45Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_109.67Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_10021.86Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_100052.72Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_2012.06Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_35.95Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_57.62Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_131.15Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_1046.54Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_10047.47Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_100047.47Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_2047.3Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_341.51Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_544.54Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_131.72Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_1046.75Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_10047.68Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_100047.68Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_2047.52Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_341.71Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_544.75Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1000_diff112.24Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1000_max-5.07Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1000_std-3.36Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_100_diff112.24Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_100_max-5.07Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_100_std-3.36Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_10_diff112.16Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_10_max-4.94Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_10_std-3.37Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1_diff114.38Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1_max-7.82Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1_std-4.06Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_20_diff112.27Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_20_max-4.94Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_20_std-3.37Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_3_diff111.55Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_3_max-5.56Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_3_std-3.52Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_5_diff112.05Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_5_max-4.84Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_5_std-3.67Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_diff110.64Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_max-5.99Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_std-3.44Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_diff110.56Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_max-5.86Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_std-3.44Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_diff112.71Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_max-8.19Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_std-4.09Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_diff110.68Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_max-5.85Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_std-3.45Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_diff19.85Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_max-6.66Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_std-3.67Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_diff110.49Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_max-5.76Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_std-3.74Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_diff112.17Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_max-4.35Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_std-3.01Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_diff112.1Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_max-4.26Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_std-2.85Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_diff111.99Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_max-3.3Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_std-3.04Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_diff114.38Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_max-7.82Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_std-4.06Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_diff112.49Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_max-3.15Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_std-2.92Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_diff110.78Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_max-4.69Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_std-3.42Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_diff111.62Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_max-3.3Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_std-3.67Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_diff114.85Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_max14Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_std53.8Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_100_diff15.19Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_100_max18.51Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_100_std41.18Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_10_diff111.92Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_10_max6.58Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_10_std-1.02Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1_diff114.38Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1_max-7.82Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1_std-4.06Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_20_diff119.36Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_20_max22.85Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_20_std4.15Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_3_diff18.51Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_3_max-2.04Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_3_std-3.15Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_5_diff110.29Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_5_max2.44Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_5_std-3.73Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_diff114.85Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_max14Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_std53.8Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_100_diff15.19Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_100_max18.51Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_100_std41.18Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_10_diff111.92Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_10_max6.58Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_10_std-1.02Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1_diff114.38Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1_max-7.82Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1_std-4.06Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_20_diff119.36Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_20_max22.85Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_20_std4.15Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_3_diff18.51Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_3_max-2.04Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_3_std-3.15Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_5_diff110.29Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_5_max2.44Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_5_std-3.73Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_131.15Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_1055.24Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_10058.97Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_100059.08Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_2057.92Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_345.05Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_550.46Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_131.15Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_108.3Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_1000.99Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_10000.1Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_204.67Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_318.45Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_513.67Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_131.15Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_1083Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_10098.79Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_100099.64Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_2093.38Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_355.33Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_568.35Model cardNot counted: not on our list

The capability score counts results the model’s authors publish, for the benchmarks our methodology lists, where at least two models in the catalog report the same benchmark, configuration and metric. Results a card attributes to the Open LLM Leaderboard are the leaderboard’s runs, and Epoch AI’s evaluations are Epoch’s: neither counts. How we score capability