We value your privacy

We use cookies to enhance your browsing experience, serve personalized content and analyze our traffic. By clicking “Accept all” you consent to our use of cookies. Cookie Policy

More options
Skip to content
FacthoryFacthory
FacthoryFacthory
    • Workspace
    • Agent
    • Knowledge
    • Analytics
    • Office apps
    • Desktop
    All features
    What’s new
    Download
  • By work

    • Organizational Knowledge Risk & Gap Intelligence
    • Scientific Research & Experimentation
    • Autonomous Analytics & Insight Discovery
    • Workforce Readiness & Adaptive Learning
    • SOP Governance & Operational Standardization
    • Process Discovery & Continuous Optimization
    • All solutions

    By industry

    • Manufacturing
    • Automotive
    • Construction & Infrastructure
    • Real Estate
    • Public Sector
    • Life Sciences
    • All industries
  • Facthory for

    • Regulated industries
    • On-premises
    • Developers

    Discover

    • What’s new
    • Blog
    • Case studies
    • Webinars
    • Models

    Learn

    • Documentation
    • Help centre
  • Pricing
  • Download
Sign inGet started

A workspace for what your organization knows, with an agent that works on it.

Product

  • All features
  • Workspace
  • Agent
  • Knowledge
  • Analytics
  • Office apps
  • Desktop
  • Download
  • Pricing

Solutions

  • Organizational Knowledge Risk & Gap Intelligence
  • Scientific Research & Experimentation
  • Autonomous Analytics & Insight Discovery
  • Workforce Readiness & Adaptive Learning
  • SOP Governance & Operational Standardization
  • Process Discovery & Continuous Optimization
  • All solutions
  • All industries

Resources

  • Blog
  • Case studies
  • Webinars
  • Documentation
  • Help centre
  • Models
  • ROI calculator

Company

  • Who we are
  • Careers
  • Press hub
  • Brand kit
  • Philosophy
  • Contact us

Join our newsletter

Product news from Facthory, by email.

​

© 2026 Facthory. All rights reserved.
  • Privacy policy
  • Cookie policy
  • Terms and conditions
  • Imprint
  • Cookie settings
All modelsibm-granite

granite-embedding-107m-multilingual

sentence-similarity
107M parameters
apache-2.0
Scan not finished
View on Hugging FaceCompare with other models

Fact sheet

Parameters

107M

Context length

514 tokens

Architecture

XLMRobertaModel

Shape

6 layers, hidden size 384, 12 attention heads, 12 key-value heads

Weights stored as

bfloat16

Task

sentence-similarity

Languages

en, ar, cs, de, es, fr, it, ja, ko, nl, pt, zh

Built on

–

Released

4 Dec 2024

Last updated

19 Aug 2025

Downloads (last 30 days)

54,696

Licence and access

Licence

apache-2.0

Access

Weights download without approval

Security

Hugging Face security scan

Scan not finished

Weight files by format

Safetensors: 1
Pickle-based: 1
GGUF: 0
Other formats: 1
Pickle-based files (.bin, .pt, .pth, .pkl, .ckpt) can run code when they are loaded; safetensors files cannot.

Facthory’s checks

Automated
Partly met
Safe weight formats

Safetensors or GGUF files beside pickle-based ones.

Not evidenced
The hub’s malware and pickle scan

The scan has not finished.

Met
A declared licence

The card declares its licence.

Not evidenced
Published safety evaluations

The model card is not public.

Rated by Facthory’s crawler from the published facts; a person has not reviewed it yet.

GPU calculator

How much memory this model needs to serve at a quantization, context and number of concurrent sequences, which GPUs hold it, and how fast it can generate. Estimates from the model’s published size and shape, with the assumptions below.

Weights

BF16 / FP16 (16 bit)
​

Context per sequence: 8K tokens

Concurrent sequences: 1

KV cache

Memory

0.3 GB

Weights: 0.2 GB

KV cache: 0.1 GB

Runtime: 0 GB

GPUMemoryGPUs neededPer sequenceAll sequences
NVIDIA L424 GB
1 ×
622 tokens/s622 tokens/s
NVIDIA L40S48 GB
1 ×
1,791 tokens/s1,791 tokens/s
NVIDIA RTX 6000 Ada48 GB
1 ×
1,990 tokens/s1,990 tokens/s
NVIDIA RTX PRO 6000 Blackwell96 GB
1 ×
3,714 tokens/s3,714 tokens/s
NVIDIA A100 80GB SXM80 GB
1 ×
4,226 tokens/s4,226 tokens/s
NVIDIA H100 SXM80 GB
1 ×
6,943 tokens/s6,943 tokens/s
NVIDIA H200 SXM141 GB
1 ×
9,949 tokens/s9,949 tokens/s
AMD Instinct MI300X192 GB
1 ×
10,985 tokens/s10,985 tokens/s
AMD Instinct MI325X256 GB
1 ×
12,436 tokens/s12,436 tokens/s
Assumptions
  • Runtime memory (activations, buffers) is 10% of weights and KV cache, plus 1 GB per GPU for the framework.
  • A GPU is filled to at most 90% of its memory; tensor parallelism uses 1, 2, 4 or 8 GPUs in one server.
  • Generation is limited by memory bandwidth at 60% of the vendor’s peak: each step reads the weights once and every sequence’s KV cache. A mixture-of-experts model reads only its active experts, so it runs faster than shown.
  • GPU memory and bandwidth are the vendors’ published figures.

Profile

Kind

Embedding model

Lineage

Not stated

Uses

Math
Science
Coding
Translation
Conversation

In and out

Text → Embedding

Written on 11 Nov 2026 by Workers AI (@cf/zai-org/glm-4.7-flash) from the hub’s metadata: a reading of the publisher’s text, not checked by Facthory.

Published benchmarks

As the model card publishes them, with the source the card names. Facthory has not run them; results are self-reported unless the hub verified them.

BenchmarkMetricResultSourceCounts toward
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
accuracy71.67Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
ap33.76Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
ap_weighted33.76Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
f1

EU AI Act

What the EU AI Act asks of a general-purpose AI model depends on who places it on the EU market and how. These facts bear on it:

  • Licence: apache-2.0
  • Access: Weights download without approval
  • Parameters: 107M
Automated
Rated by Facthory’s crawler from the published facts; a person has not reviewed it yet.

General-purpose AI model (Article 3(63))

Not indicated. Its task (sentence-similarity) generates no text, audio, images or video, which the Commission’s indicative criterion asks for.

Articles 51 to 55, the obligations for general-purpose AI models, do not bind its provider.

Regulation (EU) 2024/1689, the EU AI Act · Source: General-Purpose AI Code of Practice, read 8 Nov 2026

Facthory’s EU AI Act score appears once a person has reviewed these checks. The articles we score against

Source: Read from Hugging Face on 19 Nov 2026, at commit d6cffd3. huggingface.co/ibm-granite/granite-embedding-107m-multilingual
How we rate
65.42
Model card
Not counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
f1_weighted74.35Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en)
en · test
Not counted: not on our list
main_score71.67Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
accuracy72.71Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
ap22.5Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
ap_weighted22.5Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
f160.45Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
f1_weighted77.85Model cardNot counted: not on our list
MTEB AmazonCounterfactualClassification (en-ext)
en-ext · test
Not counted: not on our list
main_score72.71Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
accuracy66.58Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
ap61.34Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
ap_weighted61.34Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
f166.22Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
f1_weighted66.22Model cardNot counted: not on our list
MTEB AmazonPolarityClassification (default)
default · test
Not counted: not on our list
main_score66.58Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
accuracy36.41Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
f135.63Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
f1_weighted35.63Model cardNot counted: not on our list
MTEB AmazonReviewsClassification (en)
en · test
Not counted: not on our list
main_score36.41Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
main_score4.54Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_12.39Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_103.72Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_1004.06Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_10004.15Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_203.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_33.25Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
map_at_53.5Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_12.39Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_103.72Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_1004.06Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_10004.15Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_203.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_33.25Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
mrr_at_53.5Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1000_diff124.57Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1000_max28.39Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1000_std13.5Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_100_diff124.79Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_100_max28.58Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_100_std13.54Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_10_diff126.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_10_max29.73Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_10_std13.57Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1_diff140.5Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1_max37.6Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_1_std20.3Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_20_diff125.68Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_20_max29.21Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_20_std13.47Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_3_diff130.91Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_3_max32.28Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_3_std13.28Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_5_diff128.82Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_5_max30.52Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_map_at_5_std13.41Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1000_diff124.57Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1000_max28.39Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1000_std13.5Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_diff124.79Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_max28.58Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_std13.54Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_diff126.89Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_max29.73Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_std13.57Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_diff140.5Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_max37.6Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_std20.3Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_diff125.68Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_max29.21Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_std13.47Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_diff130.91Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_max32.28Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_std13.28Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_diff128.82Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_max30.52Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_std13.41Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_diff113.9Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_max21.92Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_std12.66Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_diff115.93Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_max23.27Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_std12.82Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_diff122.08Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_max27.07Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_std12.65Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_diff140.5Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_max37.6Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_std20.3Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_diff119.37Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_max25.95Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_std12.55Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_diff128.79Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_max31.12Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_std11.73Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_diff125.73Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_max28.51Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_std12.14Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_diff13.55Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_max15.92Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_std12.28Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_100_diff15.75Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_100_max16.94Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_100_std12.35Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_10_diff113.83Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_10_max22.54Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_10_std11.44Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1_diff140.5Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1_max37.6Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_1_std20.3Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_20_diff110.2Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_20_max21.32Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_20_std11.59Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_3_diff124.19Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_3_max28.6Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_3_std8.38Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_5_diff119.68Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_5_max24.54Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_precision_at_5_std9.83Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_diff13.55Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_max15.92Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_std12.28Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_100_diff15.75Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_100_max16.94Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_100_std12.35Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_10_diff113.83Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_10_max22.54Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_10_std11.44Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1_diff140.5Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1_max37.6Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_1_std20.3Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_20_diff110.2Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_20_max21.32Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_20_std11.59Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_3_diff124.19Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_3_max28.6Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_3_std8.38Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_5_diff119.68Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_5_max24.54Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
nauc_recall_at_5_std9.83Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_12.39Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_104.54Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_1006.53Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_10009.8Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_205.14Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_33.53Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
ndcg_at_53.98Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_12.39Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_100.72Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_1000.17Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_10000.05Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_200.48Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_31.44Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
precision_at_51.08Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_12.39Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_107.2Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_10017.37Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_100045.21Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_209.59Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_34.33Model cardNot counted: not on our list
MTEB AppsRetrieval (default)
default · test
Not counted: not on our list
recall_at_55.42Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_127.17Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_1042.62Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_10043.58Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_100043.59Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_2043.38Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_337.48Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
map_at_540.42Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_127.67Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_1042.8Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_10043.76Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_100043.77Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_2043.56Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_337.62Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
mrr_at_540.62Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1000_diff19.04Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1000_max-1.53Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1000_std-1.85Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_100_diff19.05Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_100_max-1.52Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_100_std-1.84Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_10_diff19Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_10_max-1.33Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_10_std-1.98Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1_diff110.81Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1_max-4.32Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_1_std-3.55Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_20_diff19.1Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_20_max-1.34Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_20_std-1.74Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_3_diff18.73Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_3_max-1.98Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_3_std-2.67Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_5_diff18.41Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_5_max-2.13Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_map_at_5_std-2.36Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_diff17.5Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_max-2.26Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_100_std-1.68Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_diff17.5Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_max-2.05Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_10_std-1.82Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_diff19.22Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_max-4.23Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_1_std-3Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_diff17.56Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_max-2.08Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_20_std-1.59Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_diff17.21Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_max-2.84Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_3_std-2.54Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_diff16.96Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_max-2.83Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_mrr_at_5_std-2.15Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_diff19.06Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_max-0.68Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1000_std-1.05Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_diff19.24Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_max-0.36Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_100_std-0.67Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_diff19.11Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_max0.77Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_10_std-0.95Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_diff110.81Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_max-4.32Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_1_std-3.55Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_diff19.58Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_max1.01Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_20_std0.15Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_diff18.33Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_max-1.16Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_3_std-2.59Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_diff17.68Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_max-1.4Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_ndcg_at_5_std-1.96Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_diff13.72Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_max14.42Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1000_std56.9Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_100_diff124.06Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_100_max31.3Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_100_std47.16Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_10_diff110.5Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_10_max12.71Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_10_std4.97Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1_diff110.81Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1_max-4.32Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_1_std-3.55Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_20_diff117.64Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_20_max28.26Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_20_std23.77Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_3_diff17.25Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_3_max1.24Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_3_std-2.42Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_5_diff15.24Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_5_max0.98Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_precision_at_5_std-0.57Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_diff13.72Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_max14.42Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1000_std56.9Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_100_diff124.06Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_100_max31.3Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_100_std47.16Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_10_diff110.5Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_10_max12.71Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_10_std4.97Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1_diff110.81Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1_max-4.32Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_1_std-3.55Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_20_diff117.64Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_20_max28.26Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_20_std23.77Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_3_diff17.25Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_3_max1.24Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_3_std-2.42Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_5_diff15.24Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_5_max0.98Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
nauc_recall_at_5_std-0.57Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_127.17Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_1051.66Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_10055.66Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_100055.88Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_2054.34Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_341.08Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
ndcg_at_546.38Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_127.17Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_108.07Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_1000.98Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_10000.1Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_204.56Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_317.19Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
precision_at_512.89Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_127.17Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_1080.65Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_10097.94Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_100099.57Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_2091.11Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_351.57Model cardNot counted: not on our list
MTEB ArguAna (default)
default · test
Not counted: not on our list
recall_at_564.44Model cardNot counted: not on our list

The capability score counts results the model’s authors publish, for the benchmarks our methodology lists, where at least two models in the catalog report the same benchmark, configuration and metric. Results a card attributes to the Open LLM Leaderboard are the leaderboard’s runs, and Epoch AI’s evaluations are Epoch’s: neither counts. How we score capability