BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database
Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

GPQA

Benchmark Family
GPQA
Organization
New York University
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedgpqa/defaultACTIVE1
Diamondgpqa/diamondACTIVE405

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-018OLMO37BINSTRUCT-002 Olmo 3 7B Instruct GPQA Diamond Accuracy 40% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BTHINK-002 Olmo 3 7B Think GPQA Diamond Accuracy 51.6% Unknown Primary source AI2-OLMO37BTHINK
BR-019MIMOV25-002 MiMo-V2.5 GPQA Diamond Accuracy 84.9% Unknown Primary source XIAOM-MIMOV25
BR-019MIMOV25PRO-002 MiMo-V2.5-Pro GPQA Diamond Accuracy 86.6% Unknown Primary source XIAOM-MIMOV25PRO
BR-019MIMOV25PRO-018 MiMo-V2.5-Pro GPQA Diamond Accuracy 76.2% Unknown Primary source XIAOM-MIMOV25PRO
BR-019MIMOV2FLASH-002 MiMo-V2-Flash GPQA Diamond Accuracy 65.6% Unknown Primary source XIAOM-MIMOV2FLASH
BR-019MIMOV2FLASH-016 MiMo-V2-Flash GPQA Diamond Accuracy 84.6% Unknown Primary source XIAOM-MIMOV2FLASH
BR-019MIMOV2FLASHFEB2026-002 MiMo-V2-Flash (Feb 2026) GPQA Diamond Accuracy 83.5% Unknown Primary source XIAOM-MIMOV2FLASHFEB2026
BR-019MIMOV2OMNI-002 MiMo-V2-Omni GPQA Diamond Accuracy 82.8% Unknown Primary source XIAOM-MIMOV2OMNI
BR-019MIMOV2OMNI0327-002 MiMo-V2-Omni-0327 GPQA Diamond Accuracy 85.5% Unknown Primary source XIAOM-MIMOV2OMNI0327
BR-019MIMOV2PRO-002 MiMo-V2-Pro GPQA Diamond Accuracy 87% Unknown Primary source XIAOM-MIMOV2PRO
BR-020LFM212B-002 LFM2 1.2B GPQA Diamond Accuracy 22.8% Unknown Primary source LQAI-LFM212B
BR-020LFM224BA2B-002 LFM2 24B A2B GPQA Diamond Accuracy 47.4% Unknown Primary source LQAI-LFM224BA2B
BR-020LFM226B-002 LFM2 2.6B GPQA Diamond Accuracy 30.6% Unknown Primary source LQAI-LFM226B
BR-020LFM2512BINSTRUCT-002 LFM2.5-1.2B-Instruct GPQA Diamond Accuracy 32.6% Unknown Primary source LQAI-LFM2512BINSTRUCT
BR-020LFM2512BTHINKING-002 LFM2.5-1.2B-Thinking GPQA Diamond Accuracy 33.9% Unknown Primary source LQAI-LFM2512BTHINKING
BR-020LFM258BA1B-002 LFM2.5-8B-A1B GPQA Diamond Accuracy 51.3% Unknown Primary source LQAI-LFM258BA1B
BR-020LFM25VL16B-002 LFM2.5-VL-1.6B GPQA Diamond Accuracy 28.9% Unknown Primary source LQAI-LFM25VL16B
BR-020LFM28BA1B-002 LFM2 8B A1B GPQA Diamond Accuracy 34.4% Unknown Primary source LQAI-LFM28BA1B
BR-020LFM40B-002 LFM 40B GPQA Diamond Accuracy 32.7% Unknown Primary source LQAI-LFM40B
BR-021LING1T-002 Ling-1T GPQA Diamond Accuracy 71.9% Unknown Primary source INCAI-LING1T
BR-021LING261T-002 Ling-2.6-1T GPQA Diamond Accuracy 75.2% Unknown Primary source INCAI-LING261T
BR-021LING26FLASH-002 Ling 2.6 Flash GPQA Diamond Accuracy 59.3% Unknown Primary source INCAI-LING26FLASH
BR-021LINGFLASH20-002 Ling-flash-2.0 GPQA Diamond Accuracy 65.7% Unknown Primary source INCAI-LINGFLASH20
BR-021LINGMINI20-002 Ling-mini-2.0 GPQA Diamond Accuracy 56.2% Unknown Primary source INCAI-LINGMINI20
BR-021RING1T-002 Ring-1T GPQA Diamond Accuracy 77.4% Unknown Primary source INCAI-RING1T
BR-021RING261T-002 Ring-2.6-1T GPQA Diamond Accuracy 85.7% Unknown Primary source INCAI-RING261T
BR-021RINGFLASH20-002 Ring-flash-2.0 GPQA Diamond Accuracy 72.5% Unknown Primary source INCAI-RINGFLASH20
BR-022EXAONE4012B-002 Exaone 4.0 1.2B GPQA Diamond Accuracy 42.4% Unknown Primary source LGAI-EXAONE4012B
BR-022EXAONE4012B-013 Exaone 4.0 1.2B GPQA Diamond Accuracy 51.5% Unknown Primary source LGAI-EXAONE4012B
BR-022EXAONE4032B-002 EXAONE 4.0 32B GPQA Diamond Accuracy 62.8% Unknown Primary source LGAI-EXAONE4032B
BR-022EXAONE4032B-013 EXAONE 4.0 32B GPQA Diamond Accuracy 73.9% Unknown Primary source LGAI-EXAONE4032B
BR-022EXAONE4533B-002 EXAONE 4.5 33B GPQA Diamond Accuracy 79.4% Unknown Primary source LGAI-EXAONE4533B
BR-022KEXAONE-002 K-EXAONE GPQA Diamond Accuracy 78.3% Unknown Primary source LGAI-KEXAONE
BR-022KEXAONE-013 K-EXAONE GPQA Diamond Accuracy 69.5% Unknown Primary source LGAI-KEXAONE
BR-023DEEPHERMES3LLAMA318BPREVIEW-002 DeepHermes 3 - Llama-3.1 8B Preview GPQA Diamond Accuracy 27% Unknown Primary source NOUS-DEEPHERMES3LLAMA318BPREVIEW
BR-023DEEPHERMES3MISTRAL24BPREVIEW-002 DeepHermes 3 - Mistral 24B Preview GPQA Diamond Accuracy 38.2% Unknown Primary source NOUS-DEEPHERMES3MISTRAL24BPREVIEW
BR-023HERMES3LLAMA3170B-002 Hermes 3 - Llama-3.1 70B GPQA Diamond Accuracy 40.1% Unknown Primary source NOUS-HERMES3LLAMA3170B
BR-023HERMES4LLAMA31405B-002 Hermes 4 - Llama-3.1 405B GPQA Diamond Accuracy 72.7% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-013 Hermes 4 - Llama-3.1 405B GPQA Diamond Accuracy 53.6% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA3170B-002 Hermes 4 - Llama-3.1 70B GPQA Diamond Accuracy 49.1% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-013 Hermes 4 - Llama-3.1 70B GPQA Diamond Accuracy 69.9% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-024SOLAROPEN100B-002 Solar Open 100B GPQA Diamond Accuracy 65.7% Unknown Primary source UPSTG-SOLAROPEN100B
BR-024SOLARPRO2-002 Solar Pro 2 GPQA Diamond Accuracy 56.1% Unknown Primary source UPSTG-SOLARPRO2
BR-024SOLARPRO2-013 Solar Pro 2 GPQA Diamond Accuracy 68.7% Unknown Primary source UPSTG-SOLARPRO2
BR-024SOLARPRO2PREVIEW-002 Solar Pro 2 (Preview) GPQA Diamond Accuracy 54.4% Unknown Primary source UPSTG-SOLARPRO2PREVIEW
BR-024SOLARPRO2PREVIEW-006 Solar Pro 2 (Preview) GPQA Diamond Accuracy 57.8% Unknown Primary source UPSTG-SOLARPRO2PREVIEW
BR-024SOLARPRO3-002 Solar Pro 3 GPQA Diamond Accuracy 72.4% Unknown Primary source UPSTG-SOLARPRO3
BR-025JAMBA15LARGE-002 Jamba 1.5 Large GPQA Diamond Accuracy 42.7% Unknown Primary source AI21-JAMBA15LARGE
BR-025JAMBA15MINI-002 Jamba 1.5 Mini GPQA Diamond Accuracy 30.2% Unknown Primary source AI21-JAMBA15MINI
BR-025JAMBA16LARGE-002 Jamba 1.6 Large GPQA Diamond Accuracy 38.7% Unknown Primary source AI21-JAMBA16LARGE
BR-025JAMBA16MINI-002 Jamba 1.6 Mini GPQA Diamond Accuracy 30% Unknown Primary source AI21-JAMBA16MINI
BR-025JAMBA17LARGE-002 Jamba 1.7 Large GPQA Diamond Accuracy 39% Unknown Primary source AI21-JAMBA17LARGE
BR-025JAMBA17MINI-002 Jamba 1.7 Mini GPQA Diamond Accuracy 32.2% Unknown Primary source AI21-JAMBA17MINI
BR-025JAMBAREASONING3B-002 Jamba Reasoning 3B GPQA Diamond Accuracy 33.3% Unknown Primary source AI21-JAMBAREASONING3B
BR-026STEP35FLASH-002 Step 3.5 Flash GPQA Diamond Accuracy 83.1% Unknown Primary source STPFN-STEP35FLASH
BR-026STEP35FLASH2603-002 Step 3.5 Flash 2603 GPQA Diamond Accuracy 82.6% Unknown Primary source STPFN-STEP35FLASH2603
BR-026STEP37FLASH-002 Step 3.7 Flash GPQA Diamond Accuracy 80.9% Unknown Primary source STPFN-STEP37FLASH
BR-026STEP3VL10B-002 Step3 VL 10B GPQA Diamond Accuracy 69% Unknown Primary source STPFN-STEP3VL10B
BR-027PHI3MINIINSTRUCT38B-002 Phi-3 Mini Instruct 3.8B GPQA Diamond Accuracy 31.9% Unknown Primary source MSFT-PHI3MINIINSTRUCT38B
BR-027PHI4-002 Phi-4 GPQA Diamond Accuracy 57.5% Unknown Primary source MSFT-PHI4
BR-027PHI4MINIINSTRUCT-002 Phi-4 Mini Instruct GPQA Diamond Accuracy 33.1% Unknown Primary source MSFT-PHI4MINIINSTRUCT
BR-027PHI4MULTIMODALINSTRUCT-002 Phi-4 Multimodal Instruct GPQA Diamond Accuracy 31.5% Unknown Primary source MSFT-PHI4MULTIMODALINSTRUCT
BR-028K2THINKV2-002 K2 Think V2 GPQA Diamond Accuracy 71.3% Unknown Primary source MBZAI-K2THINKV2
BR-028K2V2-002 K2-V2 GPQA Diamond Accuracy 68.1% Unknown Primary source MBZAI-K2V2
BR-028K2V2-013 K2-V2 GPQA Diamond Accuracy 54.1% Unknown Primary source MBZAI-K2V2
BR-028K2V2-024 K2-V2 GPQA Diamond Accuracy 59.8% Unknown Primary source MBZAI-K2V2
BR-029JT35BFLASH-002 JT-35B-Flash GPQA Diamond Accuracy 82.9% Unknown Primary source CMOB-JT35BFLASH
BR-029JT41FLASH236BA21B-002 JT-4.1 Flash 236B A21B GPQA Diamond Accuracy 84.5% Unknown Primary source CMOB-JT41FLASH236BA21B
BR-029JTMINI-002 JT-MINI GPQA Diamond Accuracy 67.6% Unknown Primary source CMOB-JTMINI
BR-030SARVAM105B-002 Sarvam 105B GPQA Diamond Accuracy 73.8% Unknown Primary source SRVM-SARVAM105B
BR-030SARVAM30B-002 Sarvam 30B GPQA Diamond Accuracy 63.3% Unknown Primary source SRVM-SARVAM30B
BR-030SARVAMM-002 Sarvam M GPQA Diamond Accuracy 41.6% Unknown Primary source SRVM-SARVAMM
BR-031MINICPM51B-002 MiniCPM5-1B GPQA Diamond Accuracy 27.8% Unknown Primary source OBMB-MINICPM51B
BR-031MINICPM51B-013 MiniCPM5-1B GPQA Diamond Accuracy 26.9% Unknown Primary source OBMB-MINICPM51B
BR-031MINICPMV4613B-002 MiniCPM-V 4.6 1.3B GPQA Diamond Accuracy 30.5% Unknown Primary source OBMB-MINICPMV4613B
BR-032APERTUS70BINSTRUCT-002 Apertus 70B Instruct GPQA Diamond Accuracy 27.2% Unknown Primary source SWAI-APERTUS70BINSTRUCT
BR-032APERTUS8BINSTRUCT-002 Apertus 8B Instruct GPQA Diamond Accuracy 25.6% Unknown Primary source SWAI-APERTUS8BINSTRUCT
BR-033DOUBAOSEEDCODE-002 Doubao Seed Code GPQA Diamond Accuracy 76.4% Unknown Primary source BDSD-DOUBAOSEEDCODE
BR-033SEEDOSS36BINSTRUCT-002 Seed-OSS-36B-Instruct GPQA Diamond Accuracy 72.6% Unknown Primary source BDSD-SEEDOSS36BINSTRUCT
BR-034TRI21BTHINK-002 Tri-21B-Think GPQA Diamond Accuracy 60.1% Unknown Primary source TRLN-TRI21BTHINK
BR-034TRI21BTHINKPREVIEW-002 Tri-21B-think Preview GPQA Diamond Accuracy 53.8% Unknown Primary source TRLN-TRI21BTHINKPREVIEW
BR-035HY3PREVIEW-002 Hy3-preview GPQA Diamond Accuracy 86.7% Unknown Primary source TCNT-HY3PREVIEW
BR-035HY3PREVIEW-013 Hy3-preview GPQA Diamond Accuracy 73.2% Unknown Primary source TCNT-HY3PREVIEW
BR-036ERNIE45300BA47B-002 ERNIE 4.5 300B A47B GPQA Diamond Accuracy 81.1% Unknown Primary source BAIDU-ERNIE45300BA47B
BR-036ERNIE50THINKINGPREVIEW-002 ERNIE 5.0 Thinking Preview GPQA Diamond Accuracy 77.7% Unknown Primary source BAIDU-ERNIE50THINKINGPREVIEW
BR-037APRIELV1515BTHINKER-002 Apriel-v1.5-15B-Thinker GPQA Diamond Accuracy 71.3% Unknown Primary source SVNW-APRIELV1515BTHINKER
BR-037APRIELV1615BTHINKER-002 Apriel-v1.6-15B-Thinker GPQA Diamond Accuracy 73.3% Unknown Primary source SVNW-APRIELV1615BTHINKER
BR-038REKAFLASH3-002 Reka Flash 3 GPQA Diamond Accuracy 52.9% Unknown Primary source REKA-REKAFLASH3
BR-039MIDMK25PRO-002 Mi:dm K 2.5 Pro GPQA Diamond Accuracy 70.1% Unknown Primary source KT-MIDMK25PRO
BR-039MIDMK25PROPREVIEW-001 Mi:dm K 2.5 Pro Preview GPQA Diamond Accuracy 72.2% Unknown Primary source KT-MIDMK25PROPREVIEW
BR-040KATCODERPROV1-002 KAT-Coder-Pro V1 GPQA Diamond Accuracy 76.4% Unknown Primary source KWAI-KATCODERPROV1
BR-040KATCODERPROV2-002 KAT Coder Pro V2 GPQA Diamond Accuracy 85.5% Unknown Primary source KWAI-KATCODERPROV2
BR-041MERCURY2-002 Mercury 2 GPQA Diamond Accuracy 77% Unknown Primary source INCPT-MERCURY2
BR-042DBRXINSTRUCT-002 DBRX Instruct GPQA Diamond Accuracy 33.1% Unknown Primary source DBRX-DBRXINSTRUCT
BR-043HYPERCLOVAXSEEDTHINK32B-002 HyperCLOVA X SEED Think (32B) GPQA Diamond Accuracy 61.5% Unknown Primary source NAVER-HYPERCLOVAXSEEDTHINK32B
BR-044HYPERNOVA60B2605-002 HyperNova 60B 2605 GPQA Diamond Accuracy 73.3% Unknown Primary source MVSC-HYPERNOVA60B2605
BR-045INTELLECT3-002 INTELLECT-3 GPQA Diamond Accuracy 76.1% Unknown Primary source PRIME-INTELLECT3
BR-046NEXN2PRO-002 Nex-N2-Pro GPQA Diamond Accuracy 89.2% Unknown Primary source NEXAI-NEXN2PRO
BR-047LONGCATFLASHLITE-002 LongCat Flash Lite GPQA Diamond Accuracy 63.6% Unknown Primary source LCAT-LONGCATFLASHLITE