BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database
Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

GPQA

Benchmark Family
GPQA
Organization
New York University
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedgpqa/defaultACTIVE1
Diamondgpqa/diamondACTIVE405

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-009LLAMA4MAVERICK-002 Llama 4 Maverick GPQA Diamond Accuracy 67.1% Unknown Primary source META-LLAMA4MAVERICK
BR-009LLAMA4SCOUT-002 Llama 4 Scout GPQA Diamond Accuracy 58.7% Unknown Primary source META-LLAMA4SCOUT
BR-009MUSESPARK-002 Muse Spark GPQA Diamond Accuracy 88.4% Unknown Primary source META-MUSESPARK
BR-009MUSESPARK11-002 Muse Spark 1.1 GPQA Diamond Accuracy 89.8% Unknown Primary source META-MS11
BR-010KIMIK2-002 Kimi K2 GPQA Diamond Accuracy 76.6% Unknown Primary source KIMI-KIMIK2
BR-010KIMIK20905-002 Kimi K2 0905 GPQA Diamond Accuracy 76.7% Unknown Primary source KIMI-KIMIK20905
BR-010KIMIK25-002 Kimi K2.5 GPQA Diamond Accuracy 87.9% Unknown Primary source KIMI-KIMIK25
BR-010KIMIK25-015 Kimi K2.5 GPQA Diamond Accuracy 78.9% Unknown Primary source KIMI-KIMIK25
BR-010KIMIK26-002 Kimi K2.6 GPQA Diamond Accuracy 91.1% Unknown Primary source KIMI-KIMIK26
BR-010KIMIK26-019 Kimi K2.6 GPQA Diamond Accuracy 78.8% Unknown Primary source KIMI-KIMIK26
BR-010KIMIK27CODE-002 Kimi K2.7 Code GPQA Diamond Accuracy 89.6% Unknown Primary source KIMI-KIMIK27CODE
BR-010KIMIK2THINKING-002 Kimi K2 Thinking GPQA Diamond Accuracy 83.8% Unknown Primary source KIMI-KIMIK2THINKING
BR-010KIMILINEAR48BA3BINSTRUCT-002 Kimi Linear 48B A3B Instruct GPQA Diamond Accuracy 41.2% Unknown Primary source KIMI-KIMILINEAR48BA3BINSTRUCT
BR-01145-002 GLM-4.5 GPQA Diamond Accuracy 78.2% Unknown Primary source GLM-45
BR-01146-002 GLM-4.6 GPQA Diamond Accuracy 78% Unknown Primary source GLM-46
BR-01146-016 GLM-4.6 GPQA Diamond Accuracy 63.2% Unknown Primary source GLM-46
BR-01147-002 GLM-4.7 GPQA Diamond Accuracy 85.9% Unknown Primary source GLM-47
BR-01147-016 GLM-4.7 GPQA Diamond Accuracy 66.4% Unknown Primary source GLM-47
BR-0115-002 GLM-5 GPQA Diamond Accuracy 82% Unknown Primary source GLM-5
BR-0115-014 GLM-5 GPQA Diamond Accuracy 66.6% Unknown Primary source GLM-5
BR-01151-002 GLM-5.1 GPQA Diamond Accuracy 86.8% Unknown Primary source GLM-51
BR-01151-017 GLM-5.1 GPQA Diamond Accuracy 83.9% Unknown Primary source GLM-51
BR-01152-009 GLM-5.2 GPQA Diamond Accuracy 91.2 Unknown Primary source GLM-52
BR-011GLM45AIR-002 GLM-4.5-Air GPQA Diamond Accuracy 73.3% Unknown Primary source GLM-GLM45AIR
BR-011GLM45V-002 GLM-4.5V GPQA Diamond Accuracy 57.3% Unknown Primary source GLM-GLM45V
BR-011GLM45V-014 GLM-4.5V GPQA Diamond Accuracy 68.4% Unknown Primary source GLM-GLM45V
BR-011GLM46V-002 GLM-4.6V GPQA Diamond Accuracy 56.6% Unknown Primary source GLM-GLM46V
BR-011GLM46V-014 GLM-4.6V GPQA Diamond Accuracy 71.9% Unknown Primary source GLM-GLM46V
BR-011GLM47FLASH-002 GLM-4.7-Flash GPQA Diamond Accuracy 58.1% Unknown Primary source GLM-GLM47FLASH
BR-011GLM47FLASH-013 GLM-4.7-Flash GPQA Diamond Accuracy 45.2% Unknown Primary source GLM-GLM47FLASH
BR-011GLM5TURBO-002 GLM-5-Turbo GPQA Diamond Accuracy 84.7% Unknown Primary source GLM-GLM5TURBO
BR-011GLM5VTURBO-002 GLM 5V Turbo GPQA Diamond Accuracy 80.9% Unknown Primary source GLM-GLM5VTURBO
BR-012MINIMAXM140K-002 MiniMax M1 40k GPQA Diamond Accuracy 68.2% Unknown Primary source MMAX-MINIMAXM140K
BR-012MINIMAXM180K-002 MiniMax M1 80k GPQA Diamond Accuracy 69.7% Unknown Primary source MMAX-MINIMAXM180K
BR-012MINIMAXM2-002 MiniMax-M2 GPQA Diamond Accuracy 77.7% Unknown Primary source MMAX-MINIMAXM2
BR-012MINIMAXM21-002 MiniMax-M2.1 GPQA Diamond Accuracy 83% Unknown Primary source MMAX-MINIMAXM21
BR-012MINIMAXM25-002 MiniMax-M2.5 GPQA Diamond Accuracy 84.8% Unknown Primary source MMAX-MINIMAXM25
BR-012MINIMAXM27-002 MiniMax-M2.7 GPQA Diamond Accuracy 87.4% Unknown Primary source MMAX-MINIMAXM27
BR-012MINIMAXM3-002 MiniMax-M3 GPQA Diamond Accuracy 92.9% Unknown Primary source MMAX-M3
BR-013LG3-002 Mistral Large 3 GPQA Diamond Accuracy 68% Unknown Primary source MSTRL-LG3
BR-013SM3-002 Mistral Small 3 GPQA Diamond Accuracy 46.2% Unknown Primary source MSTRL-SM3
BR-013SM31-002 Mistral Small 3.1 GPQA Diamond Accuracy 45.4% Unknown Primary source MSTRL-SM31
BR-013SM32-002 Mistral Small 3.2 GPQA Diamond Accuracy 50.5% Unknown Primary source MSTRL-SM32
BR-013SM4-001 Mistral Small 4 GPQA Diamond Accuracy 71.2 Unknown Primary source MSTRL-SM4
BR-014COMMANDA-002 Command A GPQA Diamond Accuracy 52.7% Unknown Primary source COHR-COMMANDA
BR-014COMMANDAPLUS-002 Command A+ GPQA Diamond Accuracy 76.1% Unknown Primary source COHR-APLUS
BR-014COMMANDRMAR24-002 Command-R (Mar '24) GPQA Diamond Accuracy 28.4% Unknown Primary source COHR-COMMANDRMAR24
BR-014COMMANDRPLUSAPR24-002 Command-R+ (Apr '24) GPQA Diamond Accuracy 32.3% Unknown Primary source COHR-COMMANDRPLUSAPR24
BR-014NORTHMINICODE-002 North Mini Code GPQA Diamond Accuracy 75.7% Unknown Primary source COHR-NORTHMINICODE
BR-014TINYAYAGLOBAL-002 Tiny Aya Global GPQA Diamond Accuracy 30.5% Unknown Primary source COHR-TINYAYAGLOBAL
BR-015LLAMA31NEMOTRONINSTRUCT70B-002 Llama 3.1 Nemotron Instruct 70B GPQA Diamond Accuracy 46.5% Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONNANO4BV11-002 Llama 3.1 Nemotron Nano 4B v1.1 GPQA Diamond Accuracy 40.8% Unknown Primary source NVDA-LLAMA31NEMOTRONNANO4BV11
BR-015LLAMA31NEMOTRONULTRA253BV1-002 Llama 3.1 Nemotron Ultra 253B v1 GPQA Diamond Accuracy 72.8% Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-002 Llama 3.3 Nemotron Super 49B v1 GPQA Diamond Accuracy 64.3% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-013 Llama 3.3 Nemotron Super 49B v1 GPQA Diamond Accuracy 51.7% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMANEMOTRONSUPER49BV15-002 Llama Nemotron Super 49B v1.5 GPQA Diamond Accuracy 48.1% Unknown Primary source NVDA-LLAMANEMOTRONSUPER49BV15
BR-015LLAMANEMOTRONSUPER49BV15-013 Llama Nemotron Super 49B v1.5 GPQA Diamond Accuracy 74.8% Unknown Primary source NVDA-LLAMANEMOTRONSUPER49BV15
BR-015NEMOTRON3NANOOMNI30BA3BREASONING-002 Nemotron 3 Nano Omni 30B A3B Reasoning GPQA Diamond Accuracy 46.9% Unknown Primary source NVDA-NEMOTRON3NANOOMNI30BA3BREASONING
BR-015NEMOTRON3ULTRA550BA55B-002 Nemotron 3 Ultra 550B A55B GPQA Diamond Accuracy 86.7% Unknown Primary source NVDA-NEMOTRON3ULTRA550BA55B
BR-015NEMOTRONCASCADE230BA3B-002 Nemotron Cascade 2 30B A3B GPQA Diamond Accuracy 75.8% Unknown Primary source NVDA-NEMOTRONCASCADE230BA3B
BR-015NVIDIANEMOTRON3NANO30BA3B-002 NVIDIA Nemotron 3 Nano 30B A3B GPQA Diamond Accuracy 39.9% Unknown Primary source NVDA-NVIDIANEMOTRON3NANO30BA3B
BR-015NVIDIANEMOTRON3NANO30BA3B-014 NVIDIA Nemotron 3 Nano 30B A3B GPQA Diamond Accuracy 75.7% Unknown Primary source NVDA-NVIDIANEMOTRON3NANO30BA3B
BR-015NVIDIANEMOTRON3NANO4B-002 NVIDIA Nemotron 3 Nano 4B GPQA Diamond Accuracy 51.3% Unknown Primary source NVDA-NVIDIANEMOTRON3NANO4B
BR-015NVIDIANEMOTRON3SUPER120BA12B-002 NVIDIA Nemotron 3 Super 120B A12B GPQA Diamond Accuracy 80% Unknown Primary source NVDA-NVIDIANEMOTRON3SUPER120BA12B
BR-015NVIDIANEMOTRONNANO12BV2VL-002 NVIDIA Nemotron Nano 12B v2 VL GPQA Diamond Accuracy 57.2% Unknown Primary source NVDA-NVIDIANEMOTRONNANO12BV2VL
BR-015NVIDIANEMOTRONNANO12BV2VL-014 NVIDIA Nemotron Nano 12B v2 VL GPQA Diamond Accuracy 43.9% Unknown Primary source NVDA-NVIDIANEMOTRONNANO12BV2VL
BR-015NVIDIANEMOTRONNANO9BV2-002 NVIDIA Nemotron Nano 9B V2 GPQA Diamond Accuracy 55.7% Unknown Primary source NVDA-NVIDIANEMOTRONNANO9BV2
BR-015NVIDIANEMOTRONNANO9BV2-013 NVIDIA Nemotron Nano 9B V2 GPQA Diamond Accuracy 57% Unknown Primary source NVDA-NVIDIANEMOTRONNANO9BV2
BR-016NOVA20LITE-002 Nova 2.0 Lite GPQA Diamond Accuracy 81.1% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20LITE-017 Nova 2.0 Lite GPQA Diamond Accuracy 69.8% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20LITE-029 Nova 2.0 Lite GPQA Diamond Accuracy 60.3% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20LITE-041 Nova 2.0 Lite GPQA Diamond Accuracy 76.8% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20OMNI-002 Nova 2.0 Omni GPQA Diamond Accuracy 76% Unknown Primary source AMZN-NOVA20OMNI
BR-016NOVA20OMNI-014 Nova 2.0 Omni GPQA Diamond Accuracy 55.5% Unknown Primary source AMZN-NOVA20OMNI
BR-016NOVA20OMNI-026 Nova 2.0 Omni GPQA Diamond Accuracy 69.9% Unknown Primary source AMZN-NOVA20OMNI
BR-016NOVA20PROPREVIEW-002 Nova 2.0 Pro Preview GPQA Diamond Accuracy 78.5% Unknown Primary source AMZN-NOVA20PROPREVIEW
BR-016NOVA20PROPREVIEW-017 Nova 2.0 Pro Preview GPQA Diamond Accuracy 63.6% Unknown Primary source AMZN-NOVA20PROPREVIEW
BR-016NOVA20PROPREVIEW-031 Nova 2.0 Pro Preview GPQA Diamond Accuracy 75.1% Unknown Primary source AMZN-NOVA20PROPREVIEW
BR-016NOVALITE-002 Nova Lite GPQA Diamond Accuracy 43.3% Unknown Primary source AMZN-NOVALITE
BR-016NOVAMICRO-002 Nova Micro GPQA Diamond Accuracy 35.8% Unknown Primary source AMZN-NOVAMICRO
BR-016NOVAPREMIER-002 Nova Premier GPQA Diamond Accuracy 56.9% Unknown Primary source AMZN-NOVAPREMIER
BR-016NOVAPRO-002 Nova Pro GPQA Diamond Accuracy 49.9% Unknown Primary source AMZN-NOVAPRO
BR-017GRANITE338B-002 Granite 3.3 8B GPQA Diamond Accuracy 33.8% Unknown Primary source IBM-GRANITE338B
BR-017GRANITE401B-002 Granite 4.0 1B GPQA Diamond Accuracy 28.1% Unknown Primary source IBM-GRANITE401B
BR-017GRANITE40350M-002 Granite 4.0 350M GPQA Diamond Accuracy 26.1% Unknown Primary source IBM-GRANITE40350M
BR-017GRANITE40H1B-002 Granite 4.0 H 1B GPQA Diamond Accuracy 26.3% Unknown Primary source IBM-GRANITE40H1B
BR-017GRANITE40H350M-002 Granite 4.0 H 350M GPQA Diamond Accuracy 25.7% Unknown Primary source IBM-GRANITE40H350M
BR-017GRANITE40HSMALL-002 Granite 4.0 H Small GPQA Diamond Accuracy 41.6% Unknown Primary source IBM-GRANITE40HSMALL
BR-017GRANITE40MICRO-002 Granite 4.0 Micro GPQA Diamond Accuracy 33.6% Unknown Primary source IBM-GRANITE40MICRO
BR-017GRANITE4130B-002 Granite 4.1 30B GPQA Diamond Accuracy 48.1% Unknown Primary source IBM-GRANITE4130B
BR-017GRANITE413B-002 Granite 4.1 3B GPQA Diamond Accuracy 31.4% Unknown Primary source IBM-GRANITE413B
BR-017GRANITE418B-002 Granite 4.1 8B GPQA Diamond Accuracy 43.3% Unknown Primary source IBM-GRANITE418B
BR-018LLAMA31TULU3405B-002 Llama 3.1 Tulu3 405B GPQA Diamond Accuracy 51.6% Unknown Primary source AI2-LLAMA31TULU3405B
BR-018MOLMO28B-002 Molmo2-8B GPQA Diamond Accuracy 42.5% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO7BD-002 Molmo 7B-D GPQA Diamond Accuracy 24% Unknown Primary source AI2-MOLMO7BD
BR-018OLMO232B-002 OLMo 2 32B GPQA Diamond Accuracy 32.8% Unknown Primary source AI2-OLMO232B
BR-018OLMO27B-002 OLMo 2 7B GPQA Diamond Accuracy 28.8% Unknown Primary source AI2-OLMO27B
BR-018OLMO3132BINSTRUCT-002 Olmo 3.1 32B Instruct GPQA Diamond Accuracy 53.9% Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BTHINK-002 Olmo 3.1 32B Think GPQA Diamond Accuracy 59.1% Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO332BTHINK-002 Olmo 3 32B Think GPQA Diamond Accuracy 61% Unknown Primary source AI2-OLMO332BTHINK