BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

GPQA

Benchmark Family
GPQA
Organization
New York University
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedgpqa/defaultACTIVE1
Diamondgpqa/diamondACTIVE405

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-007QWEN330BA3B2507-002 Qwen3 30B A3B 2507 GPQA Diamond Accuracy 70.7% Unknown Primary source QWEN-QWEN330BA3B2507
BR-007QWEN330BA3B2507INSTRUCT-002 Qwen3 30B A3B 2507 Instruct GPQA Diamond Accuracy 65.9% Unknown Primary source QWEN-QWEN330BA3B2507INSTRUCT
BR-007QWEN332B-002 Qwen3 32B GPQA Diamond Accuracy 66.8% Unknown Primary source QWEN-QWEN332B
BR-007QWEN332B-016 Qwen3 32B GPQA Diamond Accuracy 53.5% Unknown Primary source QWEN-QWEN332B
BR-007QWEN34B-002 Qwen3 4B GPQA Diamond Accuracy 52.2% Unknown Primary source QWEN-QWEN34B
BR-007QWEN34B-009 Qwen3 4B GPQA Diamond Accuracy 39.8% Unknown Primary source QWEN-QWEN34B
BR-007QWEN34B2507-002 Qwen3 4B 2507 GPQA Diamond Accuracy 66.7% Unknown Primary source QWEN-QWEN34B2507
BR-007QWEN34B2507INSTRUCT-002 Qwen3 4B 2507 Instruct GPQA Diamond Accuracy 51.7% Unknown Primary source QWEN-QWEN34B2507INSTRUCT
BR-007QWEN3508B-002 Qwen3.5 0.8B GPQA Diamond Accuracy 23.6% Unknown Primary source QWEN-QWEN3508B
BR-007QWEN3508B-016 Qwen3.5 0.8B GPQA Diamond Accuracy 11.1% Unknown Primary source QWEN-QWEN3508B
BR-007QWEN35122BA10B-002 Qwen3.5 122B A10B GPQA Diamond Accuracy 82.7% Unknown Primary source QWEN-QWEN35122BA10B
BR-007QWEN35122BA10B-017 Qwen3.5 122B A10B GPQA Diamond Accuracy 85.7% Unknown Primary source QWEN-QWEN35122BA10B
BR-007QWEN3527B-002 Qwen3.5 27B GPQA Diamond Accuracy 85.8% Unknown Primary source QWEN-QWEN3527B
BR-007QWEN3527B-015 Qwen3.5 27B GPQA Diamond Accuracy 84.2% Unknown Primary source QWEN-QWEN3527B
BR-007QWEN352B-002 Qwen3.5 2B GPQA Diamond Accuracy 43.8% Unknown Primary source QWEN-QWEN352B
BR-007QWEN352B-017 Qwen3.5 2B GPQA Diamond Accuracy 45.6% Unknown Primary source QWEN-QWEN352B
BR-007QWEN3535BA3B-002 Qwen3.5 35B A3B GPQA Diamond Accuracy 84.5% Unknown Primary source QWEN-QWEN3535BA3B
BR-007QWEN3535BA3B-015 Qwen3.5 35B A3B GPQA Diamond Accuracy 81.9% Unknown Primary source QWEN-QWEN3535BA3B
BR-007QWEN35397BA17B-002 Qwen3.5 397B A17B GPQA Diamond Accuracy 89.3% Unknown Primary source QWEN-QWEN35397BA17B
BR-007QWEN35397BA17B-019 Qwen3.5 397B A17B GPQA Diamond Accuracy 86.1% Unknown Primary source QWEN-QWEN35397BA17B
BR-007QWEN354B-002 Qwen3.5 4B GPQA Diamond Accuracy 71.2% Unknown Primary source QWEN-QWEN354B
BR-007QWEN354B-016 Qwen3.5 4B GPQA Diamond Accuracy 77.1% Unknown Primary source QWEN-QWEN354B
BR-007QWEN359B-002 Qwen3.5 9B GPQA Diamond Accuracy 78.6% Unknown Primary source QWEN-QWEN359B
BR-007QWEN359B-016 Qwen3.5 9B GPQA Diamond Accuracy 80.6% Unknown Primary source QWEN-QWEN359B
BR-007QWEN35OMNIFLASH-002 Qwen3.5 Omni Flash GPQA Diamond Accuracy 74.2% Unknown Primary source QWEN-QWEN35OMNIFLASH
BR-007QWEN35OMNIPLUS-002 Qwen3.5 Omni Plus GPQA Diamond Accuracy 82.6% Unknown Primary source QWEN-QWEN35OMNIPLUS
BR-007QWEN3627B-002 Qwen3.6 27B GPQA Diamond Accuracy 82.9% Unknown Primary source QWEN-QWEN3627B
BR-007QWEN3627B-017 Qwen3.6 27B GPQA Diamond Accuracy 84.2% Unknown Primary source QWEN-QWEN3627B
BR-007QWEN3635BA3B-002 Qwen3.6 35B A3B GPQA Diamond Accuracy 81.7% Unknown Primary source QWEN-QWEN3635BA3B
BR-007QWEN3635BA3B-015 Qwen3.6 35B A3B GPQA Diamond Accuracy 84.1% Unknown Primary source QWEN-QWEN3635BA3B
BR-007QWEN36MAXPREVIEW-002 Qwen3.6 Max Preview GPQA Diamond Accuracy 88.8% Unknown Primary source QWEN-QWEN36MAXPREVIEW
BR-007QWEN36PLUS-002 Qwen3.6 Plus GPQA Diamond Accuracy 88.2% Unknown Primary source QWEN-QWEN36PLUS
BR-007QWEN37MAX-002 Qwen3.7 Max GPQA Diamond Accuracy 92.3% Unknown Primary source QWEN-QWEN37MAX
BR-007QWEN37PLUS-002 Qwen3.7 Plus GPQA Diamond Accuracy 90% Unknown Primary source QWEN-QWEN37PLUS
BR-007QWEN38B-002 Qwen3 8B GPQA Diamond Accuracy 58.9% Unknown Primary source QWEN-QWEN38B
BR-007QWEN38B-016 Qwen3 8B GPQA Diamond Accuracy 45.2% Unknown Primary source QWEN-QWEN38B
BR-007QWEN3CODER30BA3BINSTRUCT-002 Qwen3 Coder 30B A3B Instruct GPQA Diamond Accuracy 51.6% Unknown Primary source QWEN-QWEN3CODER30BA3BINSTRUCT
BR-007QWEN3CODER480BA35BINSTRUCT-002 Qwen3 Coder 480B A35B Instruct GPQA Diamond Accuracy 61.8% Unknown Primary source QWEN-QWEN3CODER480BA35BINSTRUCT
BR-007QWEN3CODERNEXT-002 Qwen3 Coder Next GPQA Diamond Accuracy 73.7% Unknown Primary source QWEN-QWEN3CODERNEXT
BR-007QWEN3MAX-002 Qwen3 Max GPQA Diamond Accuracy 76.4% Unknown Primary source QWEN-QWEN3MAX
BR-007QWEN3MAXPREVIEW-002 Qwen3 Max (Preview) GPQA Diamond Accuracy 76.4% Unknown Primary source QWEN-QWEN3MAXPREVIEW
BR-007QWEN3MAXTHINKING-002 Qwen3 Max Thinking GPQA Diamond Accuracy 86.1% Unknown Primary source QWEN-QWEN3MAXTHINKING
BR-007QWEN3MAXTHINKINGPREVIEW-002 Qwen3 Max Thinking (Preview) GPQA Diamond Accuracy 77.6% Unknown Primary source QWEN-QWEN3MAXTHINKINGPREVIEW
BR-007QWEN3NEXT80BA3B-002 Qwen3 Next 80B A3B GPQA Diamond Accuracy 75.9% Unknown Primary source QWEN-QWEN3NEXT80BA3B
BR-007QWEN3NEXT80BA3BINSTRUCT-002 Qwen3 Next 80B A3B Instruct GPQA Diamond Accuracy 73.8% Unknown Primary source QWEN-QWEN3NEXT80BA3BINSTRUCT
BR-007QWEN3OMNI30BA3B-002 Qwen3 Omni 30B A3B GPQA Diamond Accuracy 72.6% Unknown Primary source QWEN-QWEN3OMNI30BA3B
BR-007QWEN3OMNI30BA3BINSTRUCT-002 Qwen3 Omni 30B A3B Instruct GPQA Diamond Accuracy 62% Unknown Primary source QWEN-QWEN3OMNI30BA3BINSTRUCT
BR-007QWEN3VL235BA22B-002 Qwen3 VL 235B A22B GPQA Diamond Accuracy 77.2% Unknown Primary source QWEN-QWEN3VL235BA22B
BR-007QWEN3VL235BA22BINSTRUCT-002 Qwen3 VL 235B A22B Instruct GPQA Diamond Accuracy 71.2% Unknown Primary source QWEN-QWEN3VL235BA22BINSTRUCT
BR-007QWEN3VL30BA3B-002 Qwen3 VL 30B A3B GPQA Diamond Accuracy 72% Unknown Primary source QWEN-QWEN3VL30BA3B
BR-007QWEN3VL30BA3BINSTRUCT-002 Qwen3 VL 30B A3B Instruct GPQA Diamond Accuracy 69.5% Unknown Primary source QWEN-QWEN3VL30BA3BINSTRUCT
BR-007QWEN3VL32B-002 Qwen3 VL 32B GPQA Diamond Accuracy 73.3% Unknown Primary source QWEN-QWEN3VL32B
BR-007QWEN3VL32BINSTRUCT-002 Qwen3 VL 32B Instruct GPQA Diamond Accuracy 67.1% Unknown Primary source QWEN-QWEN3VL32BINSTRUCT
BR-007QWEN3VL4B-002 Qwen3 VL 4B GPQA Diamond Accuracy 49.4% Unknown Primary source QWEN-QWEN3VL4B
BR-007QWEN3VL4BINSTRUCT-002 Qwen3 VL 4B Instruct GPQA Diamond Accuracy 37.1% Unknown Primary source QWEN-QWEN3VL4BINSTRUCT
BR-007QWEN3VL8B-002 Qwen3 VL 8B GPQA Diamond Accuracy 57.9% Unknown Primary source QWEN-QWEN3VL8B
BR-007QWEN3VL8BINSTRUCT-002 Qwen3 VL 8B Instruct GPQA Diamond Accuracy 42.7% Unknown Primary source QWEN-QWEN3VL8BINSTRUCT
BR-007QWQ32B-002 QwQ 32B GPQA Diamond Accuracy 59.3% Unknown Primary source QWEN-QWQ32B
BR-007QWQ32BPREVIEW-002 QwQ 32B-Preview GPQA Diamond Accuracy 55.7% Unknown Primary source QWEN-QWQ32BPREVIEW
BR-008DEEPSEEKCODERV2LITEINSTRUCT-002 DeepSeek Coder V2 Lite Instruct GPQA Diamond Accuracy 31.9% Unknown Primary source DPSK-DEEPSEEKCODERV2LITEINSTRUCT
BR-008DEEPSEEKR10528MAY25-002 DeepSeek R1 0528 (May '25) GPQA Diamond Accuracy 81.3% Unknown Primary source DPSK-DEEPSEEKR10528MAY25
BR-008DEEPSEEKR10528QWEN38B-002 DeepSeek R1 0528 Qwen3 8B GPQA Diamond Accuracy 61.2% Unknown Primary source DPSK-DEEPSEEKR10528QWEN38B
BR-008DEEPSEEKR1DISTILLLLAMA70B-002 DeepSeek R1 Distill Llama 70B GPQA Diamond Accuracy 40.2% Unknown Primary source DPSK-DEEPSEEKR1DISTILLLLAMA70B
BR-008DEEPSEEKR1DISTILLLLAMA8B-002 DeepSeek R1 Distill Llama 8B GPQA Diamond Accuracy 30.2% Unknown Primary source DPSK-DEEPSEEKR1DISTILLLLAMA8B
BR-008DEEPSEEKR1DISTILLQWEN14B-002 DeepSeek R1 Distill Qwen 14B GPQA Diamond Accuracy 48.4% Unknown Primary source DPSK-DEEPSEEKR1DISTILLQWEN14B
BR-008DEEPSEEKR1DISTILLQWEN15B-002 DeepSeek R1 Distill Qwen 1.5B GPQA Diamond Accuracy 9.8% Unknown Primary source DPSK-DEEPSEEKR1DISTILLQWEN15B
BR-008DEEPSEEKR1DISTILLQWEN32B-002 DeepSeek R1 Distill Qwen 32B GPQA Diamond Accuracy 61.5% Unknown Primary source DPSK-DEEPSEEKR1DISTILLQWEN32B
BR-008DEEPSEEKR1JAN25-002 DeepSeek R1 (Jan '25) GPQA Diamond Accuracy 70.8% Unknown Primary source DPSK-DEEPSEEKR1JAN25
BR-008DEEPSEEKV30324-002 DeepSeek V3 0324 GPQA Diamond Accuracy 65.5% Unknown Primary source DPSK-DEEPSEEKV30324
BR-008DEEPSEEKV31-002 DeepSeek V3.1 GPQA Diamond Accuracy 77.9% Unknown Primary source DPSK-DEEPSEEKV31
BR-008DEEPSEEKV31-013 DeepSeek V3.1 GPQA Diamond Accuracy 73.5% Unknown Primary source DPSK-DEEPSEEKV31
BR-008DEEPSEEKV31TERMINUS-002 DeepSeek V3.1 Terminus GPQA Diamond Accuracy 79.2% Unknown Primary source DPSK-DEEPSEEKV31TERMINUS
BR-008DEEPSEEKV31TERMINUS-016 DeepSeek V3.1 Terminus GPQA Diamond Accuracy 75.1% Unknown Primary source DPSK-DEEPSEEKV31TERMINUS
BR-008DEEPSEEKV32-002 DeepSeek V3.2 GPQA Diamond Accuracy 75.1% Unknown Primary source DPSK-DEEPSEEKV32
BR-008DEEPSEEKV32-013 DeepSeek V3.2 GPQA Diamond Accuracy 84% Unknown Primary source DPSK-DEEPSEEKV32
BR-008DEEPSEEKV32EXP-002 DeepSeek V3.2 Exp GPQA Diamond Accuracy 73.8% Unknown Primary source DPSK-DEEPSEEKV32EXP
BR-008DEEPSEEKV32EXP-013 DeepSeek V3.2 Exp GPQA Diamond Accuracy 79.7% Unknown Primary source DPSK-DEEPSEEKV32EXP
BR-008DEEPSEEKV32SPECIALE-002 DeepSeek V3.2 Speciale GPQA Diamond Accuracy 87.1% Unknown Primary source DPSK-DEEPSEEKV32SPECIALE
BR-008DEEPSEEKV3DEC24-002 DeepSeek V3 (Dec '24) GPQA Diamond Accuracy 55.7% Unknown Primary source DPSK-DEEPSEEKV3DEC24
BR-008DEEPSEEKV4FLASH-002 DeepSeek V4 Flash GPQA Diamond Accuracy 86.7% Unknown Primary source DPSK-DEEPSEEKV4FLASH
BR-008DEEPSEEKV4FLASH-013 DeepSeek V4 Flash GPQA Diamond Accuracy 71.6% Unknown Primary source DPSK-DEEPSEEKV4FLASH
BR-008DEEPSEEKV4FLASH-024 DeepSeek V4 Flash GPQA Diamond Accuracy 89.4% Unknown Primary source DPSK-DEEPSEEKV4FLASH
BR-008DEEPSEEKV4PRO-002 DeepSeek V4 Pro GPQA Diamond Accuracy 90.5% Unknown Primary source DPSK-DEEPSEEKV4PRO
BR-008DEEPSEEKV4PRO-014 DeepSeek V4 Pro GPQA Diamond Accuracy 71.7% Unknown Primary source DPSK-DEEPSEEKV4PRO
BR-008DEEPSEEKV4PRO-025 DeepSeek V4 Pro GPQA Diamond Accuracy 88.8% Unknown Primary source DPSK-DEEPSEEKV4PRO
BR-008V4FLASH-004 DeepSeek V4-Flash GPQA Diamond Pass@1 88.1 Unknown Primary source DPSK-V4FLASH
BR-008V4PRO-004 DeepSeek V4-Pro GPQA Diamond Pass@1 90.1 Unknown Primary source DPSK-V4PRO
BR-009LLAMA2CHAT13B-002 Llama 2 Chat 13B GPQA Diamond Accuracy 32.1% Unknown Primary source META-LLAMA2CHAT13B
BR-009LLAMA2CHAT70B-002 Llama 2 Chat 70B GPQA Diamond Accuracy 32.7% Unknown Primary source META-LLAMA2CHAT70B
BR-009LLAMA2CHAT7B-002 Llama 2 Chat 7B GPQA Diamond Accuracy 22.7% Unknown Primary source META-LLAMA2CHAT7B
BR-009LLAMA31INSTRUCT405B-002 Llama 3.1 Instruct 405B GPQA Diamond Accuracy 51.5% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT70B-002 Llama 3.1 Instruct 70B GPQA Diamond Accuracy 40.9% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT8B-002 Llama 3.1 Instruct 8B GPQA Diamond Accuracy 25.9% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA32INSTRUCT11BVISION-002 Llama 3.2 Instruct 11B (Vision) GPQA Diamond Accuracy 22.1% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT1B-002 Llama 3.2 Instruct 1B GPQA Diamond Accuracy 19.6% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT3B-002 Llama 3.2 Instruct 3B GPQA Diamond Accuracy 25.5% Unknown Primary source META-LLAMA32INSTRUCT3B
BR-009LLAMA32INSTRUCT90BVISION-002 Llama 3.2 Instruct 90B (Vision) GPQA Diamond Accuracy 43.2% Unknown Primary source META-LLAMA32INSTRUCT90BVISION
BR-009LLAMA33INSTRUCT70B-002 Llama 3.3 Instruct 70B GPQA Diamond Accuracy 49.8% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA3INSTRUCT70B-002 Llama 3 Instruct 70B GPQA Diamond Accuracy 37.9% Unknown Primary source META-LLAMA3INSTRUCT70B
BR-009LLAMA3INSTRUCT8B-002 Llama 3 Instruct 8B GPQA Diamond Accuracy 29.6% Unknown Primary source META-LLAMA3INSTRUCT8B