BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

GPQA

Benchmark Family
GPQA
Organization
New York University
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedgpqa/defaultACTIVE1
Diamondgpqa/diamondACTIVE405

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-00141-002 GPT-4.1 GPQA Diamond Accuracy 66.6% Unknown Primary source OPNAI-41
BR-0015-002 GPT-5 GPQA Diamond Accuracy 85.4% Unknown Primary source OPNAI-5
BR-0015-017 GPT-5 GPQA Diamond Accuracy 84.2% Unknown Primary source OPNAI-5
BR-0015-029 GPT-5 GPQA Diamond Accuracy 80.8% Unknown Primary source OPNAI-5
BR-0015-041 GPT-5 GPQA Diamond Accuracy 67.3% Unknown Primary source OPNAI-5
BR-00151-002 GPT-5.1 GPQA Diamond Accuracy 87.3% Unknown Primary source OPNAI-51
BR-00151-017 GPT-5.1 GPQA Diamond Accuracy 64.3% Unknown Primary source OPNAI-51
BR-00152-002 GPT-5.2 GPQA Diamond Accuracy 90.3% Unknown Primary source OPNAI-52
BR-00152-013 GPT-5.2 GPQA Diamond Accuracy 71.2% Unknown Primary source OPNAI-52
BR-00152-026 GPT-5.2 GPQA Diamond Accuracy 86.4% Unknown Primary source OPNAI-52
BR-00154-003 GPT-5.4 GPQA Diamond Accuracy 74.8% Unknown Primary source OPNAI-54
BR-00154-015 GPT-5.4 GPQA Diamond Accuracy 87.1% Unknown Primary source OPNAI-54
BR-00154-027 GPT-5.4 GPQA Diamond Accuracy 92% Unknown Primary source OPNAI-54
BR-00155-015 GPT-5.5 GPQA Diamond Accuracy 93.5% Unknown Primary source OPNAI-55
BR-00155-030 GPT-5.5 GPQA Diamond Accuracy 92.6% Unknown Primary source OPNAI-55
BR-00155-043 GPT-5.5 GPQA Diamond Accuracy 76.8% Unknown Primary source OPNAI-55
BR-00155-056 GPT-5.5 GPQA Diamond Accuracy 93.2% Unknown Primary source OPNAI-55
BR-00155-069 GPT-5.5 GPQA Diamond Accuracy 91% Unknown Primary source OPNAI-55
BR-00156LN-003 GPT-5.6 Luna GPQA Diamond Accuracy 83.5% Unknown Primary source OPNAI-56LN
BR-00156LN-014 GPT-5.6 Luna GPQA Diamond Accuracy 91.1% Unknown Primary source OPNAI-56LN
BR-00156LN-026 GPT-5.6 Luna GPQA Diamond Accuracy 85.9% Unknown Primary source OPNAI-56LN
BR-00156LN-037 GPT-5.6 Luna GPQA Diamond Accuracy 89.5% Unknown Primary source OPNAI-56LN
BR-00156LN-048 GPT-5.6 Luna GPQA Diamond Accuracy 89.2% Unknown Primary source OPNAI-56LN
BR-00156LN-059 GPT-5.6 Luna GPQA Diamond Accuracy 64.5% Unknown Primary source OPNAI-56LN
BR-00156SL-003 GPT-5.6 Sol GPQA Diamond Accuracy 89.8% Unknown Primary source OPNAI-56SL
BR-00156SL-017 GPT-5.6 Sol GPQA Diamond Accuracy 92.6% Unknown Primary source OPNAI-56SL
BR-00156SL-031 GPT-5.6 Sol GPQA Diamond Accuracy 79% Unknown Primary source OPNAI-56SL
BR-00156SL-042 GPT-5.6 Sol GPQA Diamond Accuracy 92.8% Unknown Primary source OPNAI-56SL
BR-00156SL-056 GPT-5.6 Sol GPQA Diamond Accuracy 94.1% Unknown Primary source OPNAI-56SL
BR-00156SL-071 GPT-5.6 Sol GPQA Diamond Accuracy 93.1% Unknown Primary source OPNAI-56SL
BR-00156TR-003 GPT-5.6 Terra GPQA Diamond Accuracy 87.2% Unknown Primary source OPNAI-56TR
BR-00156TR-016 GPT-5.6 Terra GPQA Diamond Accuracy 89.6% Unknown Primary source OPNAI-56TR
BR-00156TR-030 GPT-5.6 Terra GPQA Diamond Accuracy 74.6% Unknown Primary source OPNAI-56TR
BR-00156TR-041 GPT-5.6 Terra GPQA Diamond Accuracy 90.8% Unknown Primary source OPNAI-56TR
BR-00156TR-055 GPT-5.6 Terra GPQA Diamond Accuracy 92.5% Unknown Primary source OPNAI-56TR
BR-00156TR-070 GPT-5.6 Terra GPQA Diamond Accuracy 84.3% Unknown Primary source OPNAI-56TR
BR-002FB5-003 Claude Fable 5 GPQA Diamond Accuracy 92.6% Unknown Primary source ANTHR-FB5
BR-002H3-002 Claude 3 Haiku GPQA Diamond Accuracy 37.4% Unknown Primary source ANTHR-H3
BR-002H35-002 Claude 3.5 Haiku GPQA Diamond Accuracy 40.8% Unknown Primary source ANTHR-H35
BR-002H45-002 Claude 4.5 Haiku GPQA Diamond Accuracy 67.2% Unknown Primary source ANTHR-H45
BR-002H45-018 Claude 4.5 Haiku GPQA Diamond Accuracy 64.6% Unknown Primary source ANTHR-H45
BR-002O3-002 Claude 3 Opus GPQA Diamond Accuracy 48.9% Unknown Primary source ANTHR-O3
BR-002O4-002 Claude 4 Opus GPQA Diamond Accuracy 70.1% Unknown Primary source ANTHR-O4
BR-002O4-008 Claude 4 Opus GPQA Diamond Accuracy 79.6% Unknown Primary source ANTHR-O4
BR-002O41-002 Claude 4.1 Opus GPQA Diamond Accuracy 80.9% Unknown Primary source ANTHR-O41
BR-002O45-002 Claude Opus 4.5 GPQA Diamond Accuracy 86.6% Unknown Primary source ANTHR-O45
BR-002O45-014 Claude Opus 4.5 GPQA Diamond Accuracy 81% Unknown Primary source ANTHR-O45
BR-002O46-002 Claude Opus 4.6 GPQA Diamond Accuracy 84% Unknown Primary source ANTHR-O46
BR-002O46-014 Claude Opus 4.6 GPQA Diamond Accuracy 89.6% Unknown Primary source ANTHR-O46
BR-002O47-008 Claude Opus 4.7 GPQA Diamond Accuracy 94.2% Unknown Primary source ANTHR-O47
BR-002O48-013 Claude Opus 4.8 GPQA Diamond Accuracy 93.6 Unknown Primary source ANTHR-O48
BR-002S3-002 Claude 3 Sonnet GPQA Diamond Accuracy 40% Unknown Primary source ANTHR-S3
BR-002S37-002 Claude 3.7 Sonnet GPQA Diamond Accuracy 77.2% Unknown Primary source ANTHR-S37
BR-002S37-013 Claude 3.7 Sonnet GPQA Diamond Accuracy 65.6% Unknown Primary source ANTHR-S37
BR-002S4-002 Claude 4 Sonnet GPQA Diamond Accuracy 77.7% Unknown Primary source ANTHR-S4
BR-002S4-017 Claude 4 Sonnet GPQA Diamond Accuracy 68.3% Unknown Primary source ANTHR-S4
BR-002S45-002 Claude 4.5 Sonnet GPQA Diamond Accuracy 83.4% Unknown Primary source ANTHR-S45
BR-002S45-017 Claude 4.5 Sonnet GPQA Diamond Accuracy 72.7% Unknown Primary source ANTHR-S45
BR-002S46-003 Claude Sonnet 4.6 GPQA Diamond Accuracy 79.9% Unknown Primary source ANTHR-S46
BR-002S46-015 Claude Sonnet 4.6 GPQA Diamond Accuracy 87.5% Unknown Primary source ANTHR-S46
BR-002S46-032 Claude Sonnet 4.6 GPQA Diamond Accuracy 79.7% Unknown Primary source ANTHR-S46
BR-002S5-004 Claude Sonnet 5 GPQA Diamond Accuracy 91.1% Unknown Primary source ANTHR-S5
BR-002S5-017 Claude Sonnet 5 GPQA Diamond Accuracy 80% Unknown Primary source ANTHR-S5
BR-00310P-002 Gemini 1.0 Pro GPQA Diamond Accuracy 27.7% Unknown Primary source GOOGL-G10P
BR-00325F-002 Gemini 2.5 Flash GPQA Diamond Accuracy 79% Unknown Primary source GOOGL-G25F
BR-00325F-014 Gemini 2.5 Flash GPQA Diamond Accuracy 68.3% Unknown Primary source GOOGL-G25F
BR-00325P-002 Gemini 2.5 Pro GPQA Diamond Accuracy 84.4% Unknown Primary source GOOGL-G25P
BR-00331P-001 Gemini 3.1 Pro GPQA Diamond Accuracy 94.3% Unknown Primary source GOOGL-G31P
BR-00335F-004 Gemini 3.5 Flash GPQA Diamond Accuracy 92.2% Unknown Primary source GOOGL-G35F
BR-00335F-019 Gemini 3.5 Flash GPQA Diamond Accuracy 82.8% Unknown Primary source GOOGL-G35F
BR-00335F-029 Gemini 3.5 Flash GPQA Diamond Accuracy 92.1% Unknown Primary source GOOGL-G35F
BR-0043-002 Grok 3 GPQA Diamond Accuracy 69.3% Unknown Primary source XAI-G3
BR-0044-002 Grok 4 GPQA Diamond Accuracy 87.7% Unknown Primary source XAI-G4
BR-00443-002 Grok 4.3 GPQA Diamond Accuracy 89% Unknown Primary source XAI-G43
BR-00443-014 Grok 4.3 GPQA Diamond Accuracy 65.8% Unknown Primary source XAI-G43
BR-00443-029 Grok 4.3 GPQA Diamond Accuracy 90.1% Unknown Primary source XAI-G43
BR-00443-046 Grok 4.3 GPQA Diamond Accuracy 84.3% Unknown Primary source XAI-G43
BR-00445-003 Grok 4.5 GPQA Diamond Accuracy 93.1% Unknown Primary source XAI-G45
BR-00735-007 Qwen3.5-397B-A17B GPQA Accuracy 88.4 Unknown Primary source QWEN-35
BR-00737-008 Qwen3.7-Max GPQA Diamond Accuracy 90 Unknown Primary source QWEN-37
BR-007QWEN15CHAT110B-002 Qwen1.5 Chat 110B GPQA Diamond Accuracy 28.9% Unknown Primary source QWEN-QWEN15CHAT110B
BR-007QWEN25CODERINSTRUCT32B-002 Qwen2.5 Coder Instruct 32B GPQA Diamond Accuracy 41.7% Unknown Primary source QWEN-QWEN25CODERINSTRUCT32B
BR-007QWEN25CODERINSTRUCT7B-002 Qwen2.5 Coder Instruct 7B GPQA Diamond Accuracy 33.9% Unknown Primary source QWEN-QWEN25CODERINSTRUCT7B
BR-007QWEN25INSTRUCT32B-002 Qwen2.5 Instruct 32B GPQA Diamond Accuracy 46.6% Unknown Primary source QWEN-QWEN25INSTRUCT32B
BR-007QWEN25INSTRUCT72B-002 Qwen2.5 Instruct 72B GPQA Diamond Accuracy 49.1% Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25MAX-002 Qwen2.5 Max GPQA Diamond Accuracy 58.7% Unknown Primary source QWEN-QWEN25MAX
BR-007QWEN25TURBO-002 Qwen2.5 Turbo GPQA Diamond Accuracy 41% Unknown Primary source QWEN-QWEN25TURBO
BR-007QWEN2INSTRUCT72B-002 Qwen2 Instruct 72B GPQA Diamond Accuracy 37.1% Unknown Primary source QWEN-QWEN2INSTRUCT72B
BR-007QWEN306B-002 Qwen3 0.6B GPQA Diamond Accuracy 23.1% Unknown Primary source QWEN-QWEN306B
BR-007QWEN306B-013 Qwen3 0.6B GPQA Diamond Accuracy 23.9% Unknown Primary source QWEN-QWEN306B
BR-007QWEN314B-002 Qwen3 14B GPQA Diamond Accuracy 60.4% Unknown Primary source QWEN-QWEN314B
BR-007QWEN314B-016 Qwen3 14B GPQA Diamond Accuracy 47% Unknown Primary source QWEN-QWEN314B
BR-007QWEN317B-002 Qwen3 1.7B GPQA Diamond Accuracy 28.3% Unknown Primary source QWEN-QWEN317B
BR-007QWEN317B-013 Qwen3 1.7B GPQA Diamond Accuracy 35.6% Unknown Primary source QWEN-QWEN317B
BR-007QWEN3235BA22B-002 Qwen3 235B A22B GPQA Diamond Accuracy 61.3% Unknown Primary source QWEN-QWEN3235BA22B
BR-007QWEN3235BA22B-013 Qwen3 235B A22B GPQA Diamond Accuracy 70% Unknown Primary source QWEN-QWEN3235BA22B
BR-007QWEN3235BA22B2507-002 Qwen3 235B A22B 2507 GPQA Diamond Accuracy 79% Unknown Primary source QWEN-QWEN3235BA22B2507
BR-007QWEN3235BA22B2507INSTRUCT-002 Qwen3 235B A22B 2507 Instruct GPQA Diamond Accuracy 75.3% Unknown Primary source QWEN-QWEN3235BA22B2507INSTRUCT
BR-007QWEN330BA3B-002 Qwen3 30B A3B GPQA Diamond Accuracy 61.6% Unknown Primary source QWEN-QWEN330BA3B
BR-007QWEN330BA3B-013 Qwen3 30B A3B GPQA Diamond Accuracy 51.5% Unknown Primary source QWEN-QWEN330BA3B