BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database
Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

SWE-bench: Pro Public Dataset

Benchmark Family
SWE-bench
Version or Variant
Pro Public Dataset
Canonical Reference
swe-bench/pro-public
Release Date
Unknown
Status
ACTIVE

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-0015-060 GPT-5 SWE-bench Pro Public Dataset Resolved 41.78 ±3.49 Unknown Primary source OPNAI-5
BR-00152-054 GPT-5.2 SWE-bench Pro Public Dataset Resolved 29.94 ±2.15 Unknown Primary source OPNAI-52
BR-00154-051 GPT-5.4 SWE-bench Pro Public Dataset Resolved 59.10 ±3.56 Unknown Primary source OPNAI-54
BR-002H45-039 Claude 4.5 Haiku SWE-bench Pro Public Dataset Resolved 39.45 ±3.55 Unknown Primary source ANTHR-H45
BR-002O45-037 Claude Opus 4.5 SWE-bench Pro Public Dataset Resolved 45.89 ±3.60 Unknown Primary source ANTHR-O45
BR-002O46-035 Claude Opus 4.6 SWE-bench Pro Public Dataset Resolved 51.90 ±3.61 Unknown Primary source ANTHR-O46
BR-002S4-036 Claude 4 Sonnet SWE-bench Pro Public Dataset Resolved 42.70 ±3.59 Unknown Primary source ANTHR-S4
BR-002S45-038 Claude 4.5 Sonnet SWE-bench Pro Public Dataset Resolved 43.60 ±3.60 Unknown Primary source ANTHR-S45
BR-00330F-009 Gemini 3 Flash SWE-bench Pro Public Dataset Resolved 34.63 ±3.55 Unknown Primary source GOOGL-G30F
BR-00330P-008 Gemini 3 Pro SWE-bench Pro Public Dataset Resolved 43.30 ±3.60 Unknown Primary source GOOGL-G30P
BR-00331P-024 Gemini 3.1 Pro SWE-bench Pro Public Dataset Resolved 46.10 ±3.60 Unknown Primary source GOOGL-G31P
BR-007QWEN3235BA22B-023 Qwen3 235B A22B SWE-bench Pro Public Dataset Resolved 21.41 ±2.25 Unknown Primary source QWEN-QWEN3235BA22B
BR-007QWEN3CODER480BA35BINSTRUCT-012 Qwen3 Coder 480B A35B Instruct SWE-bench Pro Public Dataset Resolved 38.70 ±3.55 Unknown Primary source QWEN-QWEN3CODER480BA35BINSTRUCT
BR-008DEEPSEEKV32-029 DeepSeek V3.2 SWE-bench Pro Public Dataset Resolved 15.56 ±2.63 Unknown Primary source DPSK-DEEPSEEKV32
BR-009LLAMA31INSTRUCT405B-012 Llama 3.1 Instruct 405B SWE-bench Pro Public Dataset Resolved 11.18 ±2.15 Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA4MAVERICK-017 Llama 4 Maverick SWE-bench Pro Public Dataset Resolved 5.24 ±1.24 Unknown Primary source META-LLAMA4MAVERICK
BR-009MS11-004 Muse Spark 1.1 SWE-bench Pro Public Dataset Resolved 61.50 ±3.10 Unknown Primary source META-MS11
BR-009MUSESPARK-016 Muse Spark SWE-bench Pro Public Dataset Resolved 55.00 ±3.60 Unknown Primary source META-MUSESPARK
BR-010KIMIK2-012 Kimi K2 SWE-bench Pro Public Dataset Resolved 27.67 ±3.25 Unknown Primary source KIMI-KIMIK2
BR-01146-026 GLM-4.6 SWE-bench Pro Public Dataset Resolved 9.67 ±2.15 Unknown Primary source GLM-46
BR-012MINIMAXM21-012 MiniMax-M2.1 SWE-bench Pro Public Dataset Resolved 36.81 ±3.55 Unknown Primary source MMAX-MINIMAXM21