BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

Qwen2.5 Instruct 72B

MODEL RECORD: QWEN-QWEN25INSTRUCT72B

Organization
Qwen
Family
QWEN25INSTRUCT72B
Model number
Unknown
Tier
Unknown
Status
ACTIVE
Release date
2024-09-19

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-007QWEN25INSTRUCT72B-001 Qwen2.5 Instruct 72B Artificial Analysis Intelligence Index Overall 9.6 Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25INSTRUCT72B-002 Qwen2.5 Instruct 72B GPQA Diamond Accuracy 49.1% Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25INSTRUCT72B-003 Qwen2.5 Instruct 72B Humanity's Last Exam No tools Overall 4.2% Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25INSTRUCT72B-004 Qwen2.5 Instruct 72B SciCode Overall 26.7% Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25INSTRUCT72B-005 Qwen2.5 Instruct 72B tau2-bench Overall 34.5% Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25INSTRUCT72B-006 Qwen2.5 Instruct 72B Terminal-Bench Hard Overall 4.5% Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25INSTRUCT72B-007 Qwen2.5 Instruct 72B CritPt Overall 0% Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25INSTRUCT72B-008 Qwen2.5 Instruct 72B AA-Omniscience Overall -52.2 Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25INSTRUCT72B-009 Qwen2.5 Instruct 72B AA-Omniscience Accuracy 17.6% Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25INSTRUCT72B-010 Qwen2.5 Instruct 72B IFBench Overall 36.9% Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25INSTRUCT72B-011 Qwen2.5 Instruct 72B AA-LCR Overall 20.3% Unknown Primary source QWEN-QWEN25INSTRUCT72B