BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

Allen Institute for AI

Provider prefix
AI2
Benchmark Record namespace
018

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-018LLAMA31TULU3405B-001 Llama 3.1 Tulu3 405B Artificial Analysis Intelligence Index Overall 8.3 Unknown Primary source AI2-LLAMA31TULU3405B
BR-018LLAMA31TULU3405B-002 Llama 3.1 Tulu3 405B GPQA Diamond Accuracy 51.6% Unknown Primary source AI2-LLAMA31TULU3405B
BR-018LLAMA31TULU3405B-003 Llama 3.1 Tulu3 405B Humanity's Last Exam No tools Overall 3.5% Unknown Primary source AI2-LLAMA31TULU3405B
BR-018LLAMA31TULU3405B-004 Llama 3.1 Tulu3 405B SciCode Overall 30.2% Unknown Primary source AI2-LLAMA31TULU3405B
BR-018MOLMO28B-001 Molmo2-8B Artificial Analysis Intelligence Index Overall 2 Unknown Primary source AI2-MOLMO28B
BR-018MOLMO28B-002 Molmo2-8B GPQA Diamond Accuracy 42.5% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO28B-003 Molmo2-8B Humanity's Last Exam No tools Overall 4.4% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO28B-004 Molmo2-8B SciCode Overall 13.3% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO28B-005 Molmo2-8B tau2-bench Overall 0% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO28B-006 Molmo2-8B Terminal-Bench Hard Overall 0% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO28B-007 Molmo2-8B CritPt Overall 0% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO28B-008 Molmo2-8B AA-Omniscience Overall -69.1 Unknown Primary source AI2-MOLMO28B
BR-018MOLMO28B-009 Molmo2-8B AA-Omniscience Accuracy 11.3% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO28B-010 Molmo2-8B IFBench Overall 26.9% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO28B-011 Molmo2-8B MMMU-Pro Overall 37.5% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO28B-012 Molmo2-8B AA-LCR Overall 0% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO7BD-001 Molmo 7B-D Artificial Analysis Intelligence Index Overall 3.8 Unknown Primary source AI2-MOLMO7BD
BR-018MOLMO7BD-002 Molmo 7B-D GPQA Diamond Accuracy 24% Unknown Primary source AI2-MOLMO7BD
BR-018MOLMO7BD-003 Molmo 7B-D Humanity's Last Exam No tools Overall 5.1% Unknown Primary source AI2-MOLMO7BD
BR-018MOLMO7BD-004 Molmo 7B-D SciCode Overall 3.6% Unknown Primary source AI2-MOLMO7BD
BR-018MOLMO7BD-005 Molmo 7B-D tau2-bench Overall 0% Unknown Primary source AI2-MOLMO7BD
BR-018MOLMO7BD-006 Molmo 7B-D Terminal-Bench Hard Overall 0% Unknown Primary source AI2-MOLMO7BD
BR-018MOLMO7BD-007 Molmo 7B-D IFBench Overall 19.7% Unknown Primary source AI2-MOLMO7BD
BR-018MOLMO7BD-008 Molmo 7B-D MMMU-Pro Overall 24.5% Unknown Primary source AI2-MOLMO7BD
BR-018MOLMO7BD-009 Molmo 7B-D AA-LCR Overall 0% Unknown Primary source AI2-MOLMO7BD
BR-018OLMO232B-001 OLMo 2 32B Artificial Analysis Intelligence Index Overall 5 Unknown Primary source AI2-OLMO232B
BR-018OLMO232B-002 OLMo 2 32B GPQA Diamond Accuracy 32.8% Unknown Primary source AI2-OLMO232B
BR-018OLMO232B-003 OLMo 2 32B Humanity's Last Exam No tools Overall 3.7% Unknown Primary source AI2-OLMO232B
BR-018OLMO232B-004 OLMo 2 32B SciCode Overall 8% Unknown Primary source AI2-OLMO232B
BR-018OLMO232B-005 OLMo 2 32B tau2-bench Overall 0% Unknown Primary source AI2-OLMO232B
BR-018OLMO232B-006 OLMo 2 32B Terminal-Bench Hard Overall 0% Unknown Primary source AI2-OLMO232B
BR-018OLMO232B-007 OLMo 2 32B IFBench Overall 38.1% Unknown Primary source AI2-OLMO232B
BR-018OLMO232B-008 OLMo 2 32B AA-LCR Overall 0% Unknown Primary source AI2-OLMO232B
BR-018OLMO27B-001 OLMo 2 7B Artificial Analysis Intelligence Index Overall 3.9 Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-002 OLMo 2 7B GPQA Diamond Accuracy 28.8% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-003 OLMo 2 7B Humanity's Last Exam No tools Overall 5.5% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-004 OLMo 2 7B SciCode Overall 3.7% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-005 OLMo 2 7B tau2-bench Overall 0% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-006 OLMo 2 7B Terminal-Bench Hard Overall 0% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-007 OLMo 2 7B IFBench Overall 24.4% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-008 OLMo 2 7B AA-LCR Overall 0% Unknown Primary source AI2-OLMO27B
BR-018OLMO3132BINSTRUCT-001 Olmo 3.1 32B Instruct Artificial Analysis Intelligence Index Overall 6.5 Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BINSTRUCT-002 Olmo 3.1 32B Instruct GPQA Diamond Accuracy 53.9% Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BINSTRUCT-003 Olmo 3.1 32B Instruct Humanity's Last Exam No tools Overall 4.9% Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BINSTRUCT-004 Olmo 3.1 32B Instruct SciCode Overall 16.7% Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BINSTRUCT-005 Olmo 3.1 32B Instruct tau2-bench Overall 21.3% Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BINSTRUCT-006 Olmo 3.1 32B Instruct Terminal-Bench Hard Overall 0% Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BINSTRUCT-007 Olmo 3.1 32B Instruct CritPt Overall 0% Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BINSTRUCT-008 Olmo 3.1 32B Instruct AA-Omniscience Overall -51.1 Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BINSTRUCT-009 Olmo 3.1 32B Instruct AA-Omniscience Accuracy 11.3% Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BINSTRUCT-010 Olmo 3.1 32B Instruct IFBench Overall 39.2% Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BINSTRUCT-011 Olmo 3.1 32B Instruct AA-LCR Overall 0% Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BTHINK-001 Olmo 3.1 32B Think Artificial Analysis Intelligence Index Overall 8.1 Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO3132BTHINK-002 Olmo 3.1 32B Think GPQA Diamond Accuracy 59.1% Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO3132BTHINK-003 Olmo 3.1 32B Think Humanity's Last Exam No tools Overall 6% Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO3132BTHINK-004 Olmo 3.1 32B Think SciCode Overall 29.3% Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO3132BTHINK-005 Olmo 3.1 32B Think tau2-bench Overall 0% Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO3132BTHINK-006 Olmo 3.1 32B Think Terminal-Bench Hard Overall 0% Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO3132BTHINK-007 Olmo 3.1 32B Think CritPt Overall 0% Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO3132BTHINK-008 Olmo 3.1 32B Think AA-Omniscience Overall -44.1 Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO3132BTHINK-009 Olmo 3.1 32B Think AA-Omniscience Accuracy 13.6% Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO3132BTHINK-010 Olmo 3.1 32B Think IFBench Overall 66% Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO3132BTHINK-011 Olmo 3.1 32B Think AA-LCR Overall 0% Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO332BTHINK-001 Olmo 3 32B Think Artificial Analysis Intelligence Index Overall 6.4 Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO332BTHINK-002 Olmo 3 32B Think GPQA Diamond Accuracy 61% Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO332BTHINK-003 Olmo 3 32B Think Humanity's Last Exam No tools Overall 5.9% Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO332BTHINK-004 Olmo 3 32B Think SciCode Overall 28.6% Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO332BTHINK-005 Olmo 3 32B Think tau2-bench Overall 0% Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO332BTHINK-006 Olmo 3 32B Think Terminal-Bench Hard Overall 1.5% Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO332BTHINK-007 Olmo 3 32B Think CritPt Overall 0% Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO332BTHINK-008 Olmo 3 32B Think AA-Omniscience Overall -58.4 Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO332BTHINK-009 Olmo 3 32B Think AA-Omniscience Accuracy 14.5% Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO332BTHINK-010 Olmo 3 32B Think IFBench Overall 49.1% Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO332BTHINK-011 Olmo 3 32B Think AA-LCR Overall 0% Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO37BINSTRUCT-001 Olmo 3 7B Instruct Artificial Analysis Intelligence Index Overall 2.8 Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-002 Olmo 3 7B Instruct GPQA Diamond Accuracy 40% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-003 Olmo 3 7B Instruct Humanity's Last Exam No tools Overall 5.8% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-004 Olmo 3 7B Instruct SciCode Overall 10.3% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-005 Olmo 3 7B Instruct tau2-bench Overall 12.6% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-006 Olmo 3 7B Instruct Terminal-Bench Hard Overall 0% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-007 Olmo 3 7B Instruct CritPt Overall 0% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-008 Olmo 3 7B Instruct AA-Omniscience Overall -77.7 Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-009 Olmo 3 7B Instruct AA-Omniscience Accuracy 7.3% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-010 Olmo 3 7B Instruct IFBench Overall 32.8% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-011 Olmo 3 7B Instruct AA-LCR Overall 0% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BTHINK-001 Olmo 3 7B Think Artificial Analysis Intelligence Index Overall 4 Unknown Primary source AI2-OLMO37BTHINK
BR-018OLMO37BTHINK-002 Olmo 3 7B Think GPQA Diamond Accuracy 51.6% Unknown Primary source AI2-OLMO37BTHINK
BR-018OLMO37BTHINK-003 Olmo 3 7B Think Humanity's Last Exam No tools Overall 5.7% Unknown Primary source AI2-OLMO37BTHINK
BR-018OLMO37BTHINK-004 Olmo 3 7B Think SciCode Overall 21.2% Unknown Primary source AI2-OLMO37BTHINK
BR-018OLMO37BTHINK-005 Olmo 3 7B Think tau2-bench Overall 0% Unknown Primary source AI2-OLMO37BTHINK
BR-018OLMO37BTHINK-006 Olmo 3 7B Think Terminal-Bench Hard Overall 0.8% Unknown Primary source AI2-OLMO37BTHINK
BR-018OLMO37BTHINK-007 Olmo 3 7B Think CritPt Overall 0% Unknown Primary source AI2-OLMO37BTHINK
BR-018OLMO37BTHINK-008 Olmo 3 7B Think AA-Omniscience Overall -73.7 Unknown Primary source AI2-OLMO37BTHINK
BR-018OLMO37BTHINK-009 Olmo 3 7B Think AA-Omniscience Accuracy 10.8% Unknown Primary source AI2-OLMO37BTHINK
BR-018OLMO37BTHINK-010 Olmo 3 7B Think IFBench Overall 41.5% Unknown Primary source AI2-OLMO37BTHINK
BR-018OLMO37BTHINK-011 Olmo 3 7B Think AA-LCR Overall 0% Unknown Primary source AI2-OLMO37BTHINK