BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

Olmo 3 7B Instruct

MODEL RECORD: AI2-OLMO37BINSTRUCT

Organization
Allen Institute for AI
Family
OLMO37BINSTRUCT
Model number
Unknown
Tier
Unknown
Status
ACTIVE
Release date
2025-11-20

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-018OLMO37BINSTRUCT-001 Olmo 3 7B Instruct Artificial Analysis Intelligence Index Overall 2.8 Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-002 Olmo 3 7B Instruct GPQA Diamond Accuracy 40% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-003 Olmo 3 7B Instruct Humanity's Last Exam No tools Overall 5.8% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-004 Olmo 3 7B Instruct SciCode Overall 10.3% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-005 Olmo 3 7B Instruct tau2-bench Overall 12.6% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-006 Olmo 3 7B Instruct Terminal-Bench Hard Overall 0% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-007 Olmo 3 7B Instruct CritPt Overall 0% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-008 Olmo 3 7B Instruct AA-Omniscience Overall -77.7 Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-009 Olmo 3 7B Instruct AA-Omniscience Accuracy 7.3% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-010 Olmo 3 7B Instruct IFBench Overall 32.8% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BINSTRUCT-011 Olmo 3 7B Instruct AA-LCR Overall 0% Unknown Primary source AI2-OLMO37BINSTRUCT