BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

OLMo 2 7B

MODEL RECORD: AI2-OLMO27B

Organization
Allen Institute for AI
Family
OLMO27B
Model number
Unknown
Tier
Unknown
Status
ACTIVE
Release date
2024-11-26

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-018OLMO27B-001 OLMo 2 7B Artificial Analysis Intelligence Index Overall 3.9 Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-002 OLMo 2 7B GPQA Diamond Accuracy 28.8% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-003 OLMo 2 7B Humanity's Last Exam No tools Overall 5.5% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-004 OLMo 2 7B SciCode Overall 3.7% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-005 OLMo 2 7B tau2-bench Overall 0% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-006 OLMo 2 7B Terminal-Bench Hard Overall 0% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-007 OLMo 2 7B IFBench Overall 24.4% Unknown Primary source AI2-OLMO27B
BR-018OLMO27B-008 OLMo 2 7B AA-LCR Overall 0% Unknown Primary source AI2-OLMO27B