BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

Llama 3.1 Nemotron Instruct 70B

MODEL RECORD: NVDA-LLAMA31NEMOTRONINSTRUCT70B

Organization
NVIDIA
Family
LLAMA31NEMOTRONINSTRUCT70B
Model number
Unknown
Tier
Unknown
Status
ACTIVE
Release date
2024-10-15

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-015LLAMA31NEMOTRONINSTRUCT70B-001 Llama 3.1 Nemotron Instruct 70B Artificial Analysis Intelligence Index Overall 7.6 Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONINSTRUCT70B-002 Llama 3.1 Nemotron Instruct 70B GPQA Diamond Accuracy 46.5% Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONINSTRUCT70B-003 Llama 3.1 Nemotron Instruct 70B Humanity's Last Exam No tools Overall 4.6% Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONINSTRUCT70B-004 Llama 3.1 Nemotron Instruct 70B SciCode Overall 23.3% Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONINSTRUCT70B-005 Llama 3.1 Nemotron Instruct 70B tau2-bench Overall 23.1% Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONINSTRUCT70B-006 Llama 3.1 Nemotron Instruct 70B Terminal-Bench Hard Overall 4.5% Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONINSTRUCT70B-007 Llama 3.1 Nemotron Instruct 70B CritPt Overall 0% Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONINSTRUCT70B-008 Llama 3.1 Nemotron Instruct 70B AA-Omniscience Overall -41 Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONINSTRUCT70B-009 Llama 3.1 Nemotron Instruct 70B AA-Omniscience Accuracy 16.5% Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONINSTRUCT70B-010 Llama 3.1 Nemotron Instruct 70B IFBench Overall 30.7% Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONINSTRUCT70B-011 Llama 3.1 Nemotron Instruct 70B AA-LCR Overall 7% Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B