BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

Nous Research

Provider prefix
NOUS
Benchmark Record namespace
023

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-023DEEPHERMES3LLAMA318BPREVIEW-001 DeepHermes 3 - Llama-3.1 8B Preview Artificial Analysis Intelligence Index Overall 2.3 Unknown Primary source NOUS-DEEPHERMES3LLAMA318BPREVIEW
BR-023DEEPHERMES3LLAMA318BPREVIEW-002 DeepHermes 3 - Llama-3.1 8B Preview GPQA Diamond Accuracy 27% Unknown Primary source NOUS-DEEPHERMES3LLAMA318BPREVIEW
BR-023DEEPHERMES3LLAMA318BPREVIEW-003 DeepHermes 3 - Llama-3.1 8B Preview Humanity's Last Exam No tools Overall 4.3% Unknown Primary source NOUS-DEEPHERMES3LLAMA318BPREVIEW
BR-023DEEPHERMES3LLAMA318BPREVIEW-004 DeepHermes 3 - Llama-3.1 8B Preview SciCode Overall 9.1% Unknown Primary source NOUS-DEEPHERMES3LLAMA318BPREVIEW
BR-023DEEPHERMES3MISTRAL24BPREVIEW-001 DeepHermes 3 - Mistral 24B Preview Artificial Analysis Intelligence Index Overall 5.3 Unknown Primary source NOUS-DEEPHERMES3MISTRAL24BPREVIEW
BR-023DEEPHERMES3MISTRAL24BPREVIEW-002 DeepHermes 3 - Mistral 24B Preview GPQA Diamond Accuracy 38.2% Unknown Primary source NOUS-DEEPHERMES3MISTRAL24BPREVIEW
BR-023DEEPHERMES3MISTRAL24BPREVIEW-003 DeepHermes 3 - Mistral 24B Preview Humanity's Last Exam No tools Overall 3.9% Unknown Primary source NOUS-DEEPHERMES3MISTRAL24BPREVIEW
BR-023DEEPHERMES3MISTRAL24BPREVIEW-004 DeepHermes 3 - Mistral 24B Preview SciCode Overall 22.8% Unknown Primary source NOUS-DEEPHERMES3MISTRAL24BPREVIEW
BR-023HERMES3LLAMA3170B-001 Hermes 3 - Llama-3.1 70B Artificial Analysis Intelligence Index Overall 5.1 Unknown Primary source NOUS-HERMES3LLAMA3170B
BR-023HERMES3LLAMA3170B-002 Hermes 3 - Llama-3.1 70B GPQA Diamond Accuracy 40.1% Unknown Primary source NOUS-HERMES3LLAMA3170B
BR-023HERMES3LLAMA3170B-003 Hermes 3 - Llama-3.1 70B Humanity's Last Exam No tools Overall 4.1% Unknown Primary source NOUS-HERMES3LLAMA3170B
BR-023HERMES3LLAMA3170B-004 Hermes 3 - Llama-3.1 70B SciCode Overall 23.1% Unknown Primary source NOUS-HERMES3LLAMA3170B
BR-023HERMES4LLAMA31405B-001 Hermes 4 - Llama-3.1 405B Artificial Analysis Intelligence Index Overall 9 Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-002 Hermes 4 - Llama-3.1 405B GPQA Diamond Accuracy 72.7% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-003 Hermes 4 - Llama-3.1 405B Humanity's Last Exam No tools Overall 10.3% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-004 Hermes 4 - Llama-3.1 405B SciCode Overall 25.2% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-005 Hermes 4 - Llama-3.1 405B tau2-bench Overall 22.2% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-006 Hermes 4 - Llama-3.1 405B Terminal-Bench Hard Overall 11.4% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-007 Hermes 4 - Llama-3.1 405B CritPt Overall 0.3% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-008 Hermes 4 - Llama-3.1 405B AA-Omniscience Overall -36 Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-009 Hermes 4 - Llama-3.1 405B AA-Omniscience Accuracy 30.2% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-010 Hermes 4 - Llama-3.1 405B IFBench Overall 32.7% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-011 Hermes 4 - Llama-3.1 405B AA-LCR Overall 20.7% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-012 Hermes 4 - Llama-3.1 405B Artificial Analysis Intelligence Index Overall 8.8 Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-013 Hermes 4 - Llama-3.1 405B GPQA Diamond Accuracy 53.6% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-014 Hermes 4 - Llama-3.1 405B Humanity's Last Exam No tools Overall 4.2% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-015 Hermes 4 - Llama-3.1 405B SciCode Overall 34.6% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-016 Hermes 4 - Llama-3.1 405B tau2-bench Overall 26.6% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-017 Hermes 4 - Llama-3.1 405B Terminal-Bench Hard Overall 9.8% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-018 Hermes 4 - Llama-3.1 405B CritPt Overall 0% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-019 Hermes 4 - Llama-3.1 405B AA-Omniscience Overall -33 Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-020 Hermes 4 - Llama-3.1 405B AA-Omniscience Accuracy 26.3% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-021 Hermes 4 - Llama-3.1 405B IFBench Overall 34.8% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-022 Hermes 4 - Llama-3.1 405B AA-LCR Overall 20% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA3170B-001 Hermes 4 - Llama-3.1 70B Artificial Analysis Intelligence Index Overall 6.9 Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-002 Hermes 4 - Llama-3.1 70B GPQA Diamond Accuracy 49.1% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-003 Hermes 4 - Llama-3.1 70B Humanity's Last Exam No tools Overall 3.6% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-004 Hermes 4 - Llama-3.1 70B SciCode Overall 27.7% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-005 Hermes 4 - Llama-3.1 70B tau2-bench Overall 21.6% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-006 Hermes 4 - Llama-3.1 70B Terminal-Bench Hard Overall 0% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-007 Hermes 4 - Llama-3.1 70B CritPt Overall 0% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-008 Hermes 4 - Llama-3.1 70B AA-Omniscience Overall -47.4 Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-009 Hermes 4 - Llama-3.1 70B AA-Omniscience Accuracy 18.2% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-010 Hermes 4 - Llama-3.1 70B IFBench Overall 29% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-011 Hermes 4 - Llama-3.1 70B AA-LCR Overall 2% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-012 Hermes 4 - Llama-3.1 70B Artificial Analysis Intelligence Index Overall 10 Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-013 Hermes 4 - Llama-3.1 70B GPQA Diamond Accuracy 69.9% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-014 Hermes 4 - Llama-3.1 70B Humanity's Last Exam No tools Overall 7.9% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-015 Hermes 4 - Llama-3.1 70B SciCode Overall 34.1% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-016 Hermes 4 - Llama-3.1 70B tau2-bench Overall 22.5% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-017 Hermes 4 - Llama-3.1 70B Terminal-Bench Hard Overall 4.5% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-018 Hermes 4 - Llama-3.1 70B CritPt Overall 0% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-019 Hermes 4 - Llama-3.1 70B AA-Omniscience Overall -49.9 Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-020 Hermes 4 - Llama-3.1 70B AA-Omniscience Accuracy 23.3% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-021 Hermes 4 - Llama-3.1 70B IFBench Overall 31.3% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-022 Hermes 4 - Llama-3.1 70B AA-LCR Overall 6.7% Unknown Primary source NOUS-HERMES4LLAMA3170B