Hermes 4 - Llama-3.1 405B on tau2-bench

BENCHMARK RECORD: BR-023HERMES4LLAMA31405B-016

Canonical URL: https://www.benchmarkregistry.org/records/BR-023HERMES4LLAMA31405B-016

Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.

Record

Record Identifier

BR-023HERMES4LLAMA31405B-016

Record Status

ACTIVE

Created At

2026-07-13T06:11:37.967Z

Updated At

2026-07-13T06:11:37.967Z

Superseded By

Not applicable

Model

Official Model Name

Hermes 4 - Llama-3.1 405B

Model Identifier

NOUS-HERMES4LLAMA31405B

Organization

Nous Research

Model Family

HERMES4LLAMA31405B

Model Number

Unknown

Tier

Unknown

Model Snapshot

Unknown

Snapshot Label

Unknown

Provider Model Identifier

Unknown

Snapshot Date

Unknown

Benchmark

Benchmark Family

tau2-bench

Benchmark Version or Variant

Unknown

Benchmark Version Reference

tau2-bench/default

Benchmark Organization

Sierra

Benchmark Status

ACTIVE

Result

Metric

Overall

Score

26.6%

Numeric Score

26.6

Evaluation Date

Unknown

Reported Date

2026-07-13

Evaluation Context

Configuration Reference

CFG-000006

Shots

Unknown

Reasoning Mode

non-reasoning

Reasoning Effort

Unknown

Pass Count

Unknown

Agent Scaffold

Unknown

Evaluation Harness

Unknown

Temperature

Unknown

Top P

Unknown

Max Output Tokens

Unknown

System Prompt Description

Unknown

Additional Configuration

None reported

Source and Reporting

Primary Source

Artificial Analysis Model Leaderboard ↗

Source Type

LEADERBOARD

Publisher

Artificial Analysis

Source Published Date

Unknown

Source Accessed At

2026-07-13T04:53:32.160Z

Report Type

INDEPENDENT

Evaluator

Artificial Analysis

Evaluator Type

INDEPENDENT_ORGANIZATION

Provenance

Record Status

This record is ACTIVE. Registry identifiers remain reserved when record status changes.