Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

tau2-bench

Benchmark Family: tau2-bench
Organization: Sierra
Status: ACTIVE

Versions / Variants

Version or Variant	Reference	Status	Records
Unspecified	`tau2-bench/default`	ACTIVE	350
Retail	`tau2-bench/retail`	ACTIVE	1
Telecom	`tau2-bench/telecom`	ACTIVE	2

Table may be scrolled horizontally on narrow displays.

Record No.	Model	Benchmark	Metric	Score	Eval Date	Source	Model ID
`BR-012MINIMAXM27-005`	MiniMax-M2.7	tau2-bench	Overall	84.8%	Unknown	Primary source	`MMAX-MINIMAXM27`
`BR-012MINIMAXM3-005`	MiniMax-M3	tau2-bench	Overall	88.9%	Unknown	Primary source	`MMAX-M3`
`BR-013LG3-005`	Mistral Large 3	tau2-bench	Overall	24.6%	Unknown	Primary source	`MSTRL-LG3`
`BR-013SM3-005`	Mistral Small 3	tau2-bench	Overall	19.6%	Unknown	Primary source	`MSTRL-SM3`
`BR-013SM31-005`	Mistral Small 3.1	tau2-bench	Overall	25.1%	Unknown	Primary source	`MSTRL-SM31`
`BR-013SM32-005`	Mistral Small 3.2	tau2-bench	Overall	29.5%	Unknown	Primary source	`MSTRL-SM32`
`BR-013SM4-005`	Mistral Small 4	tau2-bench	Overall	18.4%	Unknown	Primary source	`MSTRL-SM4`
`BR-013SM4-016`	Mistral Small 4	tau2-bench	Overall	41.2%	Unknown	Primary source	`MSTRL-SM4`
`BR-014APLUS-001`	Command A+	tau2-bench Telecom	Overall	85%	Unknown	Primary source	`COHR-APLUS`
`BR-014COMMANDA-005`	Command A	tau2-bench	Overall	15.2%	Unknown	Primary source	`COHR-COMMANDA`
`BR-014COMMANDAPLUS-005`	Command A+	tau2-bench	Overall	80.7%	Unknown	Primary source	`COHR-APLUS`
`BR-014NORTHMINICODE-005`	North Mini Code	tau2-bench	Overall	37.4%	Unknown	Primary source	`COHR-NORTHMINICODE`
`BR-014TINYAYAGLOBAL-005`	Tiny Aya Global	tau2-bench	Overall	0%	Unknown	Primary source	`COHR-TINYAYAGLOBAL`
`BR-015LLAMA31NEMOTRONINSTRUCT70B-005`	Llama 3.1 Nemotron Instruct 70B	tau2-bench	Overall	23.1%	Unknown	Primary source	`NVDA-LLAMA31NEMOTRONINSTRUCT70B`
`BR-015LLAMA31NEMOTRONNANO4BV11-005`	Llama 3.1 Nemotron Nano 4B v1.1	tau2-bench	Overall	11.7%	Unknown	Primary source	`NVDA-LLAMA31NEMOTRONNANO4BV11`
`BR-015LLAMA31NEMOTRONULTRA253BV1-005`	Llama 3.1 Nemotron Ultra 253B v1	tau2-bench	Overall	11.4%	Unknown	Primary source	`NVDA-LLAMA31NEMOTRONULTRA253BV1`
`BR-015LLAMA33NEMOTRONSUPER49BV1-005`	Llama 3.3 Nemotron Super 49B v1	tau2-bench	Overall	26.9%	Unknown	Primary source	`NVDA-LLAMA33NEMOTRONSUPER49BV1`
`BR-015LLAMANEMOTRONSUPER49BV15-005`	Llama Nemotron Super 49B v1.5	tau2-bench	Overall	25.1%	Unknown	Primary source	`NVDA-LLAMANEMOTRONSUPER49BV15`
`BR-015LLAMANEMOTRONSUPER49BV15-016`	Llama Nemotron Super 49B v1.5	tau2-bench	Overall	28.1%	Unknown	Primary source	`NVDA-LLAMANEMOTRONSUPER49BV15`
`BR-015NEMOTRON3NANOOMNI30BA3BREASONING-005`	Nemotron 3 Nano Omni 30B A3B Reasoning	tau2-bench	Overall	45.3%	Unknown	Primary source	`NVDA-NEMOTRON3NANOOMNI30BA3BREASONING`
`BR-015NEMOTRON3ULTRA550BA55B-005`	Nemotron 3 Ultra 550B A55B	tau2-bench	Overall	83.3%	Unknown	Primary source	`NVDA-NEMOTRON3ULTRA550BA55B`
`BR-015NEMOTRONCASCADE230BA3B-005`	Nemotron Cascade 2 30B A3B	tau2-bench	Overall	53.2%	Unknown	Primary source	`NVDA-NEMOTRONCASCADE230BA3B`
`BR-015NVIDIANEMOTRON3NANO30BA3B-005`	NVIDIA Nemotron 3 Nano 30B A3B	tau2-bench	Overall	25.4%	Unknown	Primary source	`NVDA-NVIDIANEMOTRON3NANO30BA3B`
`BR-015NVIDIANEMOTRON3NANO30BA3B-017`	NVIDIA Nemotron 3 Nano 30B A3B	tau2-bench	Overall	40.9%	Unknown	Primary source	`NVDA-NVIDIANEMOTRON3NANO30BA3B`
`BR-015NVIDIANEMOTRON3NANO4B-005`	NVIDIA Nemotron 3 Nano 4B	tau2-bench	Overall	28.1%	Unknown	Primary source	`NVDA-NVIDIANEMOTRON3NANO4B`
`BR-015NVIDIANEMOTRON3SUPER120BA12B-005`	NVIDIA Nemotron 3 Super 120B A12B	tau2-bench	Overall	67.8%	Unknown	Primary source	`NVDA-NVIDIANEMOTRON3SUPER120BA12B`
`BR-015NVIDIANEMOTRONNANO12BV2VL-005`	NVIDIA Nemotron Nano 12B v2 VL	tau2-bench	Overall	21.3%	Unknown	Primary source	`NVDA-NVIDIANEMOTRONNANO12BV2VL`
`BR-015NVIDIANEMOTRONNANO12BV2VL-017`	NVIDIA Nemotron Nano 12B v2 VL	tau2-bench	Overall	19.3%	Unknown	Primary source	`NVDA-NVIDIANEMOTRONNANO12BV2VL`
`BR-015NVIDIANEMOTRONNANO9BV2-005`	NVIDIA Nemotron Nano 9B V2	tau2-bench	Overall	23.4%	Unknown	Primary source	`NVDA-NVIDIANEMOTRONNANO9BV2`
`BR-015NVIDIANEMOTRONNANO9BV2-016`	NVIDIA Nemotron Nano 9B V2	tau2-bench	Overall	21.9%	Unknown	Primary source	`NVDA-NVIDIANEMOTRONNANO9BV2`
`BR-016NOVA20LITE-005`	Nova 2.0 Lite	tau2-bench	Overall	72.8%	Unknown	Primary source	`AMZN-NOVA20LITE`
`BR-016NOVA20LITE-020`	Nova 2.0 Lite	tau2-bench	Overall	71.9%	Unknown	Primary source	`AMZN-NOVA20LITE`
`BR-016NOVA20LITE-032`	Nova 2.0 Lite	tau2-bench	Overall	62%	Unknown	Primary source	`AMZN-NOVA20LITE`
`BR-016NOVA20LITE-044`	Nova 2.0 Lite	tau2-bench	Overall	75.7%	Unknown	Primary source	`AMZN-NOVA20LITE`
`BR-016NOVA20OMNI-005`	Nova 2.0 Omni	tau2-bench	Overall	80.4%	Unknown	Primary source	`AMZN-NOVA20OMNI`
`BR-016NOVA20OMNI-017`	Nova 2.0 Omni	tau2-bench	Overall	44.7%	Unknown	Primary source	`AMZN-NOVA20OMNI`
`BR-016NOVA20OMNI-029`	Nova 2.0 Omni	tau2-bench	Overall	67.8%	Unknown	Primary source	`AMZN-NOVA20OMNI`
`BR-016NOVA20PROPREVIEW-005`	Nova 2.0 Pro Preview	tau2-bench	Overall	92.7%	Unknown	Primary source	`AMZN-NOVA20PROPREVIEW`
`BR-016NOVA20PROPREVIEW-020`	Nova 2.0 Pro Preview	tau2-bench	Overall	71.6%	Unknown	Primary source	`AMZN-NOVA20PROPREVIEW`
`BR-016NOVA20PROPREVIEW-034`	Nova 2.0 Pro Preview	tau2-bench	Overall	90.6%	Unknown	Primary source	`AMZN-NOVA20PROPREVIEW`
`BR-016NOVALITE-005`	Nova Lite	tau2-bench	Overall	17.5%	Unknown	Primary source	`AMZN-NOVALITE`
`BR-016NOVAMICRO-005`	Nova Micro	tau2-bench	Overall	14%	Unknown	Primary source	`AMZN-NOVAMICRO`
`BR-016NOVAPREMIER-005`	Nova Premier	tau2-bench	Overall	38.3%	Unknown	Primary source	`AMZN-NOVAPREMIER`
`BR-016NOVAPRO-005`	Nova Pro	tau2-bench	Overall	14%	Unknown	Primary source	`AMZN-NOVAPRO`
`BR-017GRANITE338B-005`	Granite 3.3 8B	tau2-bench	Overall	10.5%	Unknown	Primary source	`IBM-GRANITE338B`
`BR-017GRANITE401B-005`	Granite 4.0 1B	tau2-bench	Overall	22.8%	Unknown	Primary source	`IBM-GRANITE401B`
`BR-017GRANITE40350M-005`	Granite 4.0 350M	tau2-bench	Overall	13.2%	Unknown	Primary source	`IBM-GRANITE40350M`
`BR-017GRANITE40H1B-005`	Granite 4.0 H 1B	tau2-bench	Overall	19.6%	Unknown	Primary source	`IBM-GRANITE40H1B`
`BR-017GRANITE40H350M-005`	Granite 4.0 H 350M	tau2-bench	Overall	14.6%	Unknown	Primary source	`IBM-GRANITE40H350M`
`BR-017GRANITE40HSMALL-005`	Granite 4.0 H Small	tau2-bench	Overall	17.3%	Unknown	Primary source	`IBM-GRANITE40HSMALL`
`BR-017GRANITE40MICRO-005`	Granite 4.0 Micro	tau2-bench	Overall	12.6%	Unknown	Primary source	`IBM-GRANITE40MICRO`
`BR-017GRANITE4130B-005`	Granite 4.1 30B	tau2-bench	Overall	42.1%	Unknown	Primary source	`IBM-GRANITE4130B`
`BR-017GRANITE413B-005`	Granite 4.1 3B	tau2-bench	Overall	19.6%	Unknown	Primary source	`IBM-GRANITE413B`
`BR-017GRANITE418B-005`	Granite 4.1 8B	tau2-bench	Overall	27.8%	Unknown	Primary source	`IBM-GRANITE418B`
`BR-018MOLMO28B-005`	Molmo2-8B	tau2-bench	Overall	0%	Unknown	Primary source	`AI2-MOLMO28B`
`BR-018MOLMO7BD-005`	Molmo 7B-D	tau2-bench	Overall	0%	Unknown	Primary source	`AI2-MOLMO7BD`
`BR-018OLMO232B-005`	OLMo 2 32B	tau2-bench	Overall	0%	Unknown	Primary source	`AI2-OLMO232B`
`BR-018OLMO27B-005`	OLMo 2 7B	tau2-bench	Overall	0%	Unknown	Primary source	`AI2-OLMO27B`
`BR-018OLMO3132BINSTRUCT-005`	Olmo 3.1 32B Instruct	tau2-bench	Overall	21.3%	Unknown	Primary source	`AI2-OLMO3132BINSTRUCT`
`BR-018OLMO3132BTHINK-005`	Olmo 3.1 32B Think	tau2-bench	Overall	0%	Unknown	Primary source	`AI2-OLMO3132BTHINK`
`BR-018OLMO332BTHINK-005`	Olmo 3 32B Think	tau2-bench	Overall	0%	Unknown	Primary source	`AI2-OLMO332BTHINK`
`BR-018OLMO37BINSTRUCT-005`	Olmo 3 7B Instruct	tau2-bench	Overall	12.6%	Unknown	Primary source	`AI2-OLMO37BINSTRUCT`
`BR-018OLMO37BTHINK-005`	Olmo 3 7B Think	tau2-bench	Overall	0%	Unknown	Primary source	`AI2-OLMO37BTHINK`
`BR-019MIMOV25-005`	MiMo-V2.5	tau2-bench	Overall	90.6%	Unknown	Primary source	`XIAOM-MIMOV25`
`BR-019MIMOV25PRO-005`	MiMo-V2.5-Pro	tau2-bench	Overall	94.2%	Unknown	Primary source	`XIAOM-MIMOV25PRO`
`BR-019MIMOV25PRO-021`	MiMo-V2.5-Pro	tau2-bench	Overall	72.5%	Unknown	Primary source	`XIAOM-MIMOV25PRO`
`BR-019MIMOV2FLASH-005`	MiMo-V2-Flash	tau2-bench	Overall	83.9%	Unknown	Primary source	`XIAOM-MIMOV2FLASH`
`BR-019MIMOV2FLASH-019`	MiMo-V2-Flash	tau2-bench	Overall	95%	Unknown	Primary source	`XIAOM-MIMOV2FLASH`
`BR-019MIMOV2FLASHFEB2026-005`	MiMo-V2-Flash (Feb 2026)	tau2-bench	Overall	93.3%	Unknown	Primary source	`XIAOM-MIMOV2FLASHFEB2026`
`BR-019MIMOV2OMNI-005`	MiMo-V2-Omni	tau2-bench	Overall	91.2%	Unknown	Primary source	`XIAOM-MIMOV2OMNI`
`BR-019MIMOV2OMNI0327-005`	MiMo-V2-Omni-0327	tau2-bench	Overall	88%	Unknown	Primary source	`XIAOM-MIMOV2OMNI0327`
`BR-019MIMOV2PRO-005`	MiMo-V2-Pro	tau2-bench	Overall	95%	Unknown	Primary source	`XIAOM-MIMOV2PRO`
`BR-020LFM212B-005`	LFM2 1.2B	tau2-bench	Overall	12.6%	Unknown	Primary source	`LQAI-LFM212B`
`BR-020LFM224BA2B-005`	LFM2 24B A2B	tau2-bench	Overall	11.1%	Unknown	Primary source	`LQAI-LFM224BA2B`
`BR-020LFM226B-005`	LFM2 2.6B	tau2-bench	Overall	13.5%	Unknown	Primary source	`LQAI-LFM226B`
`BR-020LFM2512BINSTRUCT-005`	LFM2.5-1.2B-Instruct	tau2-bench	Overall	10.8%	Unknown	Primary source	`LQAI-LFM2512BINSTRUCT`
`BR-020LFM2512BTHINKING-005`	LFM2.5-1.2B-Thinking	tau2-bench	Overall	19.6%	Unknown	Primary source	`LQAI-LFM2512BTHINKING`
`BR-020LFM258BA1B-005`	LFM2.5-8B-A1B	tau2-bench	Overall	16.1%	Unknown	Primary source	`LQAI-LFM258BA1B`
`BR-020LFM25VL16B-005`	LFM2.5-VL-1.6B	tau2-bench	Overall	8.5%	Unknown	Primary source	`LQAI-LFM25VL16B`
`BR-020LFM28BA1B-005`	LFM2 8B A1B	tau2-bench	Overall	10.5%	Unknown	Primary source	`LQAI-LFM28BA1B`
`BR-021LING1T-005`	Ling-1T	tau2-bench	Overall	32.7%	Unknown	Primary source	`INCAI-LING1T`
`BR-021LING261T-005`	Ling-2.6-1T	tau2-bench	Overall	89.8%	Unknown	Primary source	`INCAI-LING261T`
`BR-021LING26FLASH-005`	Ling 2.6 Flash	tau2-bench	Overall	86%	Unknown	Primary source	`INCAI-LING26FLASH`
`BR-021LINGFLASH20-005`	Ling-flash-2.0	tau2-bench	Overall	20.8%	Unknown	Primary source	`INCAI-LINGFLASH20`
`BR-021LINGMINI20-005`	Ling-mini-2.0	tau2-bench	Overall	13.2%	Unknown	Primary source	`INCAI-LINGMINI20`
`BR-021RING1T-005`	Ring-1T	tau2-bench	Overall	26.3%	Unknown	Primary source	`INCAI-RING1T`
`BR-021RING261T-005`	Ring-2.6-1T	tau2-bench	Overall	92.4%	Unknown	Primary source	`INCAI-RING261T`
`BR-021RINGFLASH20-005`	Ring-flash-2.0	tau2-bench	Overall	0%	Unknown	Primary source	`INCAI-RINGFLASH20`
`BR-022EXAONE4012B-005`	Exaone 4.0 1.2B	tau2-bench	Overall	20.5%	Unknown	Primary source	`LGAI-EXAONE4012B`
`BR-022EXAONE4012B-016`	Exaone 4.0 1.2B	tau2-bench	Overall	16.4%	Unknown	Primary source	`LGAI-EXAONE4012B`
`BR-022EXAONE4032B-005`	EXAONE 4.0 32B	tau2-bench	Overall	4.1%	Unknown	Primary source	`LGAI-EXAONE4032B`
`BR-022EXAONE4032B-016`	EXAONE 4.0 32B	tau2-bench	Overall	17.3%	Unknown	Primary source	`LGAI-EXAONE4032B`
`BR-022EXAONE4533B-005`	EXAONE 4.5 33B	tau2-bench	Overall	78.1%	Unknown	Primary source	`LGAI-EXAONE4533B`
`BR-022KEXAONE-005`	K-EXAONE	tau2-bench	Overall	74.3%	Unknown	Primary source	`LGAI-KEXAONE`
`BR-022KEXAONE-016`	K-EXAONE	tau2-bench	Overall	59.1%	Unknown	Primary source	`LGAI-KEXAONE`
`BR-023HERMES4LLAMA31405B-005`	Hermes 4 - Llama-3.1 405B	tau2-bench	Overall	22.2%	Unknown	Primary source	`NOUS-HERMES4LLAMA31405B`
`BR-023HERMES4LLAMA31405B-016`	Hermes 4 - Llama-3.1 405B	tau2-bench	Overall	26.6%	Unknown	Primary source	`NOUS-HERMES4LLAMA31405B`
`BR-023HERMES4LLAMA3170B-005`	Hermes 4 - Llama-3.1 70B	tau2-bench	Overall	21.6%	Unknown	Primary source	`NOUS-HERMES4LLAMA3170B`
`BR-023HERMES4LLAMA3170B-016`	Hermes 4 - Llama-3.1 70B	tau2-bench	Overall	22.5%	Unknown	Primary source	`NOUS-HERMES4LLAMA3170B`
`BR-024SOLARMINI-002`	Solar Mini	tau2-bench	Overall	20.2%	Unknown	Primary source	`UPSTG-SOLARMINI`

Showing records 201–300 of 353 Page 3 of 4

Previous Next