BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database
Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

tau2-bench

Benchmark Family
tau2-bench
Organization
Sierra
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedtau2-bench/defaultACTIVE350
Retailtau2-bench/retailACTIVE1
Telecomtau2-bench/telecomACTIVE2

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-024SOLAROPEN100B-005 Solar Open 100B tau2-bench Overall 48.2% Unknown Primary source UPSTG-SOLAROPEN100B
BR-024SOLARPRO2-005 Solar Pro 2 tau2-bench Overall 31.9% Unknown Primary source UPSTG-SOLARPRO2
BR-024SOLARPRO2-016 Solar Pro 2 tau2-bench Overall 28.1% Unknown Primary source UPSTG-SOLARPRO2
BR-024SOLARPRO3-005 Solar Pro 3 tau2-bench Overall 86.3% Unknown Primary source UPSTG-SOLARPRO3
BR-025JAMBA17LARGE-005 Jamba 1.7 Large tau2-bench Overall 13.5% Unknown Primary source AI21-JAMBA17LARGE
BR-025JAMBA17MINI-005 Jamba 1.7 Mini tau2-bench Overall 12.6% Unknown Primary source AI21-JAMBA17MINI
BR-025JAMBAREASONING3B-005 Jamba Reasoning 3B tau2-bench Overall 15.8% Unknown Primary source AI21-JAMBAREASONING3B
BR-026STEP35FLASH-005 Step 3.5 Flash tau2-bench Overall 94.4% Unknown Primary source STPFN-STEP35FLASH
BR-026STEP35FLASH2603-005 Step 3.5 Flash 2603 tau2-bench Overall 87.4% Unknown Primary source STPFN-STEP35FLASH2603
BR-026STEP37FLASH-005 Step 3.7 Flash tau2-bench Overall 98.5% Unknown Primary source STPFN-STEP37FLASH
BR-026STEP3VL10B-005 Step3 VL 10B tau2-bench Overall 16.1% Unknown Primary source STPFN-STEP3VL10B
BR-027PHI3MINIINSTRUCT38B-005 Phi-3 Mini Instruct 3.8B tau2-bench Overall 0% Unknown Primary source MSFT-PHI3MINIINSTRUCT38B
BR-027PHI4-005 Phi-4 tau2-bench Overall 0% Unknown Primary source MSFT-PHI4
BR-027PHI4MINIINSTRUCT-005 Phi-4 Mini Instruct tau2-bench Overall 8.2% Unknown Primary source MSFT-PHI4MINIINSTRUCT
BR-028K2THINKV2-005 K2 Think V2 tau2-bench Overall 25.4% Unknown Primary source MBZAI-K2THINKV2
BR-028K2V2-005 K2-V2 tau2-bench Overall 27.8% Unknown Primary source MBZAI-K2V2
BR-028K2V2-016 K2-V2 tau2-bench Overall 20.8% Unknown Primary source MBZAI-K2V2
BR-028K2V2-027 K2-V2 tau2-bench Overall 24.9% Unknown Primary source MBZAI-K2V2
BR-029JT35BFLASH-005 JT-35B-Flash tau2-bench Overall 99.1% Unknown Primary source CMOB-JT35BFLASH
BR-029JTMINI-005 JT-MINI tau2-bench Overall 93% Unknown Primary source CMOB-JTMINI
BR-030SARVAM105B-005 Sarvam 105B tau2-bench Overall 46.8% Unknown Primary source SRVM-SARVAM105B
BR-030SARVAM30B-005 Sarvam 30B tau2-bench Overall 34.5% Unknown Primary source SRVM-SARVAM30B
BR-030SARVAMM-005 Sarvam M tau2-bench Overall 0% Unknown Primary source SRVM-SARVAMM
BR-031MINICPM51B-005 MiniCPM5-1B tau2-bench Overall 81% Unknown Primary source OBMB-MINICPM51B
BR-031MINICPM51B-016 MiniCPM5-1B tau2-bench Overall 82.5% Unknown Primary source OBMB-MINICPM51B
BR-031MINICPMV4613B-005 MiniCPM-V 4.6 1.3B tau2-bench Overall 87.7% Unknown Primary source OBMB-MINICPMV4613B
BR-032APERTUS70BINSTRUCT-005 Apertus 70B Instruct tau2-bench Overall 12.9% Unknown Primary source SWAI-APERTUS70BINSTRUCT
BR-032APERTUS8BINSTRUCT-005 Apertus 8B Instruct tau2-bench Overall 11.4% Unknown Primary source SWAI-APERTUS8BINSTRUCT
BR-033DOUBAOSEEDCODE-005 Doubao Seed Code tau2-bench Overall 58.2% Unknown Primary source BDSD-DOUBAOSEEDCODE
BR-033SEEDOSS36BINSTRUCT-005 Seed-OSS-36B-Instruct tau2-bench Overall 49.4% Unknown Primary source BDSD-SEEDOSS36BINSTRUCT
BR-034TRI21BTHINK-005 Tri-21B-Think tau2-bench Overall 81% Unknown Primary source TRLN-TRI21BTHINK
BR-034TRI21BTHINKPREVIEW-005 Tri-21B-think Preview tau2-bench Overall 93.3% Unknown Primary source TRLN-TRI21BTHINKPREVIEW
BR-035HY3PREVIEW-005 Hy3-preview tau2-bench Overall 92.7% Unknown Primary source TCNT-HY3PREVIEW
BR-035HY3PREVIEW-016 Hy3-preview tau2-bench Overall 67.5% Unknown Primary source TCNT-HY3PREVIEW
BR-036ERNIE45300BA47B-005 ERNIE 4.5 300B A47B tau2-bench Overall 0% Unknown Primary source BAIDU-ERNIE45300BA47B
BR-036ERNIE50THINKINGPREVIEW-005 ERNIE 5.0 Thinking Preview tau2-bench Overall 83.9% Unknown Primary source BAIDU-ERNIE50THINKINGPREVIEW
BR-037APRIELV1515BTHINKER-005 Apriel-v1.5-15B-Thinker tau2-bench Overall 68.4% Unknown Primary source SVNW-APRIELV1515BTHINKER
BR-037APRIELV1615BTHINKER-005 Apriel-v1.6-15B-Thinker tau2-bench Overall 69.3% Unknown Primary source SVNW-APRIELV1615BTHINKER
BR-038REKAFLASH3-005 Reka Flash 3 tau2-bench Overall 0% Unknown Primary source REKA-REKAFLASH3
BR-039MIDMK25PRO-005 Mi:dm K 2.5 Pro tau2-bench Overall 86.5% Unknown Primary source KT-MIDMK25PRO
BR-039MIDMK25PROPREVIEW-004 Mi:dm K 2.5 Pro Preview tau2-bench Overall 49.4% Unknown Primary source KT-MIDMK25PROPREVIEW
BR-040KATCODERPROV1-005 KAT-Coder-Pro V1 tau2-bench Overall 88.6% Unknown Primary source KWAI-KATCODERPROV1
BR-040KATCODERPROV2-005 KAT Coder Pro V2 tau2-bench Overall 89.5% Unknown Primary source KWAI-KATCODERPROV2
BR-041MERCURY2-005 Mercury 2 tau2-bench Overall 70.8% Unknown Primary source INCPT-MERCURY2
BR-043HYPERCLOVAXSEEDTHINK32B-005 HyperCLOVA X SEED Think (32B) tau2-bench Overall 87.4% Unknown Primary source NAVER-HYPERCLOVAXSEEDTHINK32B
BR-044HYPERNOVA60B2605-005 HyperNova 60B 2605 tau2-bench Overall 63.2% Unknown Primary source MVSC-HYPERNOVA60B2605
BR-045INTELLECT3-005 INTELLECT-3 tau2-bench Overall 26.6% Unknown Primary source PRIME-INTELLECT3
BR-046NEXN2PRO-005 Nex-N2-Pro tau2-bench Overall 81.6% Unknown Primary source NEXAI-NEXN2PRO
BR-047LONGCATFLASHLITE-005 LongCat Flash Lite tau2-bench Overall 79.5% Unknown Primary source LCAT-LONGCATFLASHLITE
BR-048MOTIF2127BREASONING-005 Motif-2-12.7B-Reasoning tau2-bench Overall 46.5% Unknown Primary source MOTIF-MOTIF2127BREASONING
BR-049NANBEIGE413B-005 Nanbeige4.1-3B tau2-bench Overall 21.6% Unknown Primary source NANB-NANBEIGE413B
BR-051TRINITYLARGETHINKING-005 Trinity Large Thinking tau2-bench Overall 90.1% Unknown Primary source ARCEE-TRINITYLARGETHINKING
BR-052FALCONH1R7B-005 Falcon-H1R-7B tau2-bench Overall 27.8% Unknown Primary source TIIUA-FALCONH1R7B