BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

tau2-bench

Benchmark Family
tau2-bench
Organization
Sierra
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedtau2-bench/defaultACTIVE350
Retailtau2-bench/retailACTIVE1
Telecomtau2-bench/telecomACTIVE2

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-007QWEN359B-019 Qwen3.5 9B tau2-bench Overall 86.8% Unknown Primary source QWEN-QWEN359B
BR-007QWEN35OMNIFLASH-005 Qwen3.5 Omni Flash tau2-bench Overall 84.5% Unknown Primary source QWEN-QWEN35OMNIFLASH
BR-007QWEN35OMNIPLUS-005 Qwen3.5 Omni Plus tau2-bench Overall 88.3% Unknown Primary source QWEN-QWEN35OMNIPLUS
BR-007QWEN3627B-005 Qwen3.6 27B tau2-bench Overall 93.6% Unknown Primary source QWEN-QWEN3627B
BR-007QWEN3627B-020 Qwen3.6 27B tau2-bench Overall 94.2% Unknown Primary source QWEN-QWEN3627B
BR-007QWEN3635BA3B-005 Qwen3.6 35B A3B tau2-bench Overall 85.1% Unknown Primary source QWEN-QWEN3635BA3B
BR-007QWEN3635BA3B-018 Qwen3.6 35B A3B tau2-bench Overall 95.3% Unknown Primary source QWEN-QWEN3635BA3B
BR-007QWEN36MAXPREVIEW-005 Qwen3.6 Max Preview tau2-bench Overall 95.9% Unknown Primary source QWEN-QWEN36MAXPREVIEW
BR-007QWEN36PLUS-005 Qwen3.6 Plus tau2-bench Overall 97.7% Unknown Primary source QWEN-QWEN36PLUS
BR-007QWEN37MAX-005 Qwen3.7 Max tau2-bench Overall 94.7% Unknown Primary source QWEN-QWEN37MAX
BR-007QWEN37PLUS-005 Qwen3.7 Plus tau2-bench Overall 93% Unknown Primary source QWEN-QWEN37PLUS
BR-007QWEN38B-005 Qwen3 8B tau2-bench Overall 27.8% Unknown Primary source QWEN-QWEN38B
BR-007QWEN38B-019 Qwen3 8B tau2-bench Overall 24.9% Unknown Primary source QWEN-QWEN38B
BR-007QWEN3CODER30BA3BINSTRUCT-005 Qwen3 Coder 30B A3B Instruct tau2-bench Overall 34.5% Unknown Primary source QWEN-QWEN3CODER30BA3BINSTRUCT
BR-007QWEN3CODER480BA35BINSTRUCT-005 Qwen3 Coder 480B A35B Instruct tau2-bench Overall 43.6% Unknown Primary source QWEN-QWEN3CODER480BA35BINSTRUCT
BR-007QWEN3CODERNEXT-005 Qwen3 Coder Next tau2-bench Overall 79.5% Unknown Primary source QWEN-QWEN3CODERNEXT
BR-007QWEN3MAX-005 Qwen3 Max tau2-bench Overall 74.3% Unknown Primary source QWEN-QWEN3MAX
BR-007QWEN3MAXPREVIEW-005 Qwen3 Max (Preview) tau2-bench Overall 32.7% Unknown Primary source QWEN-QWEN3MAXPREVIEW
BR-007QWEN3MAXTHINKING-005 Qwen3 Max Thinking tau2-bench Overall 83.6% Unknown Primary source QWEN-QWEN3MAXTHINKING
BR-007QWEN3MAXTHINKINGPREVIEW-005 Qwen3 Max Thinking (Preview) tau2-bench Overall 83.6% Unknown Primary source QWEN-QWEN3MAXTHINKINGPREVIEW
BR-007QWEN3NEXT80BA3B-005 Qwen3 Next 80B A3B tau2-bench Overall 41.5% Unknown Primary source QWEN-QWEN3NEXT80BA3B
BR-007QWEN3NEXT80BA3BINSTRUCT-005 Qwen3 Next 80B A3B Instruct tau2-bench Overall 21.6% Unknown Primary source QWEN-QWEN3NEXT80BA3BINSTRUCT
BR-007QWEN3OMNI30BA3B-005 Qwen3 Omni 30B A3B tau2-bench Overall 21.3% Unknown Primary source QWEN-QWEN3OMNI30BA3B
BR-007QWEN3OMNI30BA3BINSTRUCT-005 Qwen3 Omni 30B A3B Instruct tau2-bench Overall 16.4% Unknown Primary source QWEN-QWEN3OMNI30BA3BINSTRUCT
BR-007QWEN3VL235BA22B-005 Qwen3 VL 235B A22B tau2-bench Overall 54.1% Unknown Primary source QWEN-QWEN3VL235BA22B
BR-007QWEN3VL235BA22BINSTRUCT-005 Qwen3 VL 235B A22B Instruct tau2-bench Overall 35.1% Unknown Primary source QWEN-QWEN3VL235BA22BINSTRUCT
BR-007QWEN3VL30BA3B-005 Qwen3 VL 30B A3B tau2-bench Overall 19.9% Unknown Primary source QWEN-QWEN3VL30BA3B
BR-007QWEN3VL30BA3BINSTRUCT-005 Qwen3 VL 30B A3B Instruct tau2-bench Overall 19% Unknown Primary source QWEN-QWEN3VL30BA3BINSTRUCT
BR-007QWEN3VL32B-005 Qwen3 VL 32B tau2-bench Overall 45.6% Unknown Primary source QWEN-QWEN3VL32B
BR-007QWEN3VL32BINSTRUCT-005 Qwen3 VL 32B Instruct tau2-bench Overall 29.2% Unknown Primary source QWEN-QWEN3VL32BINSTRUCT
BR-007QWEN3VL4B-005 Qwen3 VL 4B tau2-bench Overall 15.5% Unknown Primary source QWEN-QWEN3VL4B
BR-007QWEN3VL4BINSTRUCT-005 Qwen3 VL 4B Instruct tau2-bench Overall 23.4% Unknown Primary source QWEN-QWEN3VL4BINSTRUCT
BR-007QWEN3VL8B-005 Qwen3 VL 8B tau2-bench Overall 22.5% Unknown Primary source QWEN-QWEN3VL8B
BR-007QWEN3VL8BINSTRUCT-005 Qwen3 VL 8B Instruct tau2-bench Overall 29.2% Unknown Primary source QWEN-QWEN3VL8BINSTRUCT
BR-008DEEPSEEKR10528MAY25-005 DeepSeek R1 0528 (May '25) tau2-bench Overall 36.5% Unknown Primary source DPSK-DEEPSEEKR10528MAY25
BR-008DEEPSEEKR10528QWEN38B-005 DeepSeek R1 0528 Qwen3 8B tau2-bench Overall 0% Unknown Primary source DPSK-DEEPSEEKR10528QWEN38B
BR-008DEEPSEEKR1DISTILLLLAMA70B-005 DeepSeek R1 Distill Llama 70B tau2-bench Overall 21.9% Unknown Primary source DPSK-DEEPSEEKR1DISTILLLLAMA70B
BR-008DEEPSEEKR1JAN25-005 DeepSeek R1 (Jan '25) tau2-bench Overall 11.4% Unknown Primary source DPSK-DEEPSEEKR1JAN25
BR-008DEEPSEEKV30324-005 DeepSeek V3 0324 tau2-bench Overall 47.1% Unknown Primary source DPSK-DEEPSEEKV30324
BR-008DEEPSEEKV31-005 DeepSeek V3.1 tau2-bench Overall 37.4% Unknown Primary source DPSK-DEEPSEEKV31
BR-008DEEPSEEKV31-016 DeepSeek V3.1 tau2-bench Overall 34.8% Unknown Primary source DPSK-DEEPSEEKV31
BR-008DEEPSEEKV31TERMINUS-005 DeepSeek V3.1 Terminus tau2-bench Overall 37.1% Unknown Primary source DPSK-DEEPSEEKV31TERMINUS
BR-008DEEPSEEKV31TERMINUS-019 DeepSeek V3.1 Terminus tau2-bench Overall 37.1% Unknown Primary source DPSK-DEEPSEEKV31TERMINUS
BR-008DEEPSEEKV32-005 DeepSeek V3.2 tau2-bench Overall 78.9% Unknown Primary source DPSK-DEEPSEEKV32
BR-008DEEPSEEKV32-016 DeepSeek V3.2 tau2-bench Overall 90.6% Unknown Primary source DPSK-DEEPSEEKV32
BR-008DEEPSEEKV32EXP-005 DeepSeek V3.2 Exp tau2-bench Overall 33.9% Unknown Primary source DPSK-DEEPSEEKV32EXP
BR-008DEEPSEEKV32EXP-016 DeepSeek V3.2 Exp tau2-bench Overall 33.9% Unknown Primary source DPSK-DEEPSEEKV32EXP
BR-008DEEPSEEKV32SPECIALE-005 DeepSeek V3.2 Speciale tau2-bench Overall 0% Unknown Primary source DPSK-DEEPSEEKV32SPECIALE
BR-008DEEPSEEKV3DEC24-005 DeepSeek V3 (Dec '24) tau2-bench Overall 22.8% Unknown Primary source DPSK-DEEPSEEKV3DEC24
BR-008DEEPSEEKV4FLASH-005 DeepSeek V4 Flash tau2-bench Overall 95.6% Unknown Primary source DPSK-DEEPSEEKV4FLASH
BR-008DEEPSEEKV4FLASH-016 DeepSeek V4 Flash tau2-bench Overall 94.4% Unknown Primary source DPSK-DEEPSEEKV4FLASH
BR-008DEEPSEEKV4FLASH-027 DeepSeek V4 Flash tau2-bench Overall 95% Unknown Primary source DPSK-DEEPSEEKV4FLASH
BR-008DEEPSEEKV4PRO-005 DeepSeek V4 Pro tau2-bench Overall 94.2% Unknown Primary source DPSK-DEEPSEEKV4PRO
BR-008DEEPSEEKV4PRO-017 DeepSeek V4 Pro tau2-bench Overall 91.2% Unknown Primary source DPSK-DEEPSEEKV4PRO
BR-008DEEPSEEKV4PRO-028 DeepSeek V4 Pro tau2-bench Overall 96.2% Unknown Primary source DPSK-DEEPSEEKV4PRO
BR-009LLAMA31INSTRUCT405B-005 Llama 3.1 Instruct 405B tau2-bench Overall 19% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT70B-005 Llama 3.1 Instruct 70B tau2-bench Overall 15.2% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT8B-005 Llama 3.1 Instruct 8B tau2-bench Overall 16.4% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA32INSTRUCT11BVISION-005 Llama 3.2 Instruct 11B (Vision) tau2-bench Overall 14.6% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT1B-005 Llama 3.2 Instruct 1B tau2-bench Overall 0% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT3B-005 Llama 3.2 Instruct 3B tau2-bench Overall 21.1% Unknown Primary source META-LLAMA32INSTRUCT3B
BR-009LLAMA33INSTRUCT70B-005 Llama 3.3 Instruct 70B tau2-bench Overall 26.6% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA3INSTRUCT70B-005 Llama 3 Instruct 70B tau2-bench Overall 0% Unknown Primary source META-LLAMA3INSTRUCT70B
BR-009LLAMA3INSTRUCT8B-005 Llama 3 Instruct 8B tau2-bench Overall 0% Unknown Primary source META-LLAMA3INSTRUCT8B
BR-009LLAMA4MAVERICK-005 Llama 4 Maverick tau2-bench Overall 17.8% Unknown Primary source META-LLAMA4MAVERICK
BR-009LLAMA4SCOUT-005 Llama 4 Scout tau2-bench Overall 15.5% Unknown Primary source META-LLAMA4SCOUT
BR-009MUSESPARK-005 Muse Spark tau2-bench Overall 91.5% Unknown Primary source META-MUSESPARK
BR-010KIMIK2-005 Kimi K2 tau2-bench Overall 61.1% Unknown Primary source KIMI-KIMIK2
BR-010KIMIK20905-005 Kimi K2 0905 tau2-bench Overall 73.4% Unknown Primary source KIMI-KIMIK20905
BR-010KIMIK25-005 Kimi K2.5 tau2-bench Overall 95.9% Unknown Primary source KIMI-KIMIK25
BR-010KIMIK25-018 Kimi K2.5 tau2-bench Overall 81.3% Unknown Primary source KIMI-KIMIK25
BR-010KIMIK26-005 Kimi K2.6 tau2-bench Overall 95.9% Unknown Primary source KIMI-KIMIK26
BR-010KIMIK26-022 Kimi K2.6 tau2-bench Overall 93.9% Unknown Primary source KIMI-KIMIK26
BR-010KIMIK27CODE-005 Kimi K2.7 Code tau2-bench Overall 90.1% Unknown Primary source KIMI-KIMIK27CODE
BR-010KIMIK2THINKING-005 Kimi K2 Thinking tau2-bench Overall 93% Unknown Primary source KIMI-KIMIK2THINKING
BR-010KIMILINEAR48BA3BINSTRUCT-005 Kimi Linear 48B A3B Instruct tau2-bench Overall 0% Unknown Primary source KIMI-KIMILINEAR48BA3BINSTRUCT
BR-01145-005 GLM-4.5 tau2-bench Overall 43% Unknown Primary source GLM-45
BR-01146-005 GLM-4.6 tau2-bench Overall 70.5% Unknown Primary source GLM-46
BR-01146-019 GLM-4.6 tau2-bench Overall 76.9% Unknown Primary source GLM-46
BR-01147-005 GLM-4.7 tau2-bench Overall 95.9% Unknown Primary source GLM-47
BR-01147-019 GLM-4.7 tau2-bench Overall 94.2% Unknown Primary source GLM-47
BR-0115-005 GLM-5 tau2-bench Overall 98.2% Unknown Primary source GLM-5
BR-0115-017 GLM-5 tau2-bench Overall 97.4% Unknown Primary source GLM-5
BR-01151-005 GLM-5.1 tau2-bench Overall 97.7% Unknown Primary source GLM-51
BR-01151-020 GLM-5.1 tau2-bench Overall 97.1% Unknown Primary source GLM-51
BR-01152-030 GLM-5.2 tau2-bench Overall 99.1% Unknown Primary source GLM-52
BR-011GLM45AIR-005 GLM-4.5-Air tau2-bench Overall 46.5% Unknown Primary source GLM-GLM45AIR
BR-011GLM45V-005 GLM-4.5V tau2-bench Overall 19.6% Unknown Primary source GLM-GLM45V
BR-011GLM45V-017 GLM-4.5V tau2-bench Overall 22.5% Unknown Primary source GLM-GLM45V
BR-011GLM46V-005 GLM-4.6V tau2-bench Overall 30.7% Unknown Primary source GLM-GLM46V
BR-011GLM46V-017 GLM-4.6V tau2-bench Overall 31.6% Unknown Primary source GLM-GLM46V
BR-011GLM47FLASH-005 GLM-4.7-Flash tau2-bench Overall 98.8% Unknown Primary source GLM-GLM47FLASH
BR-011GLM47FLASH-016 GLM-4.7-Flash tau2-bench Overall 91.8% Unknown Primary source GLM-GLM47FLASH
BR-011GLM5TURBO-005 GLM-5-Turbo tau2-bench Overall 98.5% Unknown Primary source GLM-GLM5TURBO
BR-011GLM5VTURBO-005 GLM 5V Turbo tau2-bench Overall 98.5% Unknown Primary source GLM-GLM5VTURBO
BR-012MINIMAXM140K-005 MiniMax M1 40k tau2-bench Overall 31.6% Unknown Primary source MMAX-MINIMAXM140K
BR-012MINIMAXM180K-005 MiniMax M1 80k tau2-bench Overall 34.2% Unknown Primary source MMAX-MINIMAXM180K
BR-012MINIMAXM2-005 MiniMax-M2 tau2-bench Overall 86.8% Unknown Primary source MMAX-MINIMAXM2
BR-012MINIMAXM21-005 MiniMax-M2.1 tau2-bench Overall 85.4% Unknown Primary source MMAX-MINIMAXM21
BR-012MINIMAXM25-005 MiniMax-M2.5 tau2-bench Overall 95.3% Unknown Primary source MMAX-MINIMAXM25