tau2-bench Telecom
Telecom support where agent and user both act on a shared environment. Close to saturation.
| Category | Agents |
|---|---|
| Metric | pass^1 (%) |
| Source | tau2-bench (original) |
| License | MIT |
| Benchmark page | taubench.com |
| Status | Scored |
| Weight | 0.6 within Agents |
| Fit | Discrimination 0.88, noise 0.74 |
Results
| # | Model | Provider | Result | Date |
|---|---|---|---|---|
| 1 | Qwen3.5 397B-A17B | Alibaba | 97.8% | 2026-02-27 |
| 2 | Claude Opus 4.5 High | Anthropic | 92.3% | 2026-05-05 |
| 3 | Gemini 3 Flash Preview High | 91.2% | 2026-03-02 | |
| 4 | Gemini 3 Pro Preview High | 91.0% | 2026-03-02 | |
| 5 | GPT-5.2 High | OpenAI | 89.7% | 2026-05-05 |
| 6 | GLM-5 | Zhipu AI | 86.8% | 2026-02-27 |
| 7 | Claude Sonnet 4.5 | Anthropic | 84.9% | 2026-02-24 |
| 8 | GPT-5.2 Non-reasoning | OpenAI | 57.2% | 2026-05-26 |