pragma.vision Your technology observatory

Verification register AI & Agents

Readiness verdict

tau2-bench (τ²-Bench)

A dated reading of what is claimed, reported, and independently verified in the current evidence.

As of
2026-06-28
Revision
1
Method
v1.0.0

Current reading

The readiness gap, in one scan

AI-assisted assembly · derived results

Claimed
80

Public ambition and stated capability

Reported
68

Observed practitioner reporting

Verified
58

Independently supported evidence

Gap
+22

Claimed minus verified

Evidence strength Strong

Decision

What the current evidence supports

Human editorial judgment · 2026-06-28

Adopt with guardrails

Why
It is the de-facto industry standard for conversational tool-agent eval and its pass^k/dual-control framing maps onto our shared-world agent risks, but headline numbers are domain-, simulator- and harness-sensitive and must not be quoted bare.
Next
Use τ²-Bench's dual-control + pass^k methodology as the template for our customer-facing agent reliability gates; report pass^k (not pass^1), segment by domain difficulty, and pin a fixed user-simulator + harness version rather than citing a single leaderboard figure.

Constraints

Blockers

No named blocker is present in the current public projection.

Evidence summary

Derived counts

AI-assisted assembly

Total
6
Tier 1
0
Tier 2
4
Tier 3
2
Supports
1
Contradicts
4
Context
1
Latest observed
2026-06-01

Counts and dates only. Raw signals, private excerpts, trust records, and internal corpus material are not published here.

Publication record

Revisions

Initial public reading

This is the initial public reading. No earlier readiness change is recorded.

Your opinion

Tell us anything.

What works, what doesn't, what's missing — especially about our watches, lenses, and the register itself. Anonymous is fine; leave an email if you'd like a reply.