pragma.vision Technology observatory & strategic foresight

Verification register Security & Identity

Readiness verdict

Inspect / Inspect Evals (UK AISI)

A dated reading of what is claimed, reported, and independently verified in the current evidence.

As of
2026-10-01
Revision
4
Method
v1.4.0

Current reading

Readiness band and full integer triple

AI-assisted assembly · derived results

Readiness band

Ready

Primary summary from verified readiness

Confidence
86% · fresh
Computed at
2026-10-01T03:34:15.416899+00:00
Claimed
65

Public ambition and stated capability

Reported
65

Observed practitioner reporting

Verified
55

Independently supported evidence

Gap
+10

Claimed leads verified

Evidence strength Critical

Decision

What the current evidence supports

Agent-assisted assessment · independently reviewed · 2026-10-01

Use Inspect for research with pinned versions and benchmark-specific validation.

Why
External teams demonstrate sustained operation, but scorer defects, execution environments and scaffolding can materially change evaluation results.
Next
Check relevant September corrections, regrade affected HealthBench logs, rerun affected KernelBench tasks, and validate sandbox and monitoring coverage.

Constraints

Blockers

  • Benchmark implementations require task-specific correctness checks.
  • Affected historical scores may require regrading or rerunning.
  • Dependency, container and GPU environments complicate reproducibility.
  • Scaffold changes can alter measured performance.
  • Monitoring coverage depends on framework version and operational controls.

Evidence summary

Derived counts

AI-assisted assembly

Total
12
Tier 1
10
Tier 2
2
Tier 3
0
Supports
8
Contradicts
4
Context
0
Latest observed
2026-09-27

Counts and dates only. Raw signals, private excerpts, trust records, and internal corpus material are not published here.

Publication record

Revisions

Revision 4

  1. 2026-07-19 Reading moved from mature to mature.
  2. 2026-09-22 Reading moved from mature to mature.
  3. 2026-09-23 Reading moved from mature to ready.
  4. 2026-10-01 Reading moved from ready to ready.

Your opinion

Tell us anything.

What works, what doesn't, what's missing — especially about our watches, lenses, and the register itself. Anonymous is fine; leave an email if you'd like a reply.