Living definition
What is Inspect / Inspect Evals (UK AISI)?
AI Safety, Eval & Alignment Security & Identity
- As of
- 2026-07-23
- Revision
- 2026-07-26.0
- Method
- v1.3.0
Definition
The term, in context
AI-assisted draft · approved dataset
Inspect is an open-source framework for evaluating large language models, structuring each evaluation as a dataset of samples, a solver pipeline that elicits model behavior, and scorers that grade the resulting outputs. Inspect Evals is a companion collection of reusable evaluation implementations built on that framework, covering areas such as reasoning, coding, and safety-relevant capabilities.
Live readiness status
Status as of the current dateline
AI-assisted assembly · derived results
As of 2026-07-23, verified readiness is 76 (claimed 85, reported 84, gap 9) — Critical evidence strength; current signals suggest Adopt with guardrails.
The readiness fact belongs to the canonical Readiness Verdict for Inspect / Inspect Evals (UK AISI).
Dataset approval
Human editorial release
pragma.vision editorial — standing authorization (operator dev@soft.house, 2026-07-17)
- Dataset
- 2026-07-26.0
- Hash
- sha256:e2eb667df093db8819d579dff9aad51021b4977da85db2dfa82f63f9ed4e72b7
- Approved
- 2026-07-26