pragma.vision Technology observatory

Verification register Security & Identity

Living definition

What is Inspect / Inspect Evals (UK AISI)?

AI Safety, Eval & Alignment Security & Identity

As of
2026-07-23
Revision
2026-07-26.0
Method
v1.3.0

Definition

The term, in context

AI-assisted draft · approved dataset

Inspect is an open-source framework for evaluating large language models, structuring each evaluation as a dataset of samples, a solver pipeline that elicits model behavior, and scorers that grade the resulting outputs. Inspect Evals is a companion collection of reusable evaluation implementations built on that framework, covering areas such as reasoning, coding, and safety-relevant capabilities.

Live readiness status

Status as of the current dateline

AI-assisted assembly · derived results

As of 2026-07-23, verified readiness is 76 (claimed 85, reported 84, gap 9) — Critical evidence strength; current signals suggest Adopt with guardrails.

The readiness fact belongs to the canonical Readiness Verdict for Inspect / Inspect Evals (UK AISI).

Dataset approval

Human editorial release

pragma.vision editorial — standing authorization (operator dev@soft.house, 2026-07-17)

Dataset
2026-07-26.0
Hash
sha256:e2eb667df093db8819d579dff9aad51021b4977da85db2dfa82f63f9ed4e72b7
Approved
2026-07-26

Your opinion

Tell us anything.

What works, what doesn't, what's missing — especially about our watches, lenses, and the register itself. Anonymous is fine; leave an email if you'd like a reply.