pragma.vision Technology observatory & strategic foresight

Verification register Bio, Health & Neuro

Readiness verdict

OpenAI HealthBench

A dated reading of what is claimed, reported, and independently verified in the current evidence.

As of
2026-10-01
Revision
3
Method
v1.4.0

Current reading

Readiness band and full integer triple

AI-assisted assembly · derived results

Readiness band

Watch

Primary summary from verified readiness

Confidence
82% · fresh
Computed at
2026-10-01T01:22:29.45723+00:00
Claimed
65

Public ambition and stated capability

Reported
55

Observed practitioner reporting

Verified
45

Independently supported evidence

Gap
+20

Claimed leads verified

Evidence strength Strong

Decision

What the current evidence supports

Agent-assisted assessment · independently reviewed · 2026-10-01

Use HealthBench for comparative offline evaluation with local and specialty-specific checks.

Why
Independent applications demonstrate reusable benchmarking, but localization and missed clinical errors limit what aggregate scores establish about care.
Next
Pin corpus and grader versions, inspect specialty failures, and supplement scores with clinician review and validation in the intended workflow.

Constraints

Blockers

  • Clinical outcome prediction remains unestablished.
  • Geographic and guideline differences require localization.
  • Fixed rubrics can miss unexpected clinical errors.
  • Aggregate scores can obscure specialty-specific weaknesses.
  • Results depend on grader and implementation versions.

Evidence summary

Derived counts

AI-assisted assembly

Total
11
Tier 1
9
Tier 2
2
Tier 3
0
Supports
5
Contradicts
5
Context
1
Latest observed
2026-09-11

Counts and dates only. Raw signals, private excerpts, trust records, and internal corpus material are not published here.

Publication record

Revisions

Revision 3

  1. 2026-07-19 Reading moved from ready to ready.
  2. 2026-09-22 Reading moved from ready to ready.
  3. 2026-10-01 Reading moved from ready to watch.

Your opinion

Tell us anything.

What works, what doesn't, what's missing — especially about our watches, lenses, and the register itself. Anonymous is fine; leave an email if you'd like a reply.