Health Evals

OpenAI logoGPT-5.1: healthcare benchmark results

OpenAI · 5 boards · snapshot reviewed September 28, 2026

The index currently holds 5 results for GPT-5.1: 0.396 on HealthBench Professional (27 of 29 indexed rows), 0.254 on HealthBench Hard (18 of 20 indexed rows), 50.9 on HealthBench (25 of 26 indexed rows), 52.73% on MedCode (Vals AI) [GPT 5.1] (12 of 102 indexed rows), 88.09% on MedScribe (Vals AI) [GPT 5.1] (12 of 104 indexed rows). Scores below sit on different scales and come from different graders, so read each against its own benchmark, never against the others.

Results by benchmark

benchmarkscoreindex positionas of
HealthBench Professional
length-adjusted, max reasoning effort, GPT-5.6 system card Table 6 column GPT-5.1 (48.0 unadjusted, 4863 chars)
0.39627 of 292026-06
HealthBench Hard
length-adjusted, max reasoning effort, GPT-5.6 system card Table 6 column GPT-5.1 (41.4 unadjusted, 4049 chars)
0.25418 of 202026-06
HealthBench
OpenAI length-adjusted score, maximum reasoning effort; raw 64.2%, mean answer 4,222 characters; GPT-5.6 card Table 6.
50.925 of 262026-06
MedCode (Vals AI)
GPT 5.1
model ID openai/gpt-5.1-2025-11-13; reasoning_effort=high; max_output_tokens=30000; standard error 2.151 pp; $0.014371/test; source snapshot 2026-09-26; run date not published
52.73%12 of 1022026-09-26
MedScribe (Vals AI)
GPT 5.1
model ID openai/gpt-5.1-2025-11-13; reasoning_effort=high; max_output_tokens=30000; standard error 1.942 pp; $0.096508/test; source snapshot 2026-09-26; run date not published
88.09%12 of 1042026-09-26

Position follows the rows held in this index and is not a controlled comparison. Sources may use different graders or task subsets. Positions include separate configurations. A source board may contain additional rows; its size is listed separately when it differs. Config caveats, where a source noted any, are on each benchmark's page, and the document behind each score is cited on the sources page. Sources also list this model as "GPT 5.1".

Which healthcare benchmarks is GPT-5.1 scored on?

As of September 28, 2026, GPT-5.1 has indexed results on 5 tracked benchmarks: HealthBench Professional, HealthBench Hard, HealthBench, MedCode (Vals AI), MedScribe (Vals AI).

Which results are indexed for GPT-5.1?

GPT-5.1 stands at 0.396 on HealthBench Professional (27 of 29 indexed rows), 0.254 on HealthBench Hard (18 of 20 indexed rows), 50.9 on HealthBench (25 of 26 indexed rows), 52.73% on MedCode (Vals AI) [GPT 5.1] (12 of 102 indexed rows), 88.09% on MedScribe (Vals AI) [GPT 5.1] (12 of 104 indexed rows).

The benchmarks themselves are described on their pages, linked in the table above, and the whole field is on the index.