Health Evals

OpenAI logoGPT-6 Astra (Anthropic run): healthcare benchmark results

OpenAI · 6 boards · snapshot reviewed September 28, 2026

The index currently holds 7 results for GPT-6 Astra (Anthropic run): 0.703 on HealthBench Professional (1 of 29 indexed rows), 0.647 on HealthBench Professional [GPT-6 Astra] (4 of 29 indexed rows), 0.366 on HealthBench Hard [GPT-6 Astra] (4 of 20 indexed rows), 58.3 on HealthBench [GPT-6 Astra] (9 of 26 indexed rows), 48.49% on MedCode (Vals AI) [GPT-6 Astra] (25 of 102 indexed rows), 87.91% on MedScribe (Vals AI) [GPT-6 Astra] (14 of 104 indexed rows), 52 on Artificial Analysis Healthcare & Medical Index [GPT-6 Astra (max)] (4 of 25 indexed rows). It has the highest indexed score on HealthBench Professional. Scores below sit on different scales and come from different graders, so read each against its own benchmark, never against the others.

Results by benchmark

benchmarkscoreindex positionas of
HealthBench Professional
Anthropic reproduction of GPT-6 Astra through the public API; max effort; no system prompt; Claude Opus 4.8 grader; length-adjusted 70.3%, raw 74.0%. Different grader/protocol from OpenAI’s own 64.7% report.
0.7031 of 292026-09
HealthBench Professional
GPT-6 Astra
OpenAI evaluation; length-adjusted at maximum reasoning effort; raw 68.2%, mean answer 3,185 characters. September 22, 2026 system-card revision; the Astra values correct a prior evaluation misconfiguration.
0.6474 of 292026-09
HealthBench Hard
GPT-6 Astra
OpenAI evaluation; length-adjusted at maximum reasoning effort; raw 34.2%, mean answer 1,697 characters. September 22, 2026 system-card revision; the Astra values correct a prior evaluation misconfiguration.
0.3664 of 202026-09
HealthBench
GPT-6 Astra
OpenAI evaluation; length-adjusted at maximum reasoning effort; raw 56.9%, mean answer 1,760 characters. September 22, 2026 system-card revision; the Astra values correct a prior evaluation misconfiguration.
58.39 of 262026-09
MedCode (Vals AI)
GPT-6 Astra
model ID openai/gpt-6-astra; reasoning_effort=max; max_output_tokens=128000; standard error 2.131 pp; $0.451358/test; source snapshot 2026-09-26; run date not published
48.49%25 of 1022026-09-26
MedScribe (Vals AI)
GPT-6 Astra
model ID openai/gpt-6-astra; reasoning_effort=max; max_output_tokens=128000; standard error 1.938 pp; $0.581991/test; source snapshot 2026-09-26; run date not published
87.91%14 of 1042026-09-26
Artificial Analysis Healthcare & Medical Index
GPT-6 Astra (max)
Artificial Analysis independent evaluation; current six-evaluation healthcare composite, including GDPval-AA v2.1, AA-Briefcase v1.1 and AutomationBench-AA. Configuration is shown in the model name. Board snapshot checked September 28, 2026; individual run dates are not disclosed. Display rounded to whole index points.
524 of 25
source board: 77
2026-09

Position follows the rows held in this index and is not a controlled comparison. Sources may use different graders or task subsets. Positions include separate configurations. A source board may contain additional rows; its size is listed separately when it differs. Config caveats, where a source noted any, are on each benchmark's page, and the document behind each score is cited on the sources page. Sources also list this model as "GPT-6 Astra" and "GPT-6 Astra (max)".

Which healthcare benchmarks is GPT-6 Astra (Anthropic run) scored on?

As of September 28, 2026, GPT-6 Astra (Anthropic run) has indexed results on 6 tracked benchmarks: HealthBench Professional, HealthBench Hard, HealthBench, MedCode (Vals AI), MedScribe (Vals AI), Artificial Analysis Healthcare & Medical Index.

Which results are indexed for GPT-6 Astra (Anthropic run)?

GPT-6 Astra (Anthropic run) stands at 0.703 on HealthBench Professional (1 of 29 indexed rows), 0.647 on HealthBench Professional [GPT-6 Astra] (4 of 29 indexed rows), 0.366 on HealthBench Hard [GPT-6 Astra] (4 of 20 indexed rows), 58.3 on HealthBench [GPT-6 Astra] (9 of 26 indexed rows), 48.49% on MedCode (Vals AI) [GPT-6 Astra] (25 of 102 indexed rows), 87.91% on MedScribe (Vals AI) [GPT-6 Astra] (14 of 104 indexed rows), 52 on Artificial Analysis Healthcare & Medical Index [GPT-6 Astra (max)] (4 of 25 indexed rows). It has the highest indexed score on HealthBench Professional.

The benchmarks themselves are described on their pages, linked in the table above, and the whole field is on the index.