Health Evals

Google logoGemini 2.5 Flash Lite (9/25) (Thinking): healthcare benchmark results

Google · 2 boards · snapshot reviewed September 28, 2026

The index currently holds 4 results for Gemini 2.5 Flash Lite (9/25) (Thinking): 34.19% on MedCode (Vals AI) (76 of 102 indexed rows), 27.08% on MedCode (Vals AI) [Gemini 2.5 Flash Lite (9/25) (Nonthinking)] (98 of 102 indexed rows), 75.82% on MedScribe (Vals AI) [Gemini 2.5 Flash Lite (9/25) (Nonthinking)] (74 of 104 indexed rows), 66.88% on MedScribe (Vals AI) (95 of 104 indexed rows). Scores below sit on different scales and come from different graders, so read each against its own benchmark, never against the others.

Results by benchmark

benchmarkscoreindex positionas of
MedCode (Vals AI)
model ID google/gemini-2.5-flash-lite-preview-09-2025-thinking; temperature=1; max_output_tokens=30000; standard error 1.736 pp; $0.001182/test; source snapshot 2026-09-26; run date not published
34.19%76 of 1022026-09-26
MedCode (Vals AI)
Gemini 2.5 Flash Lite (9/25) (Nonthinking)
model ID google/gemini-2.5-flash-lite-preview-09-2025; temperature=1; max_output_tokens=30000; standard error 1.911 pp; $0.001440/test; source snapshot 2026-09-26; run date not published
27.08%98 of 1022026-09-26
MedScribe (Vals AI)
Gemini 2.5 Flash Lite (9/25) (Nonthinking)
model ID google/gemini-2.5-flash-lite-preview-09-2025; temperature=1; max_output_tokens=30000; standard error 1.851 pp; $0.001332/test; source snapshot 2026-09-26; run date not published
75.82%74 of 1042026-09-26
MedScribe (Vals AI)
model ID google/gemini-2.5-flash-lite-preview-09-2025-thinking; temperature=1; max_output_tokens=30000; standard error 1.923 pp; $0.002567/test; source snapshot 2026-09-26; run date not published
66.88%95 of 1042026-09-26

Position follows the rows held in this index and is not a controlled comparison. Sources may use different graders or task subsets. Positions include separate configurations. A source board may contain additional rows; its size is listed separately when it differs. Config caveats, where a source noted any, are on each benchmark's page, and the document behind each score is cited on the sources page. Sources also list this model as "Gemini 2.5 Flash Lite (9/25) (Nonthinking)".

Which healthcare benchmarks is Gemini 2.5 Flash Lite (9/25) (Thinking) scored on?

As of September 28, 2026, Gemini 2.5 Flash Lite (9/25) (Thinking) has indexed results on 2 tracked benchmarks: MedCode (Vals AI), MedScribe (Vals AI).

Which results are indexed for Gemini 2.5 Flash Lite (9/25) (Thinking)?

Gemini 2.5 Flash Lite (9/25) (Thinking) stands at 34.19% on MedCode (Vals AI) (76 of 102 indexed rows), 27.08% on MedCode (Vals AI) [Gemini 2.5 Flash Lite (9/25) (Nonthinking)] (98 of 102 indexed rows), 75.82% on MedScribe (Vals AI) [Gemini 2.5 Flash Lite (9/25) (Nonthinking)] (74 of 104 indexed rows), 66.88% on MedScribe (Vals AI) (95 of 104 indexed rows).

The benchmarks themselves are described on their pages, linked in the table above, and the whole field is on the index.