NVIDIA: healthcare benchmark results
5 models · 6 results · snapshot reviewed September 28, 2026
Everything the index holds for NVIDIA, gathered in one place: Nemotron 3.5 Lightning, openai-agents + Nemotron 3 Ultra 256K, Nemotron 3 Ultra, Nemotron 3 Ultra 550B A55B (Reasoning), Nemotron 70B. Scores sit on each benchmark's own scale and never compare across rows from different boards.
Every result
| model | benchmark | score | index position |
|---|---|---|---|
| Nemotron 3.5 Lightning Subject suites release set: 257 tasks across eight subjects; one answer per task, no tools; blind cross-family grading. 95% bootstrap CI 3.6–6.2. Harness snapshot September 10, 2026; not the separate 89-task incretin ranking. | Health Optimization Bench | 4.9 | 16 of 16 |
| Nemotron 3.5 Lightning model ID fireworks/nemotron-lightning-3p5-30b-a3b; temperature=1; top_p=0.95; max_output_tokens=30000; standard error 0.492 pp; $0.006241/test; source snapshot 2026-09-26; run date not published | MedScribe (Vals AI) | 4.27% | 104 of 104 |
| openai-agents + Nemotron 3 Ultra 256K All Domains pass@1; PA 0.0%, UM 0.0%, CM 0.0%; submitted 2026-07-24; run date not published | CHI-Bench | 0.0% | 44 of 44 source board: 45 |
| Nemotron 3 Ultra model ID nvidia/nemotron-3-ultra-550b-a55b; temperature=1; top_p=0.95; max_output_tokens=30000; standard error 2.001 pp; source snapshot 2026-09-26; run date not published | MedCode (Vals AI) | 38.62% | 66 of 102 |
| Nemotron 3 Ultra 550B A55B (Reasoning) Artificial Analysis independent evaluation; current six-evaluation healthcare composite, including GDPval-AA v2.1, AA-Briefcase v1.1 and AutomationBench-AA. Configuration is shown in the model name. Board snapshot checked September 28, 2026; individual run dates are not disclosed. Display rounded to whole index points. | Artificial Analysis Healthcare & Medical Index | 23 | 22 of 25 source board: 77 |
| Nemotron 70B 95% bootstrap CI 37.3–41.3; 3 runs; temperature 0; zero-shot, closed-book | WHBench | 39.3% | 18 of 22 |
Positions refer to indexed rows, including configuration variants, and are not controlled comparisons across sources or graders. Source board sizes appear separately where coverage differs.
Which healthcare benchmarks does NVIDIA appear on?
As of September 28, 2026, NVIDIA models hold 6 indexed results across 6 tracked benchmarks, through Nemotron 3.5 Lightning, openai-agents + Nemotron 3 Ultra 256K, Nemotron 3 Ultra, Nemotron 3 Ultra 550B A55B (Reasoning), Nemotron 70B.
Where does NVIDIA have the highest indexed score?
NVIDIA does not have the highest indexed score on any tracked board in this snapshot.
Other labs with pages: OpenAI, Anthropic, Google, Alibaba, Meta, Moonshot AI, DeepSeek, SpaceXAI, xAI, Xiaomi, MiniMax, Thinking Machines, zAI, SpaceX AI, Zhipu AI, Mistral, Ant Group, Poolside, Zhipu, Z.ai, Microsoft, Baichuan, Tencent, Inception, Cohere. The full field is on the index.