{"id":117,"date":"2026-11-19T12:07:59","date_gmt":"2026-11-19T12:07:59","guid":{"rendered":"https:\/\/blockerlife.com\/index.php\/2026\/11\/19\/microsofts-diagnostic-ai-outscored-doctors-in-case-based-tests-but-needs-clinical-validation\/"},"modified":"2026-11-19T12:07:59","modified_gmt":"2026-11-19T12:07:59","slug":"microsofts-diagnostic-ai-outscored-doctors-in-case-based-tests-but-needs-clinical-validation","status":"publish","type":"post","link":"https:\/\/blockerlife.com\/index.php\/2026\/11\/19\/microsofts-diagnostic-ai-outscored-doctors-in-case-based-tests-but-needs-clinical-validation\/","title":{"rendered":"Microsoft\u2019s diagnostic AI outscored doctors in case-based tests, but needs clinical validation"},"content":{"rendered":"<p>In reporting dated October 23, 2026, Microsoft said its Diagnostic Orchestrator was more accurate than physicians in tests using past medical cases. The results do <strong>not<\/strong> establish how well it would work with patients in clinical settings.<\/p>\n<p>The system uses multiple AI agents to review symptoms and medical histories, consider which tests to order and reach a diagnosis. In cases drawn from hundreds of reports in <em>The New England Journal of Medicine<\/em>, it reached about <strong>83% diagnostic accuracy<\/strong>. Generalist physicians scored about <strong>36%<\/strong> when using references and <strong>22%<\/strong> without them. On emergency department cases drawn from a database of admissions at Boston\u2019s Beth Israel Deaconess Medical Center, the system scored <strong>80%<\/strong>, compared with a <strong>47%<\/strong> average for physicians. Its estimated diagnostic costs were also generally lower.<\/p>\n<p>The findings appeared in <em>Science<\/em>. Microsoft assembled the cases into a benchmark called SDBench, which it plans to open-source. The researchers said the system, powered by OpenAI\u2019s GPT-5, also outperformed leading AI models used on their own. The paper did not test it against several newer models.<\/p>\n<p><strong>The main limitation is that the system has been tested on historical cases, not validated in live clinical care.<\/strong> \u201cIt needs clinical validation,\u201d Microsoft AI CEO Mustafa Suleyman said. Microsoft\u2019s AI health lead and study coauthor, Dr. Dominic King, said the company planned to begin hospital-based testing with Beth Israel Deaconess Medical Center, but neither he nor Suleyman gave a firm timeline. Microsoft had not said when or how the technology might become available.<\/p>\n<p>The results are a comparison under the study\u2019s testing conditions\u2014not a reason to replace a clinician\u2019s assessment of an individual patient.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In reporting dated October 23, 2026, Microsoft said its Diagnostic Orchestrator was more accurate than physicians in tests [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-117","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/blockerlife.com\/index.php\/wp-json\/wp\/v2\/posts\/117","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blockerlife.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blockerlife.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blockerlife.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blockerlife.com\/index.php\/wp-json\/wp\/v2\/comments?post=117"}],"version-history":[{"count":0,"href":"https:\/\/blockerlife.com\/index.php\/wp-json\/wp\/v2\/posts\/117\/revisions"}],"wp:attachment":[{"href":"https:\/\/blockerlife.com\/index.php\/wp-json\/wp\/v2\/media?parent=117"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blockerlife.com\/index.php\/wp-json\/wp\/v2\/categories?post=117"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blockerlife.com\/index.php\/wp-json\/wp\/v2\/tags?post=117"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}