Peer Review of “The Performance of DeepSeek R1 and Gemini 3 in Complex Medical Scenarios: Comparative Study”
Year: 2026
Type: peer-review
Abstract: DeepSeek R1 and Gemini 3 in Complex Medical Scenarios: Comparative Study." Round 1 Review General CommentsThis paper [1] seeks to evaluate the accuracy of DeepSeek R1 in correctly identifying the primary medical diagnosis in the medical scenarios dataset portion of Massive Multitask Language Understanding Pro (MMLU-Pro) using an open-ended format.Some clarifications on the methods and results (especially around the roles of subject matter experts vs core team members in the publication), would be helpful in understanding how these results were derived.
Source: JMIRx Med
DOI: 10.2196/96225
Author: Jacqueline Guan-Ting You
Language: English
Subfield: Health Informatics
Field: Medicine
Domain: Health Sciences
Open Access status: gold
Estimated APC paid: $1,000
OpenAlex ID: W7156040128