Health Technology/clinical-trials

First Real-World Study Evaluates AI Clinical Decision Tools in Resident Training — Cambridge Health Alliance Trial

247 Health News Editorial

·

31 May 2026

·

4 min read

·clinical-trials

Cambridge Health Alliance launches first real-world study comparing AI clinical decision tools with traditional medical references in resident training. The trial evaluates OpenEvidence, ChatGPT, Claude, and Gemini for clinical appropriateness in actual patient care settings.

Originally reported by ClinicalTrials.gov

References

  1. 1.Cambridge Health Alliance. (2024). A Comparative Performance Evaluation of Four Publicly Available Large Language Models Against Gold Standard Medical References. ClinicalTrials.gov. NCT07199231. https://clinicaltrials.gov/study/NCT07199231
  2. 2.Lee, P., Bubeck, S., & Petro, J. (2023). Benefits, limits, and risks of GPT-4 as an AI chatbot for medicine. New England Journal of Medicine, 388(13), 1233-1239. https://doi.org/10.1056/NEJMsr2214184
  3. 3.Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022). AI in health and medicine. Nature Medicine, 28(1), 31-38. https://doi.org/10.1038/s41591-021-01614-0
  4. 4.Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., ... & Natarajan, V. (2023). Large language models encode clinical knowledge. Nature, 620(7972), 172-180. https://doi.org/10.1038/s41586-023-06291-2
  5. 5.Thirunavukarasu, A. J., Ting, D. S. J., Elangovan, K., Gutierrez, L., Tan, T. F., & Ting, D. S. W. (2023). Large language models in medicine. Nature Medicine, 29(8), 1930-1940. https://doi.org/10.1038/s41591-023-02448-8
Share:XLinkedIn
2

247 Health News Editorial

247 Health News is a medical intelligence platform delivering evidence-based research appraisals, clinical trial monitoring, and health technology news for healthcare professionals.

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service