Research Appraisals
Evidence-based critical appraisals of the latest medical research, systematically evaluated using Oxford CEBM methodology.
Showing 2 appraisals
Artificial intelligence in medicine
Artificial intelligence language models for medical text analysis: A systematic review
Medical text records serve as essential repositories of patient information, providing a foundation for informed clinical decision-making, accurate diagnosis, reliable prognosis, and effective treatment planning. Recent advancements in Artificial Intelligence (AI), particularly in Natural Language Processing (NLP) and Machine Learning (ML), have positioned AI-driven language models as powerful tools for analyzing, classifying, and generating medical textual data. In this systematic literature review, an initial search retrieved 548 records published between 1 January 2000 and 1 July 2024. After rigorous screening based on predefined inclusion and exclusion criteria, 22 original research articles were included. The review highlights substantial progress in applying advanced architectures such as Bidirectional Encoder Representations from Transformers (BERT) and Generative Pre-trained Transformers (GPT) to medical text processing tasks. These models consistently outperform conventional NLP and ML approaches, achieving superior results in disease classification, automated clinical documentation, and predictive analytics. However, critical challenges persist, including the limited availability of clinically validated datasets, variability in data preprocessing protocols, insufficient external validation, and the lack of interpretable AI frameworks, all of which collectively hinder clinical trust and large-scale adoption. Future research should prioritize the development of hybrid AI systems that integrate multimodal data sources (text, imaging, and structured records), incorporate explainable AI mechanisms, and adhere to standardized reporting frameworks. Addressing these methodological gaps will be pivotal in enhancing the reliability, clinical applicability, and impact of AI language models, thereby advancing evidence-based medicine, personalized treatment strategies, and overall patient care.
2 Aug 2026
Read appraisal →Proceedings of the National Academy of Sciences of the United States of America
Race-conscious admissions algorithms and the law.
In recent years, colleges and universities have begun to use machine learning (ML) systems to inform admissions decisions. Meanwhile, in the 2023 case Students for Fair Admissions, Inc. v. President and Fellows of Harvard College, the Supreme Court held that colleges and universities may not make admissions decisions "on the basis of race." These parallel developments-the rise of ML in admissions and the fall of race-based affirmative action-will force educational institutions, and ultimately courts, to confront the difficult question of what it means for ML systems to differentiate "on the basis of race." We begin by mapping the Students for Fair Admissions decision onto different uses of race in predictive AI. We distinguish between "first-order" and "second-order" race consciousness at both the training and predictive phases of machine learning, and we argue that each category of race consciousness raises distinct legal and normative issues. We go on to show that the Students for Fair Admissions decision potentially permits-and even endorses-certain forms of race consciousness. Our analysis is grounded in the observation that the process of developing ML-based systems enables policymakers to calibrate decision making algorithms much more precisely and explicitly in response to specific criticisms of race-conscious affirmative action.
28 July 2026
Read appraisal →