Research Appraisals
Evidence-based critical appraisals of the latest medical research, systematically evaluated using Oxford CEBM methodology.
Showing 2 appraisals
Studies in health technology and informatics
De-Identification of Free-Text Medical Records Using Large Language Models
This study evaluates large language models (LLMs) for automated de-identification of free-text medical records. Using 150 synthetically generated, personal health information (PHI)-enriched doctor's letters (23.2 PHIs per letter), we compared the full LLaMA-3.1-8B model (BF16, GPU) with a quantized variant (Q8, CPU) under zero-shot and few-shot prompting. Few-shot prompting improved performance from a macro F1 of 0.989 to 0.996 (recall = 0.994); the quantized Q8 model achieved a macro F1 of 0.992 (recall = 0.987) while enabling fully local, GPU-free inference. Although LLMs perform at a level comparable to human annotation, false negatives remain a concern for highly sensitive PHI, such as names. While human annotators typically require 13.4 seconds per PHI, the LLMs de-identified complete letters within seconds, demonstrating an efficiency and scalability advantage alongside GDPR-compliant, high-precision de-identification.
24 May 2026
Read appraisal →Healthcare management forum
Navigating Privacy in Health Data Sharing: A Patient-Centric Approach to Health Information Exchange
Personal Health Information (PHI) sharing through Health Information Exchange (HIE) enhances patient safety in Canada, yet not all provinces and territories voluntarily disclose PHI on safety incidents to federal and pan-Canadian surveillance systems. A frequently cited barrier by healthcare organizations for HIE between different interoperable health databases is patients' and families' concerns for their privacy. This explorative qualitative study examined patients' and families' attitudes toward PHI sharing, including its secondary use in patient safety events. Rather than expressing reluctance, participants described support for HIE when privacy safeguards, such as defined sharing purposes and anonymous formats, were in place. These findings present a significant opportunity for health leaders and data custodians to use the research findings to create a patient-centric framework for the HIE of PHI.
6 May 2026
Read appraisal →