Research Appraisaldiagnostic

Deep Learning outperforms physicians in myopathy and neuropathy classification based on Needle Electromyography Signal

PloS oneYoo, Ilhan, Yoo, Jaesung, Kim, Dongmin et al.DOI

Clinical Snapshot

35CEBM
Evidence: Weakdiagnostic

PICO Framework

P — Population57 patients with neuromuscular conditions undergoing needle electromyography at a tertiary university hospital
I — InterventionDeep learning model classification of nEMG signals
C — ComparatorClassification by six electromyographers
O — OutcomesDiagnostic accuracy, precision, sensitivity, and specificity for classifying normal, myopathy, and neuropathy conditions

Bottom Line

This small single-centre study suggests a deep learning model may outperform physicians in classifying needle EMG signals into normal, myopathy, and neuropathy categories. However, significant methodological limitations undermine confidence in these findings. The study lacks an appropriate reference standard, uses a very small sample size (57 patients), and provides insufficient technical detail for reproducibility. The absence of confidence intervals and statistical testing makes it impossible to determine if observed differences are clinically meaningful. While the concept of automated EMG interpretation is promising, this study provides insufficient evidence to support clinical implementation. Larger multicentre studies with established reference standards and rigorous validation are needed before considering such technology for clinical practice.

Evidence: Weak

Key Findings

  • P Value: Not reported

  • Effect Size: Deep learning model accuracy 0.70 vs physician accuracy 0.55

  • Primary Outcome: Classification accuracy for normal, myopathy, and neuropathy conditions

  • Nnt Or Sensitivity: Deep learning sensitivity 0.70, specificity 0.85; physician sensitivity 0.54, specificity 0.78

  • Confidence Interval: Not reported

Clinical Application

Requires significant computational infrastructure and validation in local populations before clinical implementation Would require TGA approval as medical device software; needs validation in Australian populations and integration with existing EMG equipment and workflows Patients undergoing needle electromyography for suspected neuromuscular disorders in tertiary care settings

Abstract

Needle electromyography (nEMG) is a valuable tool for diagnosing patients with neuromuscular diseases. However, it is labor-intensive and is prone to diagnostic inaccuracies stemming from human biases. To address these challenges, we validated an nEMG diagnosis-aiding system with minimal preprocessing using deep learning model to classify patients into three categories: normal, myopathy, and neuropathy. Using 376 nEMG signals from 57 patients from a tertiary university hospital database through nested k-fold cross validation, deep learning model surpassed the classification performance of six electromyographers. The median patient classification accuracy, precision, sensitivity, and specificity of the deep learning model was 0.70, 0.70, 0.70, and 0.85, respectively, whereas those of the physicians were 0.55, 0.60, 0.54, and 0.78, respectively. Model interpretability and failure analysis showed that the deep learning model classifies based on relevant signal features. Despite higher accuracy of DL model, the number of unanimously misclassified cases were higher in the DL model than physicians. Our study validates deep learning is a fast, accurate, and practical application to aid physicians in diagnosing patients using nEMG signals.

References

  1. 1.Yoo, I., Yoo, J., Kim, D., Youn, I., Kim, H., Youn, M., Won, J. H., Cho, W., Myong, Y., Kim, S., Yu, R., Kim, S. M., Kim, K., Lee, S. B., & Kim, K. (2024). Deep Learning outperforms physicians in myopathy and neuropathy classification based on Needle Electromyography Signal. PLoS One. https://doi.org/10.1371/journal.pone.0339691
Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service