Research Appraisalobservational

An online brain-computer interface for detecting incongruity in augmented reality applications

Journal of neural engineeringWimmer, Michael, ElSayed, Neven, Thomas, Bruce H et al.29 May 2026DOI

Clinical Snapshot

70CEBM
Evidence: Moderateobservational

PICO Framework

P — PopulationHealthy young adults (specific demographics not detailed in abstract)
I — InterventionHybrid brain-computer interface using EEG and eye-tracking for incongruity detection in augmented reality
C — ComparatorCongruent vs incongruent digital information overlaid on physical objects
O — OutcomesN400 event-related potential response, balanced accuracy of incongruity detection (70%)

Bottom Line

This experimental study demonstrates proof-of-concept for detecting semantic incongruity in augmented reality using hybrid brain-computer interfaces. The research leverages the well-established N400 event-related potential, achieving 70% accuracy in distinguishing between congruent and incongruent AR information. While scientifically interesting, the clinical applicability remains limited by moderate accuracy, unclear generalisability, and current technological constraints. The approach may have future relevance for AR-assisted medical applications, surgical navigation, or medical education, but requires significant development before clinical implementation. Australian healthcare professionals should view this as early-stage technology research rather than immediately applicable clinical innovation.

Evidence: Moderate

Key Findings

  • P Value: Not reported

  • Effect Size: Not reported

  • Primary Outcome: Detection of incongruent AR information using hybrid BCI

  • Nnt Or Sensitivity: 70% balanced accuracy for incongruity detection

  • Confidence Interval: Not reported

Clinical Application

Currently experimental; requires specialised EEG equipment and technical expertise Relevant to emerging digital health initiatives and TGA considerations for medical device software; potential applications in telehealth and medical AR systems Limited to research settings; potential future applications in AR-assisted healthcare, medical training, or rehabilitation

Abstract

Objective.Augmented reality can provide digital information about physical entities presented within its real-world context. However, this information might disagree with the user's expectations due to factual errors in the data or cognitive biases. Such incongruity can impair user experience and undermine trust in the AR system. To address this issue, we propose detecting inconsistencies between physical objects and digital information through hybrid brain-computer interfaces.Approach.We conducted two complementary experiments. First, we implemented a strategy that integrates eye-tracking and brain signals for incongruity detection in an offline study. Subsequently, we assessed our approach in an online study in which participants received immediate feedback on the classification.Main results.The grand average event-related potentials revealed consistent electroencephalographic responses to incongruent augmentations, specifically a centroparietal N400 effect, across both experiments. We could further distinguish between congruent and incongruent information with an average balanced accuracy of 70% in the online study.Significance.These findings demonstrate the feasibility of detecting incongruity online, allowing for autonomous system adaptation, like presenting information in a more accessible format or providing contextual support.

References

  1. 1.Wimmer, M., ElSayed, N., Thomas, B. H., Müller-Putz, G. R., & Veas, E. E. (2026). An online brain-computer interface for detecting incongruity in augmented reality applications. Journal of Neural Engineering. https://doi.org/10.1088/1741-2552/ae6ff1
Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service