Turning glasses into sensors: capacitive facial expression recognition under frame geometry constraints

Clinical Snapshot

Key Findings

• P Value: Not reported in abstract

• Effect Size: Median cosine similarity: AU02 (0.97), AU09 (0.87), AU17 (0.33)

• Primary Outcome: Facial action unit recognition accuracy via cosine similarity

• Nnt Or Sensitivity: High sensitivity for upper-face actions, limited sensitivity for lower-face actions due to mechanical signal attenuation

• Confidence Interval: Not reported in abstract

Clinical Application

Prototype stage - requires engineering development for consumer integration Potential applications in telehealth monitoring under Medicare Benefits Schedule, particularly for neurological conditions. Would require TGA approval as medical device if used clinically Adults requiring non-invasive facial expression monitoring, particularly for neurological assessment or rehabilitation

Abstract

Objective.Wearable facial expression recognition requires sensing modalities that are unobtrusive, illumination-independent, and compatible with everyday eyewear form factors. Existing optical and electromyographic approaches are limited by line-of-sight requirements, skin contact, or restricted action unit (AU) coverage. This work investigates the feasibility of non-contact capacitive sensing for facial muscle activity monitoring within the strict geometric constraints of standard eyewear.Approach.We developed FERGlasses, integrating eight loading-mode capacitive channels via a custom flexible PCB and active shielding to detect skin-to-frame displacement. A validation study with 40 participants was conducted to elicit seven facial action coding system-defined AUs. Signal fidelity was assessed using independent Random Forest regressors and benchmarked against commercial optical-proximity (OCOsense) and computer-vision (Py-Feat) standards.Main results.The system demonstrated high agreement for upper-face activity, achieving median cosine similarities of 0.97 for the Outer Brow Raiser (AU02) and 0.87 for the Nose Wrinkler (AU09), while lower-face actions such as the Chin Raiser (AU17) yielded a median of 0.33, consistent with mechanical signal attenuation along the frame. Channel-ablation analysis quantified the specific anatomical contributions of each electrode group, identifying eyebrow and rhinion sensors as primary signal drivers for upper-face and perinasal actions, respectively, and temple sensors as critical for cheek raiser detection.Significance.This study provides the first metrological validation of multi-channel capacitive sensing for AU-level recognition in eyewear. The results establish the modality as a robust, privacy-preserving, and illumination-independent alternative to optical methods for longitudinal physiological monitoring, with the current prototype serving as a wired research platform and full consumer-grade integration identified as a future engineering objective.

References

1. 1.Latino, F., Rossi, M., Palmisciano, A. C., Farabbi, A., Krishnan, A., Antonello, N., Mainardi, L., & Cerveri, P. (2026). Turning glasses into sensors: capacitive facial expression recognition under frame geometry constraints. Physiological Measurement. https://doi.org/10.1088/1361-6579/ae669e