Gated subspace alignment with drift compensation for parameter-efficient Class-Incremental Learning

Clinical Snapshot

Key Findings

• P Value: Not reported

• Effect Size: Not specified in abstract

• Primary Outcome: Improved classification accuracy in class-incremental learning scenarios

• Nnt Or Sensitivity: Not applicable - computational methodology study

• Confidence Interval: Not reported

Clinical Application

Limited clinical feasibility without validation in healthcare settings No relevance to Australian clinical practice, PBS, TGA, or RACGP guidelines Not directly applicable to clinical populations

Abstract

Class-Incremental Learning (CIL) aims to enable models to continuously learn new categories while preserving existing knowledge and avoiding catastrophic forgetting. Although parameter-expansion architectures can alleviate task interference to some extent, the representations of previously learned classes often drift or degrade as the feature subspaces continuously evolve and expand, resulting in decreased recognition performance for old classes. To address this issue, we propose an efficient CIL method-Dynamic Gated Adapter for Subspace Alignment (DGASA). Based on a frozen pre-trained backbone, DGASA introduces lightweight adapters with attention-based gating for each task to construct task-specific subspaces, while dynamically fusing cross-task information via attention mechanisms. In addition, DGASA learns a linear mapping between the old and new subspaces to achieve consistent alignment of old class prototypes in the current subspace without accessing past data. Extensive experiments demonstrate that DGASA significantly improves classification accuracy and resistance to forgetting on multiple benchmark datasets, offering strong generalization and computational efficiency.