Quantum Machine Learning delivers effective unlearning across Iris, MNIST, and Fashion-MNIST datasets

Machine Learning


Increasing demands for data privacy have necessitated “unlearning” techniques that effectively remove the influence of specific data points from trained machine learning models, and Carla Crivoi and Radu Tudor Ionescu from the University of Bucharest, along with colleagues, have published the first comprehensive empirical study of this process in the emerging field of quantum machine learning. Their work investigates how well existing non-learning techniques translate to hybrid classical-quantum neural networks and introduces two new strategies specifically designed for these architectures. Through rigorous testing on standard datasets, the team demonstrated that while effective unlearning is achievable, performance is highly influenced by the complexity of the quantum circuit and the nature of the learning task. These findings establish important baseline insights and highlight the need for new non-learning algorithms tailored to the unique challenges and opportunities posed by quantum-enhanced machine learning systems.

Their work investigates how well existing non-learning techniques translate to hybrid classical-quantum neural networks and introduces two new strategies specifically designed for these architectures. Through rigorous testing on standard datasets, the team demonstrated that while effective unlearning is achievable, performance is highly influenced by the complexity of the quantum circuit and the nature of the learning task. These findings establish important baseline insights and highlight the need for new non-learning algorithms tailored to the unique challenges and opportunities posed by quantum-enhanced machine learning systems.

Unlearning strategies for hybrid quantum neural networks

This work pioneers a comprehensive empirical study of machine unlearning within hybrid quantum-classical neural networks, a previously unexplored field. The researchers adapted a set of established non-learning techniques, including gradient-based, regularization-based, distillation-based, and qualification techniques, to settings incorporating variational quantum circuits. This adaptation allows us to systematically evaluate how these traditional methods perform when applied to models containing quantum components. To further enhance unlearning capabilities in hybrid architectures, the team introduced two new strategies: Label-Complement Augmentation and ADV-UNIFORM.

Label-Complement Augmentation forces a high-entropy output for forgotten samples, while ADV-UNIFORM adopts an adversarial approach to drive predictions toward uniformity, both of which aim to improve the forgetting process. Experiments were conducted across three datasets: Iris, MNIST, and Fashion-MNIST under both subset deletion and full-class deletion scenarios. This rigorous test allowed the researchers to assess the impact of the quantum component on stability, fidelity, and changes in representation caused by non-learning updates. Focusing on how circuit depth and entanglement structure influence unlearning processes, the research team closely analyzed the model's behavior and investigated whether variational quantum circuits can constrain memory and reshape the dynamics of forgetting through unique amplitude-based embeddings.

Hybrid quantum network successfully unlearns data

This study presents the first systematic evaluation of machine unlearning within a hybrid quantum-classical neural network, examining performance across multiple datasets, forgetting scenarios, and architectural scales. The results show that effective relearning is achievable with variational quantum models, but their behavior is strongly influenced by the circuit depth, entanglement structure, and complexity of the relearning task. While shallow circuits have limited memory, deeper hybrid models require structured interventions to reliably approximate retraining after data deletion. In this study, we find that methods that impose architectural or regularization-based constraints consistently outperform unconstrained gradient-based approaches in maintaining usefulness, achieving effective forgetting, and coordinating with retraining oracles.

This suggests that when unlearning interacts with quantum feature embeddings, it is essential to control how updates are propagated. The analysis also highlighted the importance of measuring structural integrity, rather than relying solely on utility metrics, to assess unlearning success. The authors acknowledge that it is important to extend the evaluation to real quantum hardware to understand how noise and device limitations affect non-learning performance. Future research directions include the development of nonlearning algorithms specifically designed to take advantage of quantum properties such as amplitude structure and entanglement, and the establishment of formal guarantees for quantum nonlearning, similar to qualified removal techniques in classical machine learning.

Hybrid quantum network successfully unlearns data

This study presents the first comprehensive empirical study of unlearning in hybrid quantum-classical neural networks and investigates how these models can effectively “forget” previously learned information. The researchers adapted and developed a series of non-learning techniques for these hybrid systems, including gradient-based, distillation-based, regularization-based, and qualification techniques, and introduced two new strategies specifically tailored to the hybrid architecture. Experiments were conducted across Iris, MNIST, and Fashion-MNIST datasets to evaluate performance under both subset deletion and full-class deletion scenarios. The team measured accuracy, usefulness, and quality of forgetting to assess unlearning performance.

On the Iris dataset, all methods maintained high accuracy on the retention and test sets, generally above 90%, although there was 2% subset forgetting. Test accuracies between 96.7% and 100% were achieved across several methods, demonstrating minimal performance degradation. For Iris full-class forgetting, several methods maintained high retention accuracy, but Certified achieved the highest test accuracy. These results indicate that shallow quantum circuits have low memory and are naturally robust to small data deletions.

Moving to the more complex MNIST dataset and performing subset forgetting experiments, we found that one method achieved the best retention accuracy and Certified achieved the best test accuracy. Agreement on the test set remains consistently high, indicating that the global decision boundary is largely preserved after unlearning. Structural similarity measurements showed that some methods exhibit better consistency with the retraining oracle. From a privacy perspective, several methods yielded the lowest membership inference attack values, demonstrating improved membership protection and retraining approximations. These findings establish baseline empirical insights on unlearning in hybrid quantum-classical models and highlight the need for quantum-aware algorithms and theoretical guarantees as the scale and capabilities of these systems continue to grow. The team has made the code and dataset publicly available to encourage further research in this emerging field.



Source link