Classical to quantum knowledge distillation: a study on the impact of hybridization
Conference paper
Piperno, S., Vittori, G., Windridge, D., Rosato, A. and Panella, M. 2025. Classical to quantum knowledge distillation: a study on the impact of hybridization. 2025 International Joint Conference on Neural Networks. Rome, Italy 30 Jun - 05 Jul 2025 IEEE. https://doi.org/10.1109/ijcnn64981.2025.11227730
| Type | Conference paper |
|---|---|
| Title | Classical to quantum knowledge distillation: a study on the impact of hybridization |
| Authors | Piperno, S., Vittori, G., Windridge, D., Rosato, A. and Panella, M. |
| Abstract | Knowledge distillation (KD) is a widely explored technique in classical machine learning, in which a smaller or more efficient model is trained to mimic the behavior of a larger, more complex model. In this study, we extend the concept of knowledge distillation from classical architectures to quantum architectures, with the goal of improving the training of quantum models while potentially reducing the number of parameters compared to their classical counterparts. Given the inherent challenges in training quantum neural networks, leveraging knowledge from well-established classical models could provide valuable insights and advantages, particularly in terms of model efficiency and performance. In this work we explore the potential benefits of this approach, evaluating a hybrid quantum model against a nonhybrid quantum baseline. While the proposed study is still in the preliminary stage, it aims to set the scene for further investigation into the most appropriate architecture for classical-to-quantum KD in order to enhance the development and optimization of quantum neural networks more generally. |
| Keywords | quantum machine learning |
| Sustainable Development Goals | 9 Industry, innovation and infrastructure |
| Middlesex University Theme | Creativity, Culture & Enterprise |
| Research Group | Artificial Intelligence group |
| Conference | 2025 International Joint Conference on Neural Networks |
| Proceedings Title | 2025 International Joint Conference on Neural Networks (IJCNN) |
| ISSN | 2161-4393 |
| Electronic | 2161-4407 |
| ISBN | |
| Electronic | 9798331510428 |
| Paperback | 9798331510435 |
| Publisher | IEEE |
| Publication dates | |
| 30 Jun 2025 | |
| Online | 14 Nov 2025 |
| Publication process dates | |
| Accepted | 17 Apr 2025 |
| Deposited | 07 Jul 2025 |
| Output status | Published |
| Accepted author manuscript | License File Access Level Open |
| Copyright Statement | For the purpose of open access, the author(s) has applied a Creative Commons Attribution (CC BY) license to any Accepted Manuscript version arising. |
| Digital Object Identifier (DOI) | https://doi.org/10.1109/ijcnn64981.2025.11227730 |
| Web address (URL) of conference proceedings | https://doi.org/10.1109/IJCNN64981.2025 |
https://repository.mdx.ac.uk/item/27899w
Download files
Accepted author manuscript
116
total views51
total downloads4
views this month0
downloads this month