Quaternion-based deep belief networks fine-tuning
Article
Papa, J., Rosa, G., Pereira, D. and Yang, X. 2017. Quaternion-based deep belief networks fine-tuning. Applied Soft Computing. 60, pp. 328-335. https://doi.org/10.1016/j.asoc.2017.06.046
| Type | Article |
|---|---|
| Title | Quaternion-based deep belief networks fine-tuning |
| Authors | Papa, J., Rosa, G., Pereira, D. and Yang, X. |
| Abstract | Deep learning techniques have been paramount in the last years, mainly due to their outstanding results in a number of applications. In this paper, we address the issue of fine-tuning parameters of Deep Belief Networks by means of meta-heuristics in which real-valued decision variables are described by quaternions. Such approaches essentially perform optimization in fitness landscapes that are mapped to a different representation based on hypercomplex numbers that may generate smoother surfaces. We therefore can map the optimization process onto a new space representation that is more suitable to learning parameters. Also, we proposed two approaches based on Harmony Search and quaternions that outperform the state-of-the-art results obtained so far in three public datasets for the reconstruction of binary images. |
| Keywords | Deep Belief Networks; Quaternion; Harmony Search |
| Publisher | Elsevier |
| Journal | Applied Soft Computing |
| ISSN | 1568-4946 |
| Electronic | 1872-9681 |
| Publication dates | |
| Online | 01 Jul 2017 |
| 17 Nov 2017 | |
| Publication process dates | |
| Deposited | 24 Jul 2017 |
| Accepted | 22 Jun 2017 |
| Output status | Published |
| Accepted author manuscript | License File Access Level Open |
| Copyright Statement | © 2017. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/ |
| Digital Object Identifier (DOI) | https://doi.org/10.1016/j.asoc.2017.06.046 |
| Web of Science identifier | WOS:000414072200024 |
| Language | English |
https://repository.mdx.ac.uk/item/87190
Download files
128
total views92
total downloads4
views this month1
downloads this month