Understanding 3D mid-air hand gestures with interactive surfaces and displays: a systematic literature review

Conference paper

Groenewald, C., Anslow, C., Islam, J., Rooney, C., Passmore, P. and Wong, B. 2016. Understanding 3D mid-air hand gestures with interactive surfaces and displays: a systematic literature review. HCI 2016 - Fusion! 30th International BCS Human Computer Interaction Conference (HCI 2016). Bournemouth University, Poole, United Kingdom 11 - 15 Jul 2016 British Computer Society. pp. 1-13 https://doi.org/10.14236/ewic/HCI2016.43
TypeConference paper
TitleUnderstanding 3D mid-air hand gestures with interactive surfaces and displays: a systematic literature review
AuthorsGroenewald, C., Anslow, C., Islam, J., Rooney, C., Passmore, P. and Wong, B.
Abstract

3D gesture based systems are becoming ubiquitous and there are many mid-air hand gestures that exist for interacting with digital surfaces and displays. There is no well defined gesture set for 3D mid-air hand gestures which makes it difficult to develop applications that have consistent gestures. To understand what gestures exist we conducted the first comprehensive systematic literature review on mid-air hand gestures following existing research methods. The results of the review identified 65 papers where the mid-air hand gestures supported tasks for selection, navigation, and manipulation. We also classified the gestures according to a gesture classification scheme and identified how these gestures have been empirically evaluated. The results of the review provide a richer understanding of what mid-air hand gestures have been designed, implemented, and evaluated in the literature which can help developers design better user experiences for digital interactive surfaces and displays.

ConferenceHCI 2016 - Fusion! 30th International BCS Human Computer Interaction Conference (HCI 2016)
Page range1-13
ISSN1477-9358
PublisherBritish Computer Society
Publication dates
Online11 Jul 2016
Publication process dates
Deposited26 Jun 2017
Accepted07 May 2016
Output statusPublished
Publisher's version
Copyright Statement

© Groenewald et al. Published by BCS Learning and Development Ltd. First published in the 'Electronic Workshops in Computing' series at http://ewic.bcs.org/category/18954

Digital Object Identifier (DOI)https://doi.org/10.14236/ewic/HCI2016.43
LanguageEnglish
Book titleHCI 2016 - Fusion! Proceedings of the 30th International BCS Human Computer Interaction Conference (HCI 2016)
Permalink -

https://repository.mdx.ac.uk/item/87103

Log in to edit

Download files

Publisher's version
ewic_hci16_fp_paper28.pdf

  • 51
    total views
  • 21
    total downloads
  • 3
    views this month
  • 1
    downloads this month

Export as

Related outputs

Patterns of life visualisations for intelligence analysis: exploring animation with POLAR
Attfield, S., Selvaraj, N., Kodagoda, N., Passmore, P. and Duncker-Gassen, E. 2019. Patterns of life visualisations for intelligence analysis: exploring animation with POLAR. 2019 International Carnahan Conference on Security Technology (ICCST). Chennai, India 01 - 03 Oct 2019 IEEE. pp. 1-6 https://doi.org/10.1109/CCST.2019.8888410
UX evaluation of VR locomotion & virtual object interaction mechanics
Wiedemann, D., Passmore, P. and Moar, M. 2020. UX evaluation of VR locomotion & virtual object interaction mechanics. Geril, P. and Polanska, M. (ed.) SciFi-It’2020 the 4th International Science Fiction Prototyping Conference. University of Leuven Campus Ghent, Ghent, Belgium 07 - 09 Sep 2020 EUROSIS. pp. 49-57
“VRification”: applying virtual reality to digital games
Wiedemann, D., Passmore, P. and Moar, M. 2017. “VRification”: applying virtual reality to digital games. SciFi-It'2017: International Science Fiction Prototyping Conference. Bruges, Belgium 10 - 11 Apr 2017 EUROSIS. pp. 55-58
An experiment design: investigating VR locomotion & virtual object interaction mechanics
Wiedemann, D., Passmore, P. and Moar, M. 2017. An experiment design: investigating VR locomotion & virtual object interaction mechanics. GAME-ON'2017: 18th International Conference on Intelligent Games and Simulation. Carlow, Ireland 06 - 08 Sep 2017 EUROSIS. pp. 80-86
Virtual Reality 3rd person camera behavior modes
Wiedemann, D., Passmore, P. and Moar, M. 2016. Virtual Reality 3rd person camera behavior modes. GAME-ON'2016: 17th International Conference on Intelligent Games and Simulation. Lisbon, Portugal 13 - 15 Sep 2016 EUROSIS. pp. 57-64
Local multiplayer immersion affected by 3D stereoscopy
Wiedemann, D., Passmore, P. and Moar, M. 2017. Local multiplayer immersion affected by 3D stereoscopy. CHI PLAY 2017. Amsterdam 15 - 18 Oct 2017 Association for Computing Machinery (ACM). pp. 25-35 https://doi.org/10.1145/3130859.3131429
How can we design tactile interactive software for argument construction in criminal intelligence analysis?
Groenewald, C., Wong, B., Attfield, S., Passmore, P. and Kodagoda, N. 2017. How can we design tactile interactive software for argument construction in criminal intelligence analysis? Gore, J. and Ward, P. (ed.) 13th Bi-annual International Conference on Naturalistic Decision Making (NDM13). University of Bath, Bath, United Kingdom 20 - 23 Jun 2017 The University of Bath. pp. 322-328
How analysts think: how do criminal intelligence analysts recognise and manage significant information?
Groenewald, C., Wong, B., Attfield, S., Passmore, P. and Kodagoda, N. 2017. How analysts think: how do criminal intelligence analysts recognise and manage significant information? 2017 European Intelligence and Security Informatics Conference (EISIC 2017). Athens, Greece 11 - 13 Sep 2017 Institute of Electrical and Electronics Engineers (IEEE). pp. 47-53 https://doi.org/10.1109/EISIC.2017.15
How analysts think: navigating uncertainty – aspirations, considerations and strategies
Groenewald, C., Wong, B., Attfield, S., Passmore, P. and Kodagoda, N. 2017. How analysts think: navigating uncertainty – aspirations, considerations and strategies. Gore, J. and Ward, P. (ed.) 13th Bi-annual International Conference on Naturalistic Decision Making (NDM13). University of Bath, Bath, United Kingdom 20 - 23 Jun 2017 The University of Bath. pp. 56-64
How analysts think: think-steps as a tool for structuring sensemaking in criminal intelligence analysis
Selvaraj, N., Attfield, S., Passmore, P. and Wong, B. 2016. How analysts think: think-steps as a tool for structuring sensemaking in criminal intelligence analysis. 2016 European Intelligence and Security Informatics Conference (EISIC). Uppsala, Sweden 17 - 19 Aug 2016 Institute of Electrical and Electronics Engineers (IEEE). pp. 68-75 https://doi.org/10.1109/EISIC.2016.019
360 Cinematic literacy: a case study
Passmore, P., Glancy, M., Philpot, A. and Fields, B. 2017. 360 Cinematic literacy: a case study. International Broadcasting Convention Conference 2017. Amsterdam 14 - 18 Sep 2017 International Broadcasting Convention.
Addressing VAST 2016 mini challenge 2 with POLAR kermode, classifier, excel on a power wall and data timelines
Attfield, S., Hewitt, D., Xu, K., Passmore, P., Wagstaff, A., Phillips, G., Windridge, D., Dash, G., Chapman, R. and Mason, L. 2016. Addressing VAST 2016 mini challenge 2 with POLAR kermode, classifier, excel on a power wall and data timelines. IEEE VAST Challenge 2016. Baltimore, MD, USA 23 Oct 2016
Supporting the externalisation of thinking in criminal intelligence analysis
Passmore, P., Attfield, S., Kodagoda, N., Groenewald, C. and Wong, B. 2015. Supporting the externalisation of thinking in criminal intelligence analysis. European Intelligence and Security Informatics Conference (EISIC) 2015. Manchester, United Kingdom 07 - 09 Sep 2015 Institute of Electrical and Electronics Engineers (IEEE). pp. 16-23 https://doi.org/10.1109/EISIC.2015.35
Archives of thrill: the V-Armchair experience
Passmore, P., Tennent, P., Walker, B., Philpot, A., Le, H., Markowski, M. and Karamanoglu, M. 2017. Archives of thrill: the V-Armchair experience. Lindeman, R., Bruder, G. and Iwai, D. (ed.) ICAT-EGVE 2017. Adelaide, Australia 22 - 24 Nov 2017 European Association for Computer Graphics. pp. 125-132 https://doi.org/10.2312/egve.20171349
A practical, hybrid argumentation model to assist with the formulation of defensible assessments in uncertain sense-making environments
Groenewald, C., Attfield, S., Passmore, P., Wong, B. and Kodagoda, N. 2017. A practical, hybrid argumentation model to assist with the formulation of defensible assessments in uncertain sense-making environments. 2017 International Conference Next Generation Community Policing. Heraklion, Crete, Greece 25 - 27 Oct 2017
User experience of panoramic video in CAVE-like and head mounted display viewing conditions
Philpot, A., Glancy, M., Passmore, P., Wood, A. and Fields, B. 2017. User experience of panoramic video in CAVE-like and head mounted display viewing conditions. TVX '17: ACM International Conference on Interactive Experiences for TV and Online Video. Hilversum, The Netherlands 14 - 16 Jun 2017 New York, NY, USA Association for Computing Machinery (ACM). pp. 65-75 https://doi.org/10.1145/3077548.3077550
Effects of viewing condition on user experience of panoramic video
Passmore, P., Glancy, M., Philpot, A., Roscoe, A., Wood, A. and Fields, B. 2016. Effects of viewing condition on user experience of panoramic video. Reiners, D., Iwai, D and Steinicke, F. (ed.) ICAT-EGVE 2016 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments. Little Rock, Arkansas, USA. 07 - 09 Dec 2016 The Eurographics Association. https://doi.org/10.2312/egve.20161428
Exploring the challenges of implementing guidelines for the design of visual analytics systems
Haider, J., Pohl, M., Hillemann, E., Nussbaumer, A., Attfield, S., Passmore, P. and Wong, B. 2015. Exploring the challenges of implementing guidelines for the design of visual analytics systems. Human Factors and Ergonomics Society 2015 ​59th International Annual Meeting. Los Angeles, California, USA 26 - 30 Oct 2015 Human Factors and Ergonomics Society. pp. 259-263 https://doi.org/10.1177/1541931215591053
A review of cell assemblies
Huyck, C. and Passmore, P. 2013. A review of cell assemblies. Biological Cybernetics. 107 (3), pp. 263-288. https://doi.org/10.1007/s00422-013-0555-5
A user study on curved edges in graph visualization
Xu, K., Rooney, C., Passmore, P., Ham, D. and Nguyen, P. 2012. A user study on curved edges in graph visualization. IEEE Transactions on Visualization and Computer Graphics. 18 (12), pp. 2449 -2456. https://doi.org/10.1109/TVCG.2012.189
Genetic sequences: tracing the mutations of a disease.
Mitchell, I., Passmore, P. and Xu, K. 2010. Genetic sequences: tracing the mutations of a disease. IEEE VAST Symposium 2010 Challenge. Salt Lake City, Utah, USA 24 - 29 Oct 2010
Hospitalization records: characterization of pandemic spread.
Passmore, P., Zheng, Y., Rooney, C., Al-Sheikh, T. and Xu, K. 2010. Hospitalization records: characterization of pandemic spread. IEEE VAST Symposium 2010 Challenge. Salt Lake City, Utah, USA 24 - 29 Oct 2010
Integration of geographic information system and RADARSAT synthetic aperture radar data using a self-organizing map network as compensation for realtime ground data in automatic image classification
Shepherd, I., Passmore, P. and Kamal, M. 2010. Integration of geographic information system and RADARSAT synthetic aperture radar data using a self-organizing map network as compensation for realtime ground data in automatic image classification. Journal of Applied Remote Sensing. 4 (1), pp. 1-13. https://doi.org/10.1117/1.3457166
Statistical analysis for brain EIT images using SPM.
Zhang, Y., Passmore, P., Yerworth, R. and Bayford, R. 2005. Statistical analysis for brain EIT images using SPM. Institute of Electrical and Electronics Engineers. pp. 60-67 https://doi.org/10.1109/MEDIVIS.2005.17
Models of cell assembly decay
Passmore, P. and Huyck, C. 2008. Models of cell assembly decay. Institute of Electrical and Electronics Engineers. pp. 1-6 https://doi.org/10.1109/UKRICIS.2008.4798946
Visualization of multidimensional and multimodal tomographic medical imaging data, a case study
Zhang, Y., Passmore, P. and Bayford, R. 2009. Visualization of multidimensional and multimodal tomographic medical imaging data, a case study. Philosophical Transactions of the Royal Society of London. A: Mathematical and Physical Sciences. 367 (1900), pp. 3121-3148. https://doi.org/10.1098/rsta.2009.0084
Invariance of visual perception
Chikhman, V., Shelepin, Y., Foreman, N., Passmore, P., Vakhrameeva, O. and Pronin, S. 2008. Invariance of visual perception. Experimental Psychology. 1, pp. 7-33.
Viewpoint invariance in the recognition of 3-D depth-rotated figures
Chikhman, V., Shelepin, Y., Foreman, N. and Passmore, P. 2008. Viewpoint invariance in the recognition of 3-D depth-rotated figures. Perception. 37.
The estimation of quantitative ranges of invariance in visual perception
Chikhman, V., Shelepin, Y., Vakhrameeva, O., Pronin, S., Foreman, N. and Passmore, P. 2009. The estimation of quantitative ranges of invariance in visual perception. Perception. 38.
Task based visualization of 5D brain EIT data
Zhang, Y., Passmore, P. and Bayford, R. 2009. Task based visualization of 5D brain EIT data. SAC09: The 2009 ACM Symposium on Applied Computing. Honolulu Hawaii, USA 08 - 12 Mar 2009 New York Association for Computing Machinery (ACM). pp. 831-835 https://doi.org/10.1145/1529282.1529459
Dynamics in proportionate selection.
Mitchell, I., Agrawal, A., Litovski, I. and Passmore, P. 2005. Dynamics in proportionate selection. in: International Conference on Adaptive and Natural Computnig Alogorithms, Coimbra, Portugal. Proceedings. Vienna. Springer. pp. 226-229
Colour vision model-based approach for segmentation of traffic signs
Gao, X., Hong, K., Passmore, P., Podladchikova, L. and Shaposhnikov, D. 2008. Colour vision model-based approach for segmentation of traffic signs. EURASIP Journal on Image and Video Processing. 2008. https://doi.org/10.1155/2008/386705
Visualization and post-processing of 5D Brain Images
Zhang, Y., Passmore, P. and Bayford, R. 2005. Visualization and post-processing of 5D Brain Images. 27th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Shanghai, China 01 - 04 Sep 2005 IEEE. pp. 1083-1086 https://doi.org/10.1109/IEMBS.2005.1616607