Beaming into the news: a system for and case study of tele-immersive journalism

Article

Kishore, S., Navarro, X., Dominguez, E., De La Peña, N. and Slater, M. 2018. Beaming into the news: a system for and case study of tele-immersive journalism. IEEE Computer Graphics and Applications. 38 (2), pp. 89-101. https://doi.org/10.1109/mcg.2017.2801407
TypeArticle
TitleBeaming into the news: a system for and case study of tele-immersive journalism
AuthorsKishore, S., Navarro, X., Dominguez, E., De La Peña, N. and Slater, M.
Abstract

We show how a combination of virtual reality and robotics can be used to beam a physical representation of a person to a distant location, and describe an application of this system in the context of journalism. Full body motion capture data of a person is streamed and mapped in real time, onto the limbs of a humanoid robot present at the remote location. A pair of cameras in the robots eyes stream stereoscopic video back to the HMD worn by the visitor, and a two-way audio connection allows the visitor to talk to people in the remote destination. By fusing the multisensory data of the visitor with the robot, the visitors consciousness is transformed to the robots body. This system was used by a journalist to interview a neuroscientist and a chef 900 miles distant, about food for the brain, resulting in an article published in the popular press.

Sustainable Development Goals9 Industry, innovation and infrastructure
Middlesex University ThemeCreativity, Culture & Enterprise
PublisherIEEE
JournalIEEE Computer Graphics and Applications
ISSN0272-1716
Electronic1558-1756
Publication dates
Online12 Apr 2018
PrintMar 2018
Publication process dates
AcceptedMay 2016
Deposited30 Oct 2023
Output statusPublished
Digital Object Identifier (DOI)https://doi.org/10.1109/mcg.2017.2801407
PubMed Central ID29672258
Scopus EID2-s2.0-85045555347
LanguageEnglish
Permalink -

https://repository.mdx.ac.uk/item/w39y9

Log in to edit
  • 38
    total views
  • 0
    total downloads
  • 3
    views this month
  • 0
    downloads this month

Export as

Related outputs

Evaluating student evaluations: evidence of gender bias against women in higher education based on perceived learning and instructor personality
Khokhlova, O., Lamba, N. and Kishore, S. 2023. Evaluating student evaluations: evidence of gender bias against women in higher education based on perceived learning and instructor personality. Frontiers in Education. 8. https://doi.org/10.3389/feduc.2023.1158132
Who is more ‘human-like’? Exploring gender and race in perception of avatars in an online classroom
Lamba, N., Kishore, S. and Khokhlova, O. 2023. Who is more ‘human-like’? Exploring gender and race in perception of avatars in an online classroom. 11th European Conference on Education (ECE2023). London, UK, and Online 13 - 17 Jul 2023
Developing an object detection and gripping mechanism algorithm using machine learning
Mohammad, H., Kishore, S. and Prasetyo, J. 2023. Developing an object detection and gripping mechanism algorithm using machine learning. Journal of Applied Science and Advanced Engineering. 1 (2), pp. 47-54. https://doi.org/10.59097/jasae.v1i2.15
Interactive multimodal learning: towards using pedagogical agents for inclusive education
Al Omoush, M., Salih, S., Kishore, S. and Mehigan, T. 2023. Interactive multimodal learning: towards using pedagogical agents for inclusive education. IEEE International Humanitarian Technologies Conference. Cartagena de Indias, Colombia 01 - 03 Nov 2023
PhD Work with Robothespian on display at Centre of Contemporary Culture Barcelona
Kishore, S. 2022. PhD Work with Robothespian on display at Centre of Contemporary Culture Barcelona. Centre of Contemporary Culture Barcelona (CCCB) 27 Jul - 11 Dec 2022
Using virtual avatars to explore the impact of instructors' gender, race, and qualification on perceived learning in an online classroom
Lamba, N., Kishore, S. and Khokhlova, O. 2022. Using virtual avatars to explore the impact of instructors' gender, race, and qualification on perceived learning in an online classroom. The 10th European Conference on Education. London, UK 14 - 17 Jul 2022
When your robot avatar misbehaves you are likely to apologize: an exploration of guilt during robot embodiment
Aymerich-Franch, L., Kishore, S. and Slater, M. 2020. When your robot avatar misbehaves you are likely to apologize: an exploration of guilt during robot embodiment. International Journal of Social Robotics. 12 (1), pp. 217-226. https://doi.org/10.1007/s12369-019-00556-5
A virtual reality embodiment technique to enhance helping behavior of police toward a victim of police racial aggression
Kishore, S., Spanlang, B., Iruretagoyena, G., Halan, S., Szostak, D. and Slater, M. 2019. A virtual reality embodiment technique to enhance helping behavior of police toward a victim of police racial aggression. PRESENCE: Virtual and Augmented Reality. 28, pp. 5-27. https://doi.org/10.1162/pres_a_00339
Virtually being Einstein results in an improvement in cognitive task performance and a decrease in age bias
Banakou, D., Kishore, S. and Slater, M. 2018. Virtually being Einstein results in an improvement in cognitive task performance and a decrease in age bias. Frontiers in Psychology. 9. https://doi.org/10.3389/fpsyg.2018.00917
Examining sense of responsibility in an experience of robot avatar embodiment
Aymerich-Franch, L., Kishore, S. and Slater, M. 2018. Examining sense of responsibility in an experience of robot avatar embodiment. 68th Annual Conference of the International Communication Association (ICA). Prague, Czech Republic 24 - 28 May 2018
Automated psychological therapy using immersive virtual reality for treatment of fear of heights: A single-blind, parallel-group, randomised controlled trial
Freeman, D., Haselton, P., Freeman, J., Spanlang, B., Kishore, S., Albery, E., Denne, M., Brown, P., Slater, M. and Nickless, A. 2018. Automated psychological therapy using immersive virtual reality for treatment of fear of heights: A single-blind, parallel-group, randomised controlled trial. The Lancet Psychiatry. 5 (8), pp. 625-632. https://doi.org/10.1016/S2215-0366(18)30226-8
Multi-destination beaming: apparently being in three places at once through robotic and virtual embodiment
Kishore, S., Muncunill, X.N., Bourdin, P., Or-Berkers, K., Friedman, D. and Slater, M. 2016. Multi-destination beaming: apparently being in three places at once through robotic and virtual embodiment. Frontiers in Robotics and AI. 3. https://doi.org/10.3389/frobt.2016.00065
Comparison of SSVEP BCI and eye tracking for controlling a humanoid robot in a social environment
Kishore, S., González-Franco, M., Hintemüller, C., Kapeller, C., Guger, C., Slater, M. and Blom, K.J. 2014. Comparison of SSVEP BCI and eye tracking for controlling a humanoid robot in a social environment. PRESENCE: Virtual and Augmented Reality. 23 (3), p. 242–252. https://doi.org/10.1162/pres_a_00192
Real time whole body motion mapping for avatars and robots
Spanlang, B., Navarro, X., Normand, J.-M., Kishore, S., Pizarro, R. and Slater, M. 2013. Real time whole body motion mapping for avatars and robots. 19th ACM Symposium on Virtual Reality Software and Technology. Singapore 06 - 09 Oct 2013 Association for Computing Machinery (ACM). https://doi.org/10.1145/2503713.2503747