Enabling Real-Time Shared Environments on Mobile Head-Mounted Displays

head-mounted displays;mobile computing;panoramas;video calls;computer vision;real-time

Cook, Matthew Guy ; Langlotz, Tobias ; Regenbrecht, Holger ; Mills, Steven

University of Otago

关键词: head-mounted displays;    mobile computing;    panoramas;    video calls;    computer vision;    real-time;   

Others  :  https://ourarchive.otago.ac.nz/bitstream/10523/7428/1/CookMatthewG2017MSc.pdf

美国|英语

来源: Otago University Research Archive

【 摘 要 】

Head-Mounted Displays (HMDs) are becoming more prevalent consumer devices, allowing users to experience scenes and environments from a point of view naturally controlled by their movement. However there is limited application of this experiential paradigm to telecommunications -- that is, where a HMD user can ;;call;; a mobile phone user and begin to look around in their environment. In this thesis we present a telepresence system for connecting mobile phone users with people wearing HMDs, allowing the HMD user to experience the environment of the mobile user in real-time. We developed an Android application that supports generating and transmitting high quality spherical panorama based environments in real-time, and a companion application for HMDs to view those environments live. This thesis focusses on the technical challenges involved with creating panoramic environments of sufficient quality to be suitable for viewing inside a HMD, given the constraints that arise from using mobile phones. We present computer vision techniques optimised for these constrained conditions, justifying the trade-offs made between speed and quality. We conclude by comparing our solution to conceptually similar past research along the metrics of computation speed and output quality.