Augmenting complex surfaces with projector-camera systems

spatial augmented reality;projection mapping;projector;camera;projector-camera;interactive surface particles

Jones, Brett R. ; Campbell ; Roy H.

关键词: spatial augmented reality;    projection mapping;    projector;    camera;    projector-camera;    interactive surface particles;   

Others  :  https://www.ideals.illinois.edu/bitstream/handle/2142/18407/Jones_Brett.pdf?sequence=1&isAllowed=y

美国|英语

来源: The Illinois Digital Environment for Access to Learning and Scholarship

【 摘 要 】

Display and interaction real-estate is fundamentally limited by the size of the screen in traditional display devices. Projection-based interfaces allow interaction with appropriated, everyday, passive surfaces. Instead of restricting interaction to a single rectangle, projection-based augmented reality makes interaction ubiquitous, taking the computer out of the box. Extending interaction to almost any surface enables new possibilities in a host of new domains, including entertainment, consumer electronics, advertising, medicine and many more.Overlaying virtual elements onto complex physical surfaces under real-world conditions, presents a variety of challenges, many which are open research problems. A wealth of previous work has focused on projection onto constrained surfaces like planes, parabolic curves, etc. In this research, we explore projection onto arbitrarily complex physical surfaces. We describe a complete, practical approach embodied in a projector-camera system. Our system is constructed of low-cost, commodity hardware and demonstrates some of the exciting applications of Spatial Augmented Reality. We present a novel initial homography estimation for interactive projector-camera calibration. We introduce a unique hybrid projector pattern codification technique for improved correspondences. Finally, we present interactive surface particles, which are a surface independent content representation that enables reusable interaction with complex physical surfaces.This thesis outlines the fundamental preliminaries of projector-camera systems, the current state of the art, along with our design decisions, implementation details and results. Covered topics include camera calibration, structured light 3D scanning and surface augmentation. This work demonstrates the technical and practical feasibility of appropriating complex surfaces as information displays; hopefully encouraging a future where a display device is no longer a discrete entity, but where our environment is our display and interface.