ROBOMECH Journal | |
Projection-mapping-based object pointing using a high-frame-rate camera-projector system | |
Sushil Raut1  Kohei Shimasaki1  Taku Senoo2  Idaku Ishii2  Deepak Kumar3  | |
[1] Digital Monozukuri (Manufacturing) Education Research Center, Hiroshima University, Higashi-Hiroshima, Japan;Graduate School of Advanced Science and Engineering, Hiroshima University, Higashi-Hiroshima, Japan;Graduate School of Engineering, Hiroshima University, Higashi-Hiroshima, Japan; | |
关键词: Physical security; Cyber-physical systems; High-speed camera-projector; Informative projection mapping; Real-time pattern recognition; visible light communication; | |
DOI : 10.1186/s40648-021-00197-2 | |
来源: Springer | |
【 摘 要 】
The novel approach to physical security based on visible light communication (VLC) using an informative object-pointing and simultaneous recognition by high-framerate (HFR) vision systems is presented in this study. In the proposed approach, a convolutional neural network (CNN) based object detection method is used to detect the environmental objects that assist a spatiotemporal-modulated-pattern (SMP) based imperceptible projection mapping for pointing the desired objects. The distantly located HFR vision systems that operate at hundreds of frames per second (fps) can recognize and localize the pointed objects in real-time. The prototype of an artificial intelligence-enabled camera-projector (AiCP) system is used as a transmitter that detects the multiple objects in real-time at 30 fps and simultaneously projects the detection results by means of the encoded-480-Hz-SMP masks on to the objects. The multiple 480-fps HFR vision systems as receivers can recognize the pointed objects by decoding pixel-brightness variations in HFR sequences without any camera calibration or complex recognition methods. Several experiments were conducted to demonstrate our proposed method’s usefulness using miniature and real-world objects under various conditions.
【 授权许可】
CC BY
【 预 览 】
Files | Size | Format | View |
---|---|---|---|
RO202107017431954ZK.pdf | 3620KB | download |