Real-time construction and visualisation of drift-free video mosaics from unconstrained camera motion

The Journal of Engineering

Toby P. Breckon¹  Mateusz Brzeszcz² 

[1]School of Engineering and Computing Sciences, Durham University, Durham, UK

[2]School of Engineering, Cranfield University, Cranfield, UK

关键词: in-scene motion;    modern camera hardware;    dynamic mosaic representation;    video sequence;    colour variance;    automatic gain control;    illumination variation;    subsequent optimisation;    video mosaicing;    drift free mosaic construction;    redundancy management;    bundle adjustment;    spatial overlap;    temporally dense input video frame;    video mosaic construction;    mosaic image reconstruction;    camera focal distance;    visualisation;    overlapping textured graphics primitive;    indoor environments;    image frame management;    integrated frame blending;    in-sequence loop closing;    outdoor environments;    online interframe blending;    unconstrained camera motion;   

DOI  :  10.1049/joe.2015.0016

学科分类：工程和技术（综合）

来源: IET

【 摘 要 】

This work proposes a novel approach for real-time video mosaicking facilitating drift-free mosaic construction and visualisation, with integrated frame blending and redundancy management, that is shown to be flexible to a range of varying mosaic scenarios. The approach supports unconstrained camera motion with in-sequence loop closing, variation in camera focal distance (zoom) and recovery from video sequence breaks. Real-time performance, over extended duration sequences, is realised via novel aspects of frame management within the mosaic representation and thus avoiding the high data redundancy associated with temporally dense, spatially overlapping video frame inputs. This managed set of image frames is visualised in real time using a dynamic mosaic representation of overlapping textured graphics primitives in place of the traditional globally constructed, and hence frequently reconstructed, mosaic image. Within this formulation, subsequent optimisation occurring during online construction can thus efficiency adjust relative frame positions via simple primitive position transforms. Effective visualisation is similarly facilitated by online inter-frame blending to overcome the illumination and colour variance associated with modern camera hardware. The evaluation illustrates overall robustness in video mosaic construction under a diverse range of conditions including indoor and outdoor environments, varying illumination and presence of in-scene motion on varying computational platforms.

【 授权许可】

CC BY