Clausius Normalized Field-Based Stereo Matching for Uncalibrated Image Sequences

ETRI Journal

关键词: HCI;    uncalibrated stereo matching time-varying imagery;    Computer vision;   

Others  :  1185897
DOI  :  10.4218/etrij.10.1510.0067

【 摘 要 】

We propose a homology between thermodynamic systems and images for the treatment of time-varying imagery. A physical system colder than its surroundings absorbs heat from the surroundings. Furthermore, the absorbed heat increases the entropy of the system, which is closely related to its disorder as given by the definition of Clausius and Boltzmann. Because pixels of an image are viewed as a state of lattice-like molecules in a thermodynamic system, the task of reckoning the entropy variations of pixels is similar to estimating their degrees of disorder. We apply this homology to the uncalibrated stereo matching problem. The absence of calibrations alleviates user efforts to install stereo cameras and enables users to freely modify the composition of the cameras. The proposed method is also robust to differences in brightness, white balancing, and even focusing between stereo image pairs. These peculiarities enable users to estimate the depths of interesting objects in practical applications without much effort in order to set and maintain a stereo vision setup. Users can consequently utilize two webcams as a stereo camera.

   

【 图 表 】

Figure 9

【 参考文献 】

• [1]S.J. Krotosky and M.M. Trivedi, "Person Surveillance Using Visual and Infrared Imagery," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 8, Aug. 2008, pp. 1096-1105.
• [2]R. Anchini et al., "A Comparison Between Stereo-Vision Techniques for the Reconstruction of 3-D Coordinates of Objects," IEEE Trans. Instrum. Meas., vol. 55, no. 5, Oct. 2006, pp. 1459-1466.
• [3]Y. Matsumoto and A. Zelinsky, "An Algorithm for Real-Time Stereo Vision Implementation of Head Pose and Gaze Direction Measurement," Autom. Face Gesture Recognition, 2000. pp. 499-504.
• [4]J.I. Park et al., "Virtual Control of Optical Axis of the 3DTV Camera for Reducing Visual Fatigue in Stereoscopic 3DTV," ETRI J., vol. 26, no. 6, Dec. 2004, pp. 597-604.
• [5]A. Smolic and P. Kauff, "Interactive 3-D Video Representation and Coding Technologies," IEEE Proc., vol. 93, no. 1, 2005, pp. 98-110.
• [6]C.D. Castillo and D.W. Jacobs, "Using Stereo Matching with General Epipolar Geometry for 2D Face Recognition across Pose," IEEE Trans. PAMI, vol. 31, no. 12, Dec. 2009, pp. 2298-2304.
• [7]Y.V. Venkatesh, S.K. Raja, and A.J. Kumar, "On the Application of a Modified Self-Organizing Neural Network to Estimate Stereo Disparity," IEEE Trans. Image Process., vol. 16, no. 11, 2007, pp. 2822-2829.
• [8]L.H. Liu and P. Bhattacharya, "Uncalibrated Stereo Matching Using DWT," ICPR, 2000, pp. 114-118.
• [9]J. Zhow, Y. Xu, and X. Yang, "Quaternion Wavelet Phase based Stereo Matching for Uncalibrated Images," Patt. Recog. Lett., vol. 28, no. 12, Mar. 2007, pp. 1509-1522.
• [10]W. Li, C.H. Leung, and Y.S. Hung, "Matching of Uncalibrated Stereo Images by Elastic Deformation," Int. J. Imaging Syst. Technol., vol. 14, no. 5, Mar. 2005, pp. 198-205.
• [11]S.D. Cochran and G. Medioni, "3-D Surface Description from Binocular Stereo," IEEE Trans. PAMI, vol. 14, no. 10, 1992, pp. 981-994.
• [12]P. Premaratne and F. Safaei, "Feature Based Stereo Correspondence Using Moment Invariant," Proc. IEEE Int. Conf. Inf. Automation for Sustainability, 2008, pp.104-108.
• [13]D. Scharstein and C. Pal, "Learning Conditional Random Fields for Stereo," CVPR, 2007, pp. 1-8.
• [14]R. Gherardi et al., "Optimal Parameter Estimation for MRF Stereo Matching," ICIAP, LNCS 3617, 2005, pp. 818-825.
• [15]L. Zhang and S.M. Seitz, "Parameter Estimation for MRF Stereo," CVPR, vol. 2, 2005, pp. 288-295.
• [16]J. Sun, H.Y. Shum, and N.N. Zheng, "Stereo Matching Using Belief Propagation," ECCV, LNCS 2351, 2002, pp. 510-524.
• [17]S. Geman and D. Geman, "Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images," IEEE Trans. PAMI, vol. 6, no. 6, 1984, pp. 721-741.
• [18]J. Lafferty, A. McCallum, and F. Pereira, "Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data," ICML, 2001, pp. 282-289.
• [19]S Kirkpatrick, C.D. Gelatt, Jr., M.P. Vecchi, "Optimization by Simulated Annealing," Science, vol. 220, no. 4598, 1983, pp. 671-680.
• [20]S. Della Pietra, V. Della Pietra, and J. Lafferty, "Inducing Features of Random Fields," IEEE Trans. PAMI, vol. 19, no. 4, 1997, pp. 380-393.
• [21]L. Boltzmann, Lectures on Gas Theory, trans. S.G. Brush, New York: Perfamon Press, 1995. Available: http://openlibrary.org /books/OL1115209M/Lectures_on_gas_theory
• [22]J. Daintith, Oxford Dictionary of Physics, Oxford University Press, 2005.
• [23]P. Pierre, A to Z of Thermodynamics, Oxford University Press, 1998.
• [24]J. Bouguet, "Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm." Available: http://robots.stanford.edu/cs223b04/algo_tracking.pdf.
• [25]J. Migdal and W.E.L. Grimson, "Background Subtraction using Markov Thresholds," WACV/MOTION, 2005, pp. 58-65.
• [26]Alan C. Bovik, Handbook of Image and Video Processing, Academic Press, 2000.
• [27]H. Chang, Inventing Temperature: Measurement and Scientific Progress, Oxford University Press, 2004.
• [28]Herbert B. Callen, Thermodynamics and an Introduction to Thermostatistics, 2nd ed., New York: John Wiley & Sons, ISBN 0-471-86256-8, 1985.
• [29]C. Tomasi and T. Kanade, "Detection and Tracking of Point Features," Technical Report CMU-CS-91-132, 1991.
• [30]Middlebury Stereo Vision Page. Available: http://vision. middlebury.edu/stereo
• [31]Barrel Distortion. Available: http://ptgrey.com/products/stereo.asp
• [32]Bumblebee2 Camera. Available: http://en.wikipedia.org/wiki/ Distortion_(optics)