AASCIT - Journal - All Issues

ISSN Print: 2381-1110 ISSN Online: 2381-1129

American Journal of Computer Science and Information Engineering

The Journal

Manuscript Information

Performance Review of the Stereo Matching Algorithms

American Journal of Computer Science and Information Engineering
Vol.4 , No. 1, Publication Date: Jun. 13, 2017, Page: 7-15

710 Views Since June 13, 2017, 324 Downloads Since Jun. 13, 2017

Paper in PDF (965K)

Follow on

Authors

[1]	Md. Abdul Mannan Mondal, Department of Computer Science and Engineering, University of Dhaka, Dhaka, Bangladesh.
[2]	Md. Haider Ali, Department of Computer Science and Engineering, University of Dhaka, Dhaka, Bangladesh.

Abstract

Stereo correspondence or disparity is a common tool in computer or robotic vision, essential for determining three-dimensional depth information of object using a pair of left and right images from a stereo camera system. Some applications of disparity are autonomous vehicle and robot navigation, virtual reality and stereo image analysis. Stereo correspondence or disparity is determined of matching windows of pixels by using Sum of Square Differences (SSD), Sum of Absolute Differences (SAD), or normalized correlation techniques. As a result to identify the problem of matching pixels between two images of a stereo pair several algorithms have been invented in the respective arena. In this paper comparative performance analysis of existing stereo matching algorithms are explored detailed up to date. The methods that are considered in the paper are classified into two categories. First one is named as local method while the second one is global method. The algorithms taken consideration in literature are analyzed by speed, accuracy and disparity range. Experimental results applied on different image sizes and different image sets (Tsukuba Stereo pair, Sawtooth stereo pair, Map Stereo pair and Venus Stereo pair) are also presented. Some neural network and automata based latest algorithms are discussed. Besides these some algorithms are not fallen into above mentioned categories are also discussed in details.

Keywords

Stereo Correspondence, Disparity, Sum of Absolute Difference, Sum of Square Difference, Normalize Correlation, Dense Disparity, Stereo Vision

Reference

[01]	S. T. Barnard and M. A. Fischler, “Stereo vision,” in Encyclopedia of Artificial Intelligence, (John Wiley, New York, 1987), pp. 1083-1090.
[02]	W. Hoff and N. Ahuja, “Surfaces from stereo: Integrating feature matching, disparity estimation and contour detection,” IEEE Trans. Pattern Anal. Machine Intell., vol. 11, no. 2, pp. 121-136, (1989).
[03]	T. Kanade and M. Okutomi, “A stereo matching algorithm with an adaptive window: Theory and experiment,” IEEE Trans. Pattern Anal. Machine Intell., vol. 16, no. 9, (1994).
[04]	Olga Veksler, “Stereo matching by compact windows via minimum ratio cycle,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV 2001), pp. 540-547.
[05]	Mohammad Shorif Uddin, Tadayoshi Shioyama, Mozammel Hoque Chowdhury, Md. Abdul Mannan Mondal, “Fast Window Based Approach For Stereo Matching”, Journal of Science, Jahangirnagar University, vol. 27, pp: 145-154, June 2004.
[06]	S. S. Intille and A. F. Bobick, “Disparity-space images and large occlusion stereo,” in Proceedings of the European Conference on Computer Vision (ECCV 1994), pp. 179-186.
[07]	A. Fusiello and V. Roberto, “Efficient stereo with multiple windowing,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (ICVPR 1997), pp. 858-863.
[08]	K. Muhlmann, D. Maier, J. Hesser, R. Manner, “Calculating dense disparity maps from color stereo images, an efficient implementation,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (ICVPR 2001), pp. 30-36.
[09]	Mohammad Shorif Uddin, “Stereo correspondence estimation using window- based methods by a fast algorithm” journal of electronics and computer science, vol. 4, June 2003, pp. 5-11.
[10]	Md. Abdul Mannan Mondal, Md. Al-Amin Bhuiyan “Disparity Estimation By A Two-Stage Approximation Real Time Algorithm” The International Management and Technology Conference (IMT), pp: 12-17, 8 - 10 December 2004, Orlando, Florida 32819, USA.
[11]	D. Schartein, R. Szeliski, “A taxonomy and evaluation of dense two frame stereo correspondence algorithms”, IJCV 7, 1/3, 2002.
[12]	Lugi Di Stefano, Massimiliano Marchionni, Stefano Mattoccia, “A fast Area Based Stereo Matching Algorithm”, Image and vision Computing 22, pp. 983-1005, 2004.
[13]	Elisabetta Binaghi, Ignazio Gallo, Giuseppe Marino, Mario Raspanti, “Neural adaptive stereo matching”, Pattern Recognition Letters 25, pp. 1743-1758, 2004.
[14]	Abijit S. Ogale and Yiannis Aloimonos, “Shape and the Stereo Correspondence Problem”, IJCV 65, 3, pp. 147-167, 2005.
[15]	Sukjune Yoon, Sung-Kee Park, Sungehul Kang, Yoon Keun Kwak, “Fast correlation –based stereo matching with the reduction of systematic errors”, Pattern Recognition Letters 26, pp. 2221-2231, 2005.
[16]	L. Kotoulas, A. Gasteratos, G. Ch. Sirakoulis, C. Georoulas, and I. Andreadis, “Enhancement of Fast Acquired Disparity Maps using a 1-D Cellular Automation Filter”, proceedings of the fifth IASTED International Conference on Visualization, Imaging and Image Processing, Benidorn, Spain, September 7-9, 2005.
[17]	Kuk-Jin Yoon and In So Kweon, “Adaptive Support –Weight Approach for Correspondence Search”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 4, April 2006.
[18]	P. H. S. Torra, A. Criminisi, “Dense stereo using pivoted dynamic programming”, Image and Vision Computing 22, pp. 795-806, 2004.
[19]	Salvador Gutierrez, Jose Luis Marroquin, “Robust approach for disparity estimation in stereo vision”, Image and Vision Computing 22, pp. 183-195, 2004.
[20]	Michael Bleyer, Margrit Gelautz, “A layered stereo matching algorithm using image segmentation and global visibility constraints”, ISPRS Journal of Photogrammetry and Remote Sensing 59, pp. 128-150, 2005.
[21]	Hansung Kim, Kwanghoon Sohn, “3D reconstruction from stereo images for interactions between real and virtual objects”, Signal Processing: Image Communication 20, pp. 61-75, 2005.
[22]	Abijit S. Ogale and Yiannis Aloimonos, “Robust Contrast Invariant Stereo Correspondence”, Proceedings of the 2005 IEEE International on Robotics and Automation, Barcelona, Spain, April 2005.
[23]	Qingxiong Yang, Liang Wang, Ruigang Yang, Shengnan Wang, Miao Liao, David Nister, “ Real – time Global Stereo Matching Using Hierarchical Belief Propagation”, The British Machine Vision Conference (BMVC), 2006.
[24]	Xiaodong Huang, Eric Dubois, “Dense Disparity Estimation based on the continuous wavelet transformation”, CCECE 2004- CCGEI 2004, Niagara Falls, May 2004.
[25]	C. Liu, W. Pei, S. Niyokindi, J. C. Song and L. D Wang, “Micro stereo matching based on wavelet transform and projective invariance”. Meas Sci. Technol. 17, pp. 565 -571, 2006.
[26]	Olga Veksler, “Dense Features for Semi-Dense Stereo Correspondence”, IJCV 47, pp. 247-260, 2002.
[27]	Lazaros Nalpantidis, Georgios Ch. Sirakoulis and Antonios Gasteratos, “Rieview of stereo matching algorithms for 3D vision”, 16^th International Symposium on Measurement and Control in Robotics ISMCR, pp. 116-124, 2007.
[28]	D. Scharstein, H. Hirschmüller, Y. Kitajima, G. Krathwohl, N. Nesic, X. Wang, and P. Westling. “High-resolution stereo datasets with subpixel-accurate ground truth”. In German Conference on Pattern Recognition (GCPR 2014), pp: 1-12, Münster, Germany, September 2014.
[29]	Md. Abdul Mannan Mondal, Md. Haider Ali “On Stereo Correspondence Estimation: A Spiral Search Algorithm” Proceeding of International Conference on Signal and Information Processing (ICSIP), pp: 204-207, 14-15 December 2010, Changsha, China.