Multi-spectral stereo image matching using mutual information

C. Fookes, A. Maeder, S. Sridharan, J. Cook

Research output: Chapter in Book/Report/Conference proceedingConference contribution

28 Citations (Scopus)

Abstract

Mutual information (MI) has shown promise as an effective stereo matching measure for images affected by radiometric distortion. This is due to the robustness of MI against changes in illumination. However, MI-based approaches are particularly prone to the generation of false matches due to the small statistical power of the matching windows. Consequently, most previous MI approaches utilise large matching windows which smooth the estimated disparity field. This paper proposes extensions to MI-based stereo matching in order to increase the robustness of the algorithm. Firstly, prior probabilities are incorporated into the MI measure in order to considerably increase the statistical power of the matching windows. These prior probabilities, which are calculated from the global joint histogram between the stereo pair, are tuned to a two level hierarchical approach. A 2D match surface, in which the match score is computed for every possible combination of template and matching window, is also utilised. This enforces left-right consistency and uniqueness constraints. These additions to MI-based stereo matching significantly enhance the algorithm's ability to detect correct matches while decreasing computation time and improving the accuracy. Results show that the MI measure does not perform quite as well for standard stereo pairs when compared to traditional areabased metrics. However, the MI approach is far superior when matching across multi-spectra stereo pairs.

Original languageEnglish
Title of host publicationProceedings - 2nd International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2004
EditorsY. Aloimonos, G. Taubin
Pages961-968
Number of pages8
DOIs
Publication statusPublished - 1 Dec 2004
Externally publishedYes
EventProceedings - 2nd International Symposium on 3D Data Processing, Visualization, and Transmission. 3DPVT 2004 - Thessaloniki, Greece
Duration: 6 Sep 20049 Sep 2004

Publication series

NameProceedings - 2nd International Symposium on 3D Data Processing, Visualization, and Transmission. 3DPVT 2004

Conference

ConferenceProceedings - 2nd International Symposium on 3D Data Processing, Visualization, and Transmission. 3DPVT 2004
CountryGreece
CityThessaloniki
Period6/09/049/09/04

Fingerprint Dive into the research topics of 'Multi-spectral stereo image matching using mutual information'. Together they form a unique fingerprint.

  • Cite this

    Fookes, C., Maeder, A., Sridharan, S., & Cook, J. (2004). Multi-spectral stereo image matching using mutual information. In Y. Aloimonos, & G. Taubin (Eds.), Proceedings - 2nd International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2004 (pp. 961-968). (Proceedings - 2nd International Symposium on 3D Data Processing, Visualization, and Transmission. 3DPVT 2004). https://doi.org/10.1109/TDPVT.2004.1335420