access icon free Stereo matching using cost volume fusion for high dynamic range scenes

A method is proposed to obtain accurate disparity maps for high dynamic range (HDR) scenes using stereo image pairs acquired under different exposure times and viewpoints. In HDR scenes, saturated pixels such as too-dark or too-bright pixels are inevitable because of the limited bit-depth representations of images. These saturated regions include little information for matching images and harm the performance of conventional stereo matching methods. To address this problem, a method is proposed that generates a new cost volume by fusing cost volumes obtained using different stereo image pairs taken under different exposure times as well as different points of view. In addition, the directional semi-global matching method is proposed to efficiently optimise the cost volume. Experimental results show that the proposed method generates more accurate results for saturated regions than existing methods on various datasets.

Inspec keywords: image representation; image resolution; optimisation; image fusion; stereo image processing; image matching

Other keywords: too-dark pixels; limited bit-depth image representation; HDR scenes; cost volume optimisation; stereo image pairs; stereo matching; too-bright pixels; exposure times; saturated regions; saturated pixels; cost volume fusion; disparity maps; high dynamic range scenes; directional semiglobal matching method

Subjects: Sensor fusion; Image recognition; Optimisation techniques; Computer vision and image processing techniques; Optimisation techniques

References

    1. 1)
      • 4. Rhemann, C., Hosni, A., Bleyer, M., et al: ‘Fast cost-volume filtering for visual correspondence and beyond’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011, pp. 30173024.
    2. 2)
      • 6. http://vision.middlebury.edu/stereo/data/, 2017.
    3. 3)
      • 5. Hu, X., Mordohai, P.: ‘Evaluation of stereo confidence indoors and outdoors’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
    4. 4)
    5. 5)
    6. 6)
      • 1. Hirschmuller, H., Scharstein, D.: ‘Evaluation of stereo matching costs on images with radiometric differences’, Trans. Pattern Anal. Mach. Intell., 2002, 29, (9), pp. 15201537.
    7. 7)
http://iet.metastore.ingenta.com/content/journals/10.1049/el.2017.1767
Loading

Related content

content/journals/10.1049/el.2017.1767
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading