Multiview Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency

George Vogiatzis, Carlos Hernández Esteban, Philip H. S. Torr and Roberto Cipolla

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2007

Abstract

This paper presents a volumetric formulation for the multi-view stereo problem which is amenable to a computationally tractable global optimisation using Graph-cuts. Our approach is to seek the optimal partitioning of 3D space into two regions labelled as "object" and "empty" under a cost functional consisting of the following two terms: (1) A term that forces the boundary between the two regions to pass through photo-consistent locations and (2) a ballooning term that inflates the "object" region. To take account of the effect of occlusion on the first term we use an occlusion robust photo-consistency metric based on Normalised Cross Correlation, which does not assume any geometric knowledge about the reconstructed object. The globally optimal 3D partitioning can be obtained as the minimum cut solution of a weighted graph.

Citation

George Vogiatzis, Carlos Hernández Esteban, Philip H. S. Torr and Roberto Cipolla. “Multiview Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency.” IEEE Transactions on Pattern Analysis and Machine Intelligence, 29 (12), pp. 2241–2246. 2007.

BibTeX
@article{vogiatzis2007,
  title     = {Multiview Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency},
  author    = {George Vogiatzis and Carlos Hernández Esteban and Philip H. S. Torr and Roberto Cipolla},
  journal   = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  volume    = {29},
  pages     = {2241--2246},
  year      = {2007},
  doi       = {10.1109/tpami.2007.70712},
}

Related projects