Center For Visualization & Virtual Environments
Research Project:
Real-time Stereo 3D Reconstruction
Investigators:
Ruigang Yang
Collaborators:
Greg Welch (University of North Carolina),
Marc Pollefeys (University of North Carolina)
Sponsors:
UK Office of Research, National Science Foundation
Papers:
Yang, Ruigang, and Marc Pollefeys. "Multi-Resolution Real-Time Stereo on Commodity Graphics Hardware," IEEE Computer Vision and Pattern Recognition (CVPR 2003), Madison, WI, USA (June 16-22, 2003).
Yang, Ruigang, Greg Welch, Gary Bishop (2002). "Real-Time Consensus-Based Scene Reconstruction using Commodity Graphics Hardware," Proceedings of Pacific Graphics 2002. Tsinghua University, Beijing, China (October 9-11, 2002).
We present a new method for using commodity graphics hardware to achieve real-time, on-line, 2D view synthesis or 3D depth estimation from two or more calibrated cameras. Our method combines a 3D plane-sweeping approach with 2D multi-resolution color consistency tests. We project camera imagery onto each plane, compute measures of color consistency throughout the plane at multiple resolutions, and then choose the color or depth (corresponding plane) that is most consistent. The key to achieving real-time performance is our use of the advanced features included with recent commodity computer graphics hardware to implement the computations simultaneously (in parallel) across all reference image pixels on a plane.