3D Physically-based 2D View Synthesis

Under Construction

This work is related to the Electronic Book project, which proposed a new paradigm for surgical training that allows surgeons to witness and explore (in time and space) a past surgical procedure as if they were there, with the added benefit of instruction from the original surgeon or another instructor, as well as integrated 3D illustrations, annotations, and relevant medical metadata.

Here we present some early results for the reconstruction of a teaching model. The top row shows three of the eight input images,  note these specular highlights and textureless regions that we cannot assume away with. The reconstructed point cloud using our approach is shown in the second row.