15862 – Computational Photography

 

  Assignment  5: Tour Into the Picture: Single View Modelling

- Nisarg Vyas (nisarg AT cmu DOT edu)

 

 

 

 

             The goal of the project is to estimate simple 3D geometry model from a single image based on some cues input by the end-user, and using that 3D model to generate novel views of the image. This uses the TIP (Tour Into the Picture) interface first, which allows users to input back plane and the vanishing point in the scene.

 

  Results:

  1)

 

                       

                      Original Image                                                                  Output of the TIP Interface

 

 

                 

 

                                                           Sample novel views generated from the original

 

These are just 2 sample views from many possible views. To generate even more views, you can use SJerome_model.fig , which is a Matlab figure file consisting of the estimated 3D model of the taken photograph. One can upload that in Matlab, and using the camera toolbar and 3D rotation properties, one can then generate interesting novel views.

 

2)

 

 

                                                      

   Original Image – Another World (From MS Escher) – A classic picture demonstrating illusion in perceiving planes from 3D geometry

 

 

     

 

                                                                     Sample Novel views

 

 

In the second novel view, we can easily see, that the ‘same’ pillar on the upper right corner of the image is shared between the back plane and the side plane, and hence creating geometric illusion in perception for humans.

 

The geometry model can be downloaded  from here:  AnotherWorld_model.fig

 

3)

 

                                   

 

            

                                                                                Original Image

 

 

 

   

 

                                                                           Sample Novel Views

 

The geometry model can be downloaded  from here:  View2_model.fig