15-869, Image-Based Modeling and Rendering
THIS COURSE WILL NOT BE TAUGHT FALL 2001
due to Paul Heckbert's leave of absence
and Jianbo Shi's other commitments.
We apologize for the change of plans.
We do not know when the course will next be taught.
9 Aug 2001
Professors: Steve Seitz and Paul Heckbert
Time: MW 10:30 - 11:50, Sept. 8 - Dec. 1, 1999
Place: Wean 5409B
Wed. Dec. 1.
- Wed. Sept. 8.
- what are image-based techniques?
- administrative matters, questionnaires
- preview of image mosaicing
- Assign presenter for Szeliski paper
- Mon. Sept. 13.
- image mosaics
- applications: remote sensing of earth and planets, panoramas, superresolution, video
- projective mosaics: planar scenes and panoramas
- summarize image mosaicing assignment.
- image compositing (feathering / weighted averaging)
- image warping
- transformations: rigid body, affine, projective, other
- brief review of homogeneous coordinates
- algorithms for image warping: forward, backward, two-pass
- resampling, bilinear interpolation
- Wed. Sept. 15.
- Reading for today: Image
Mosaicing for Tele-Reality Applications, Richard Szeliski, Digital CRL 94/2, 1994.
You can skim sections 6 and 7. Chris Rodriguez will present the paper.
- nonlinear optimization, Levenberg-Marquardt
- image registration for mosaicing
- manual methods
- automatic methods: sum of squared differences, mutual information
- Mon. Sept. 20.
Image Mosaicing assignment due Sun. Sept. 19 at midnight.
- image registration (part 2)
- image morphing: Beier-Neely and other methods
- Wed. Sept. 22.
- Discuss image mosaicing results from assignment 1.
- How to use the laser scanner for assignment 2.
- Reading for today: View Interpolation for Image Synthesis, Eric Chen and Lance
Williams, SIGGRAPH '93, ( PDF without
color figures). Color copies of this paper for everyone in the class are available
at Cleah's office (Doherty 4309).
Presented by Mike Montemerlo.
- Mon. Sept. 27.
Reading for today:
Stereoscopic Display Using Image Warping, Leonard McMillan and Gary Bishop,
Stereoscopic Displays and Virtual Reality Systems II, SPIE Proceedings 2409, Feb. 1995.
Presented by Howard Leung.
- environment maps: cylinder, sphere, cube
- cylindrical panoramas
- Quicktime VR
- Wed. Sept. 29.
- Reading: Layered
Representation for Motion Analysis, John Y. A. Wang and Edward H. Adelson, CVPR
Presented by Kiran Bhat.
- see also Wang's web
page with images and quicktime movies:
- occlusion, hole filling problem
- sprites (images in layers)
- automatic extraction of image layers from video
- layered depth images (LDI's)
- Mon. Oct. 4.
View Transformation assignment due Sun. Oct. 3 at midnight.
- projective geometry
- Single View Metrology, Antonio Criminisi,
Ian Reid, and Andrew Zisserman, ICCV 99.
- assignment 3 summary
- Wed. Oct. 6.
- Mon. Oct. 11.
no class - Mid-semester break.
- Wed. Oct. 13.
- Ray-based representations (4D)
- light fields: acquiring, compression, rendering (Levoy, Gortler)
- Reading: Light Field Rendering,
Marc Levoy and Pat Hanrahan, SIGGRAPH '96.
Presenter: Mike Schuresko.
- You may want to also check out a very similar paper, The Lumigraph,
by Gortler, Grzeszczuk, Szeliski, and Cohen, SIGGRAPH '96.
- Mon. Oct. 18.
- Wed. Oct. 20.
Single View Modeling assignment due Tue. Oct. 19 at midnight.
- discussion of research projects: project topics, paper and talk requirements
- Mon. Oct. 25.
- Discuss results of Single View Modeling assignment.
- global illumination and radiosity
- Wed. Oct. 27.
- Reading: Inverse Global
Illumination: Recovering Reflectance Models of Real Scenes from Photographs,
Yizhou Yu, Debevec, Malik, Hawkins, SIGGRAPH 99.
- projective geometry, epipolar geometry, the fundamental matrix
Morphing, Proc. SIGGRAPH 96, 1996, pp. 21-30.
- project meetings with Paul or Steve today or tomorrow. (you should have scheduled
- project proposals due by email on Fri, Oct 29 to Paul AND Steve. See instructions.
- Mon. Nov. 1.
- Guest speaker: Chris McGlone on photogrammetry. See also his slides
- projective geometry
- Wed. Nov. 3.
- view morphing
- brief summary of chosen research project topics
- discussion/brainstorming image based modeling approaches (mosaics, view transformation,
sprites, light fields, ...)
- Mon. Nov. 8.
- Wed. Nov. 10.
- Mon. Nov. 15.
- Wed. Nov. 17.
- shape from motion (feature tracking, factorization method). See CMU Modeling by Videotaping
- Reading: Rapid octree construction from image sequences. R. Szeliski, CVGIP:
Image Understanding, 58(1):23-32, July 1993. (This paper is apparently not available
Presenter: Tad Drake.
- shape from silhouettes
- voxel coloring
- Mon. Nov. 22.
- Wed. Nov. 24.
no class - Thanksgiving vacation.
- Mon. Nov. 29.
- Student research presentations, Smith Hall 2nd floor, 3:30-5:30pm. Note special time
and place! Each talk 20 min. total. (The links below point to progress reports from
- Kiran Bhat: 3-D
Mosaicing from Stereo Video
- Tad Drake: Generating
Images with Arbitrary Focus Regions
- Li Zhang: Real-Time
- Mike Schuresko: Single
View Modeling for Nonplanar Surfaces
- Student research presentations, Wean 5409B, 10:30-12:30. Note that class will end
later than usual. Each talk 20 min. total.
- written reports due Fri. Dec. 3
Steve Seitz and Paul Heckbert, Nov. 1999