A Lattice-based MRF Model for Dynamic Near-regular Texture

Tracking and Manipulation

To play the following videos, a quicktime player and a media player are required.

The avi format is DivX 5.2. Please download it from DivX521.exe or http://www.divx-digest.com/software/divxcodec5.html.

If you use the Microsoft IE browser, please temporarily allow pop-ups and activeX controls.

Please click on images to play videos.

Texton Detection Results

Tracking Dynamic NRTs without Occlusion

Slowly waving cloth

Underwater texture tracking and replacement

(A texture placed under a water tank was seen through disturbed water)

Playing at normal speed, 30 fps

Playing 10 times slower, 3 fps

Playing at normal speed, 30 fps

Playing 4 times slower, 7.5fps

Tracking Dynamic NRTs with Occlusion

Crowd motion

(Special thanks to Yu and Wu for running their algorithm on this video)

Fabric texture

(Special thanks to Guskov for providing the input video)

top-left: visibility map of aligned textons

results with visibility map

Validation and Comparison

Different neighborhood systems

Multiple texton templates vs. PCA texton template

The tracking result using multiple texton templates is better (see frames 16, 68, 88)

Different initial texton positions

Video Editing Applications

Texture replacement of a fabric texture

tracked lattices and lighting deformation field

texture replacement results

Texture replacement of an underwater texture

Video superimposing:

“USA” is superimposed on the dress