A Lattice-based MRF Model for Dynamic Near-regular Texture

Tracking and Manipulation


To play the following videos, a quicktime player and a media player are required.

The avi format is DivX 5.2. Please download it from DivX521.exe or http://www.divx-digest.com/software/divxcodec5.html.



            If you use the Microsoft IE browser, please temporarily allow pop-ups and activeX controls.


Please click on images to play videos.




Texton Detection Results






Tracking Dynamic NRTs without Occlusion   

Slowly waving cloth



Underwater texture tracking and replacement

(A texture placed under a water tank was seen through disturbed water)

Playing at normal speed, 30 fps

Playing 10 times slower, 3 fps


Playing at normal speed, 30 fps

Playing 4 times slower, 7.5fps



Tracking Dynamic NRTs with Occlusion


            Crowd motion

(Special thanks to Yu and Wu for running their algorithm on this video)


            Fabric texture

(Special thanks to Guskov for providing the input video)

top-left: visibility map of aligned textons

results with visibility map



Validation and Comparison

Different neighborhood systems


Multiple texton templates vs. PCA texton template

The tracking result using multiple texton templates is better (see frames 16, 68, 88)


Different initial texton positions




Video Editing Applications


            Texture replacement of a fabric texture 

tracked lattices and lighting deformation field

texture replacement results


            Texture replacement of an underwater texture


            Video superimposing:

“USA” is superimposed on the dress