Red-Green-Blue Example
Images of the Russian Empire:
Colorizing the Prokudin-Gorskii photo collection
and
= 
+
 
 
Hybrid Images:
Images that look different from afar
Julia Schwarz
Project 1
Computational Photograpy, Fall 2011

Colorizing the Prokudin-Gorskii Photo Collection (jump to hybrid images)

Sergei Mikhailovich Prokudin-Gorskii(1863-1944) [Сергей Михайлович Прокудин-Горский] came up with a clever way to create color images back before color photography was invented. He realized that color images could be re-created from three seperate images, taken with red, green and blue filters. Prokudin-Gorskii was commissioned to record life in Russia in the early 20th century, and many of these images were taken in a method that could later be used to re-create the color image. Years later, we can now re-create 20th century Russia simply by doing some clever alignment setting each photo to the red, green and blue channels of an image.


Original image

Overlaying red, green blue channels causes incorrect alignment.

Result after aligning images correctly.
 

Unfortunately, simply setting each of the three images Gorskii took to red, green, blue channels produces bad results because the images are not quite correctly aligned (see left). Correctly aligning images, however, yields much better results. I aligned images using the following methods:

Using this approach most of my images aligned quite well. However two of the larger images (see below, larger images), 0087 and 01403 still has some misalignment artifacts. I resolved this for 01403 by aligning to the G channel instead of the B channel. For 0087, I was still unable to find a good alignment, I think this is because the subject actually moved when the photo was taken.

Overview of Results

The tables below illustrate results for small files as well as larger files. Each image also shows the offsets I used to align the images. In addition to showing results required for class, I have included two results of my choice in both the small and large set.

 

Results: Small Images


00088v.jpg
Red offset x: 5 px
Red offset y: 4 px
Green offset x: 3 px
Green offset y: 3 px

00106v.jpg

Red offset x: -1 px
Red offset y: 9 px
Green offset x: 1 px
Green offset y: 4 px

00137v.jpg

Red offset x: 9 px
Red offset y: 11 px
Green offset x: 5 px
Green offset y: 6 px

00757v.jpg

Red offset x: 5 px
Red offset y: 5 px
Green offset x: 3 px
Green offset y: 2 px

00888v.jpg

Red offset x: 0 px
Red offset y: 12 px
Green offset x: 1 px
Green offset y: 6 px


00889v.jpg

Red offset x: 3 px
Red offset y: 5 px
Green offset x: 2 px
Green offset y: 2 px

00907v.jpg

Red offset x: -1 px
Red offset y: 5 px
Green offset x: -1 px
Green offset y: 2 px

00911v.jpg

Red offset x: -1 px
Red offset y: 13 px
Green offset x: -1 px
Green offset y: 1 px

01031v.jpg

Red offset x: 2 px
Red offset y: 4 px
Green offset x: 1 px
Green offset y: 1 px

01880v.jpg

Red offset x: 4 px
Red offset y: 14 px
Green offset x: 2 px
Green offset y: 6 px

00153v.jpg (choice)

Red offset x: 4 px
Red offset y: 14 px
Green offset x: 3 px
Green offset y: 7 px

003898v.jpg (choice)

Red offset x: 4 px
Red offset y: 11 px
Green offset x: 3 px
Green offset y: 5 px

Results: Large Images (click to see a larger image)


00029u.tif
Red offset x: 36 px
Red offset y: 95 px
Green offset x: 20 px
Green offset y: 40 px


00087u.tif

Blue offset x: 17 px
Blue offset y: 59 px
Green offset x: -37 px
Green offset y: -51 px

00128u.tif

Red offset x: 36 px
Red offset y: 49 px
Green offset x: 21 px
Green offset y: 32 px

00737u.tif

Red offset x: 13 px
Red offset y: 49 px
Green offset x: 8 px
Green offset y: 17 px

00822u.tif

Red offset x: 32 px
Red offset y: 125 px
Green offset x: 22 px
Green offset y: 58 px

00892u.tif

Red offset x: 3 px
Red offset y: 40 px
Green offset x: 1 px
Green offset y: 16 px

00992u.tif

Red offset x: 19 px
Red offset y: 113 px
Green offset x:  11 px
Green offset y: 52 px

01043u.tif

Blue offset x: 9 px
Blue offset y: 24 px
Green offset x: -13 px
Green offset y: 9 px

01085u.tif

Red offset x: 59 px
Red offset y: 112 px
Green offset x: 32 px
Green offset y: 45 px

01734u.tif

Red offset x: 48 px
Red offset y: 101 px
Green offset x: 28 px
Green offset y: 48 px

01861a.tif (choice)

Red offset x: 62 px
Red offset y: 143 px
Green offset x: 36 px
Green offset y: 68 px

01657u.tif (choice)

Red offset x: 13 px
Red offset y: 120 px
Green offset x: 9 px
Green offset y: 57 px

 

Hybrid Images  jump to top

Hybrid images look like one image close up, and another from afar. An artistic example of this is Salvador Dali's Gala Contemplating, which looks like Lincoln from afar. To create such images automatically I used a method described in the SIGGRAPH 2006 paper by Ovila et al. Using this technique I was able to create an image that looked like a cat close up, and like me from a distance. Specifically, I did the following:

  1. First use a GUI to register two images.
  2. Use a low-pass filter (Gaussian blur) to create a low frequency image of myself.
  3. Use a high-pass filter to create a high frequency image of the cat.
  4. Add these two images together to create my hybrid image.

Using Gaussian Pyramid to Simulate Viewing at Different Distances

I used a Gaussian pyramid to illustrate how the image changes as you look at it from farther and farther away

Close Up Far away

Frequency Analysis

We can see how the low and high pass filters affect the frequencies of the images by looking at their Fourier Transforms, as below.

Image Fourier Transform