BU Logo
ECE Logo

Serdar
Ince

ISS Laboratory Logo
Intermediate View Reconstruction

(Also please refer to this technical report for more information on IVR)

Summary:

Stereoscopic vision is an important research area since 1861 when Wheatstone introduced the first stereoscopic device. After his basic device many technologies have been proposed to deliver 3D vision to audiences. Although most of these technologies require the viewer to wear special eyewear, new technologies are emerging that do not require glasses. These technologies, called autostereoscopic displays, are becoming very popular. However their ability is limited due to their demand of multiple high quality images. Common stereoscopic cameras shoot two images simultaneously which is not enough for these displays. Therefore, the problem to be solved is to reconstruct intermediate virtual views using minimum number of real world images.

Autostereoscopic 3D Displays:

Conventional 3D displays usually require an additional eyewear for the user. The aim is to deliver the left and right view to respective eyes of user. Some examples of these eyewear and displays are

Anaglyphs

Time-Multiplexed displays

Polarization multiplexed displays.

While the techniques above require eyewear, autostereoscopic displays don’t require eyewear. In this method, views are spatially multiplexed on a pixel-addressable screen and then separated using an optical layer that covers the display.

The main idea of using lenticular sheet is summarized in figure above. The basic principle of delivering different images to each eye is achieved using optical lenses of the lenticular sheet. One can think of this configuration as of eyewear, that the user should wear, is carried on the monitor itself.

Synthagram LCD displays are one of the examples of autostereoscopic 3D displays manufactured by StereoGraphics Inc. We have SG202 and SG222 in VIP lab.

Test results:

We are working for developing new approaches for intermediate view reconstruction. Our initial results are available below. In each example, only left-most and right-most images are available. Additional seven view are recontructed using information of these images. Images are saved using PNG format not to introduce any distortions, therefore image sizes are large. (Convention: Left camera is at position 0, right camera is at position 1, virtual cameras are evenly located)

Purple Truck Image Pair (768 lines x 1024 pixels)

A video file created using these views is available here. You can play this file to feel the transition between the views. Download the video file in avi format .

If you have a SynthaGram monitor, you can download ‘interzigged’ (a format used by StereoGraphics) files. Download interzigged Image for

Intezigged images are vulnerable to compression therefore interzigged images are *.bmp format and around 2 MB.


Boston University Arches Image Pair (2400 lines x 3840 pixels)

Warning: Files sizes are around 11 MB, interzigged image is around 27 MB.

A video file created using these views is available here. You can play this file to feel the transition between the views. Download the video file in avi format (around 2 MB).

Download interzigged image for


Teddy Image Pair (1488 lines x 1792 pixels)

Warning: Files sizes are around 3 MB, interzigged image is around 8 MB.

A video file created using these views is available here. You can play this file to feel the transition between the views. Download the video file in avi format (around 2 MB).

Download interzigged image for


Flower Image Pair (480 lines x 720 pixels)


We are working towards improving our methods for better results. Please visit this page in the future for more results.

Acknowledments: Purple truck pair is used with permission of StereoVision.net. Flower is property of NHK of Japan. Teddy pair can be found at Middlebury Coll. Stero Vision Group. BU arches pair is property of ISS.

 

[Home] [Biography] [Research] [Publications] [Personal] [Downloads] [Turkce]