There are three main approaches to creating 3D content: live camera capture using stereo cameras, computer generated imagery, and converting 2D video to 3D. Converting 2D video involves using depth maps and depth image based rendering (DIBR) to generate additional views and turn a single 2D video into a 3D stereoscopic video. DIBR uses depth maps generated through block matching and color segmentation to warp pixels between views and fill holes and occlusions. While effective, this 2D to 3D conversion method has high computational requirements that make it unsuitable for real-time applications.

1. 3D content production St. Petersburg Electrotechnical University, St. Petersburg , Russia Sergey A. Sukhanov

3. What is 3D?

4. 3D Technology

5. 3D Content Production Three main approaches to creating 3-D content: • live camera capture • computer generated imagery (CGI) • 2D to 3D conversion

6. Live camera capture Live camera capture: recording stereo sequences of images simultaneously A depth-range camera Special 3D cameras (single body) Special 3D cameras (single body) side-by-side rig side-by-side rig

7. D epth map Regular 2D color video Accompanying 8-bit depth-images with the same spatio-temporal resolution The depth-images are normalized to a near clipping plane Z near and a far clipping plane Z far .

9. D epth map s and depth image based r endering (DIBR)

10. D epth map s generation B lock-matching based motion estimation 4x4 block Using previous frame as reference

14. D epth image based rendering Hole-Filling - occlusion : two different pixels of the real view image are warped to the same location in the virtual view - disocclusion : is due to the occluded area in the real view may become visible in the virtual view Left-eye view image created by 3D image warping with holes due to disocculsion Enlarged left-eye view image with stripe distortion after linear interpolation based hole-filling