Multimedia

1. Introduction Principles of Multimedia Systems Sethserey SAM Computer Science Department

2. `

5. Multimedia is Multidisciplinary Image, audio, speech processing Computer vision, pattern recognition Computer networks, operating system Human computer interaction Computer graphics Multimedia computing

6. Example Multimedia Systems Real Estate in MIT’s Project Athena

7. Example Multimedia Systems Chronoscope in MIT’s Project Athena

8. Example Multimedia Systems Navigation Learning Environment in MIT’s Project Athena

9. Example Multimedia Systems Photosynth of Microsoft Live Labs.

11. Data Compression Raw image takes about 6M bytes (without header information) 24k bytes with jpeg, Q=50

12. “JPEG” Illustration r g b Transform to frequency domain Quantization Lossless compression … 0010001 …. decoder r’ g’ b’ u v

14. Tracking Object by Image Matching

15. Multiple Object Tracking Toys Squash Lab Double Squash

16. Finding Objects in Clutter

17. Object Recognition David G. Lowe, "Object recognition from local scale-invariant features," ICCV99.

18. Posture Detection in Images Template Image

19. Dealing with Multiple Objects

21. Finding Action Clusters in Image Database

22. Finding Action Clusters (con’t)

23. Action Recognition video1 video2 Ramanan, D., Forsyth, D. A., Zisserman, A. " Strike a Pose: Tracking People by Finding Stylized Poses. " Computer Vision and Pattern Recognition (CVPR), San Diego, CA, June 2005. video3

27. Q & A