Slides of my position statement at ACM Multimedia 2015 Panel on Opportunities and Challenges of Globally Networked Cameras, Brisbane, Australia

1. 1
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
Globally Networked Cameras
The Good, The Bad and The Ugly
Touradj Ebrahimi
touradj.ebrahimi@epfl.ch
Opportunities and Challenges of
Globally Networked Cameras
ACM Multimedia 2015
Brisbane, Australia

2. 2
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
Outline

3. 3
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne

4. 4
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
The good: A connected world!

5. 5
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne

6. 6
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
The bad: A world under surveillance!
• People are increasingly exposed:
– Proliferation of video surveillance

7. 7
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
The bad: A world under surveillance!
• People are increasingly exposed:
– Proliferation of social media

8. 8
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
Privacy-sensitive visual information
• Automatic identification of Regions of Interest (ROI)
– People in the scene
– Human faces
– Cars license plates
– Moving objects
– …
• Advanced image/video analytics
– Deep learning
– Big data analytics

9. 9
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
Social media/networks business model
• User profiling
• Targeted advertisement/marketing

10. 10
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne

11. 11
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
The ugly: Emerging imaging modalities
• Wearable cameras
• Mobile cameras (e.g. drones)
• HDR
• UHD
• Light field
• …

12. 12
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne

13. 13
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne

14. 14
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
The ugly: Big data analytics

15. 15
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne

16. 16
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
… and the good again: privacy by design!
JPEG
Transcoder
Mask matrix Sub-image Morphed JPEG image
Original image
Processed image
−
Sub-image embedded
in APPn Markers
T
Reconstructed image
0 ! 0 ! 0 ! 0 ! 0 ! 0 ! 0 ! 0 ! 0 ! 0 !
0 ! 0 ! 0 ! 0 ! 0 ! 0 ! 1 ! 1 ! 0 ! 0 !
0 ! 0 ! 1 ! 1 ! 0 ! 1 ! 1 ! 1 ! 1 ! 0 !
0 ! 1 ! 1 ! 1 ! 1 ! 1 ! 1 ! 1 ! 1 ! 0 !
0 ! 1 ! 1 ! 1 ! 1 ! 0 ! 1 ! 1 ! 0 ! 0 !
0 ! 0 ! 1 ! 1 ! 0 ! 0 ! 0 ! 0 ! 0 ! 0 !
0 ! 0 ! 0 ! 0 ! 0 ! 0 ! 0 ! 0 ! 0 ! 0 !
JPEG
Transcoder
Threshold t
JPEG
Transcoder

17. 17
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
JPEG Security and Privacy
SOI
APP1 (Exif)
EOI
SOI
APP1 (Exif)
EOI
APP11
(protected
metadata)
JPEG-1 decoder
JPEG Privacy &
Security
decoder
APP1 (Exif)
APP1 (Exif)
original JPEG
codestream
JPEG compatible
codestream with
data protection
Image Data
Image data
APP11
(protected
image data)
Image Data
APP11
(protected
metadata)
Image data
APP11
(protected
image data)
APP3 (JPSearch)
APP3 (JPSearch)
APP3 (JPSearch)

18. 18
Multimedia Signal Processing Group
Swiss Federal Institute of Technology, Lausanne
Thanks for your attention!