Evaluation of bandwidth performance for interactive spherical video

Evaluation of Bandwidth Performance for Interactive Spherical Video Patrice Rondao Alface, Jean-François Macq, Nico Verzijp Bell Labs, Alcatel-Lucent ICME’s WoMAN’11, Barcelona, July 2011

Acknowledgment FP7 FascinatE project

AGENDA ,[object Object],[object Object],[object Object],[object Object],[object Object]

Introduction Interactive Spherical Video ,[object Object],[object Object],[object Object],Heymann et al., “Representation, Coding & Interactive Rendering of High-Resolution Panoramic Images and Video using MPEG-4”, in Proc. Panoramic Photogrammetry Workshop (PPW) , Berlin, Germany, Feb. 2005.

Introduction Interactive Spherical Video - Applications ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Image source: www.immersivemedia.com

Interactive Spherical Video Transmission State of the Art ,[object Object],[object Object],[object Object],[object Object],A. Smolic et al.,”Efficient Representation & Coding of Omni-directional Video using MPEG-4”, Proc. WIAMIS 2003, 4th European Workshop on Image Analysis for Multimedia Interactive Services, London, UK, April 9.-11. 2003.

Interactive Spherical Video Transmission ,[object Object],[object Object],[object Object],[object Object],[object Object],A. Mavlankar, B. Girod, Background extraction and long-term memory motion-compensated prediction for spatial-random-access-enabled video coding, Picture Coding Symposium 2009, pp.1-4, 6-8 May 2009

Interactive Spherical Video Transmission Spherical Video Random Access ,[object Object],[object Object],[object Object]

Interactive Spherical Video Transmission Tiling ,[object Object],[object Object],[object Object],[object Object],Whole panorama Visible tiles only (RoI) Possible impairment (interaction delay)

Transmission Optimization Tile-Based Quality Adaptation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Transmission Optimization Proposed probability-based approach ,[object Object],[object Object],Tile marginal utility Tile at position i, quality q Tile bitrate Tile MSE Tile marginal cost Tile inserted at quality ≥ q Probability of tile visibility ,

Transmission Optimization Proposed probability-based approach ,[object Object]

Transmission Optimization Proposed probabilistic Model of the Tile Visibility ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Results (case 1: no delay) Tiling: client viewport quality vs. bandwidth

Transmission Optimization Probabilistic Model of the Tile Visibility ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Low delay: 40ms Quality is higher close to the estimated viewport High delay: 1280ms Low probability for any viewport position; quality tends to be constant on the whole panorama 15dB better than constant bitrate 7dB better than constant bitrate Results (case 2: user interaction delay) 75kB for 4Kx2K panorama

Results (case 2: user interaction delay) PSNR vs. Delay for a fixed bandwidth 75KBs

Results (case 2: user interaction delay) Discrepancy at the client side - delay of 1280ms

Conclusions ,[object Object],[object Object],[object Object],[object Object]

http://belllabs.be/internships

Transmission Optimization Experimental Setting ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Interactive Spherical Video Transmission State of the Art ,[object Object],Chi-Wing Fu et al., "The Rhombic Dodecahedron Map: An Efficient Scheme for Encoding Panoramic Video," Multimedia, IEEE Transactions on , vol.11, no.4, pp.634-644, June 2009

Interactive Spherical Video Transmission 2D Random Access ,[object Object],[object Object],[object Object],Content-based Arbitrary

Results (case 2: user interaction delay) Temporal analysis

Results (case 2: user interaction delay) Delay 1280ms Delay 40ms

Evaluation of bandwidth performance for interactive spherical video

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie Evaluation of bandwidth performance for interactive spherical video

Ähnlich wie Evaluation of bandwidth performance for interactive spherical video (20)

Mehr von Alpen-Adria-Universität

Mehr von Alpen-Adria-Universität (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Evaluation of bandwidth performance for interactive spherical video