New coding techniques, standardisation, and quality metrics

New coding techniques, standardisation, and quality metrics Touradj Ebrahimi [email_address]

Multimedia ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Digital revolution ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Moore’s law ,[object Object]

Multimedia anywhere, anytime, accessible to everybody

In many forms, applications and services

Multimedia challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Phase 1 (yesterday): Era of all digital ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Phase 2 (today): Era of multimedia ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Examples ,[object Object],[object Object]

Phase 2 (today): Era of multimedia ,[object Object],[object Object],[object Object],[object Object]

Phase 3 (tomorrow): Era of interface ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Phase 3 (tomorrow): Era of interface ,[object Object]

Phase 4 (day after tomorrow): Era of extended media and interface ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Digital Media Roadmap 1985 1990 1995 2000 2005 2010 2015 2020 Phase 1 Phase 2 Phase 3 Phase 4 All Digital Multimedia Interface Extended media and interface

Phase 5 : Era of symbiosis ,[object Object],[object Object],[object Object],[object Object]

Phase 5 : Era of symbiosis ,[object Object]

Phase 5 : Era of symbiosis ,[object Object],[object Object]

Standards ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why compression? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Content representation ,[object Object],[object Object],[object Object],[object Object]

Application requirements ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

MPEG-x approach ,[object Object],[object Object],[object Object]

H.26x approach ,[object Object],[object Object],[object Object]

Media Coding Standards Evolution …

Frame-based Video/Image Coding Standards up to AVC ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

MPEG-1: The First Entertainment Bits ,[object Object],[object Object],[object Object],[object Object],1991 ! Source Delivery D e m u l t i p l e x e r Video Audio

MPEG-2: Digital TV ,[object Object],[object Object],[object Object],1993 !

MPEG-4: Object-Based Coding Standard ,[object Object],[object Object],[object Object],[object Object],[object Object],1998 !

Video Coding in MPEG-4 ,[object Object],[object Object],[object Object],[object Object]

H.264/AVC: Main Functionalities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Basic Coding Architecture 2003 !

H.264/AVC: a Success Story … ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Is there a Moore’s law of compression ? ,[object Object],[object Object],[object Object],[object Object],[object Object]

Scalable Video Coding: Objectives ,[object Object],[object Object],[object Object]

SVC Applications ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

SVC Coding Architecture ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],2007 ! Hierarchical MCP & Intra prediction Base layer coding texture motion Hierarchical MCP & Intra prediction Base layer coding texture motion Progressive SNR refinement texture coding Spatial decimation Spatial decimation H.264/AVC compatible base layer bit-stream Hierarchical MCP & Intra prediction Base layer coding Multiplex texture motion Scalable bit-stream H.264/AVC compatible encoder Progressive SNR refinement texture coding Progressive SNR refinement texture coding

SVC Scalability Types ,[object Object],[object Object],[object Object]

SVC Performance: Spatial Scalability ,[object Object],[object Object]

3D Worlds ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Multiview Video Coding (MVC) ,[object Object],[object Object]

MVC Prediction Structures ,[object Object],MPEG-2 Video Multiview profile MPEG-4 MVC

MVC: Technical Solution ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],2008 !

Some MVC Performance Results Anchor is H.264/AVC without hierarchical B pictures; however, Simulcast already includes hierarchical B pictures.

State-of-the-Art: H.264/AVC Encoding Architecture

The Current Video Coding Paradigm ,[object Object],[object Object],[object Object],[object Object]

Emerging Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],light Transcoding Heavy encoder Light decoder

Distributed Coding of Dependent Sources: The Slepian-Wolf Theorem ,[object Object],Independent enc. & dec: no errors Distributed enc. and joint decoding: vanishing error probability for long sequences

Lossy Coding with Side Information: The Wyner-Ziv Theorem ,[object Object],[object Object],Source Lossy Encoder Lossy Joint Decoder X X Y Y ^

Feedback Channel Based DVC Architecture ,[object Object],[object Object],[object Object],[object Object],KF KF WZ

DVC RD Performance Coastguard QCIF@15Hz, GOP2

VISNET II DVC RD Performance Foreman QCIF@15Hz, GOP2

VISNET II DVC RD Performance Soccer QCIF@15Hz, GOP2

VISNET II DVC RD Performance Hall&Monitor QCIF@15Hz, GOP2

Looking over the Horizon … ,[object Object],[object Object],[object Object],[object Object],[object Object]

‘ rugby’ 4.7 Mbit/s AVC + texture synthesis 20?? !

Quality of Experience ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Quality of Experience ,[object Object],[object Object],[object Object],[object Object],[object Object]

Challenges in visual quality assessment ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],Acknowledgement to Fernando Pereira (IST) and MPEG committee members for some slides.

New coding techniques, standardisation, and quality metrics

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (19)

Andere mochten auch

Andere mochten auch (19)

Ähnlich wie New coding techniques, standardisation, and quality metrics

Ähnlich wie New coding techniques, standardisation, and quality metrics (20)

Mehr von Touradj Ebrahimi

Mehr von Touradj Ebrahimi (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

New coding techniques, standardisation, and quality metrics