Introduction about MPEG-1,2,4,7,21

1. MPEG-7
Multimedia Content Description Interface
Presented By:
Mumtaz Khan

2. Introduction
ƒ MPEG stand for Moving Picture Experts Group
ƒ working group of ISO/IEC in charge of the development of standards for coded
representation of digital audio and video and related data.
ƒ More and more digital audio - visual information exists and increasing.
ƒ Increasing Internet popularity How fast and easy can desirable
information be made available?
ƒ More audio-visual information processing systems emerged
ƒ The major MPEG standards include the following
‚ MPEG-1 ,MPEG-2 , MPEG-4 , MPEG-7 , MPEG-21

3. MPEG-1(11/1992)
ƒ standard for lossy compression of video and audio
ƒ Standardizes the storage and retrieval of moving pictures and audio storage
media forms the basis for Video Cd and MP3 formats
ƒ provide a video resolution of 352-by-240 at 30 frames per second (fps)
ƒ This produces video quality slightly below the quality of conventional VCR
videos.
ƒ It viable for digital audio and TV broadcasting as well as the creation of video
CDs
ƒ Today various products and applications use the MPEG-1 standard especially
the audio format, the most popular is MP3.

4. MPEG-1 file Extension
ƒ The following are extension of MPEG-1
‚ .mpg , .mpeg , .mp1 , .mp2 , .mp3 , m1v, .m1a , .mpa , mpv
ƒ Extended Form
‚ Jpeg,H.261

5. MPEG-2(11/1994)
ƒ MPEG-2 is widely used as the format of digital television signals that are
broadcast by terrestrial, cable, and direct broadcast satellite TV systems.
ƒ It also specifies the format of movies and other programs that are distributed
on DVD and similar discs. As such, TV stations, TV receivers, DVD players,
and other equipment are often designed to this standard.
ƒ It provide resolutions of 720x480 and 1280x720 at 60 fps.
ƒ MPEG1 is used for VCD while MPEG2 is used for DVD.

6. MPEG-4 (V1-09-1998 v2-11-1999)
ƒ MPEG-4 was standardized in October 1998 in the ISO/IEC document 14496
ƒ The standard for multimedia for the fixed and mobile web
ƒ It based on MPEG-1 and MPEG-2 and Apple QuickTime technology.
ƒ Wavelet-based MPEG-4 files are smaller than JPEG or QuickTime files,
ƒ They are designed to transmit video and images over a narrower bandwidth
and can mix video with text, graphics and 2-D and 3-D animation layers.

7. MPEG-4 Standardized Method
ƒ Audio-visual coding at very low bit rates
ƒ Representing audio-visual objects
ƒ Describing audio-visual objects in a scene
ƒ Multiplexing and synchronizing the information associated with the objects
ƒ Interacting with the audio-visual scene that is received by the end user

8. MPEG-4 Aims and Features
ƒ Interoperability of products from different vendors
ƒ Authors to have greater re-usability and flexibility with multimedia content
produced
ƒ Improvement in the management of Intellectual Property Rights
ƒ Transparent information for network service providers
ƒ Greater interactivity for end users. Users and content authors can manipulate
rich media content (both natural and synthetic). The limits of interactivity are
set by the author
ƒ Users can have the ability to:
 Change their viewing or listening point in the scene, e.g. by navigation
through a scene
 Drag objects in the scene to a different position

9. Cont…
 Trigger a range of events by clicking on a specific object, e.g. starting or
stopping a video stream
 Select a language (if the option is provided by the author)
 Scalability
 Advanced compression that provides higher capacity on CDs and DVDs and
also greater bandwidth (therefore more space for digital channels).

10. Main parts of MPEG-4
ƒ System
‚ Scene description stream, object Description stream, visual stream, Audio stream,
multiplexing, synchronization
‚ MPEG-4/BiFS
• A method of encoding a scene description in a binary form
• Based on VRML97,which uses hierarchies and nodes, also used for Web
• Allow user to change their view point in a scene or to interact with media objects
‚ Profile and Levels
• Profile is a subset of the MPEG-4 system, Visual or Audio tool set and is used for specific
Applications
• MPEG-4 Tool set include ,Visual Profile ,Natural Profile , Synthetic and Natural, Audio Profile ,
Graphic Profile, Scene Graph Profile.
ƒ Visual
‚ Coded representation of natural and synthetic visual objects

11. Cont…
ƒ Audio
‚ Deals with the representation of audio objects
ƒ Conformance Testing
‚ Conformance conditions for bit streams and devices
ƒ Reference Software
‚ Normative and non-normative tools to validate the standard
ƒ Delivery Multimedia Integrated Framework(DMIF)
‚ MPEG-4 data is authored once and delivered anywhere
‚ A set of interfaces for accessing multimedia content

12. Encoder,Decoder,Codecs,Players
of MPEG-4
ƒ ENCODERS
‚ DICas, Studio Encode, WebCast,Paketvideo etc
ƒ DECODERS
‚ EM8610 , EM8611 : For HDTV Decoder
‚ RealMagic :used with adobe premiere DV Edition
ƒ Codecs
‚ DivX and XviD etc
ƒ PLAYERS
‚ Mpegable X4 Live, Mpegable SDK 1.4,Mpegable Player, Nexplayer for PC and
PDA ,WebCine , Osmose etc.

13. MPEG-7(08-2001)
„ MPEG-7 “ Multimedia content description interface”.
„ Provide tools for describing multimedia content
„ MPEG-1, -2, -4: make content available;
MPEG-7: makes content accessible, retrievable,
filterable, manageable (via device / computer).
„ Goal: audio-visual material as searchable as text.

14. MPEG-7 Tools
„ Descriptor(Ds)
ƒ Describe the syntax and semantics of audio, video and multimedia
contents
„ Description Schemes(Dss)
ƒ Describe High level AV features e.g. describing region,
segments,objects,events
„ Description Definition Language(DDL)
ƒ Allow new Descriptor and Description schemes to be defined and
existing DSs to be modified.
„ DDL consist
ƒ XML Schema structural language components
ƒ XML schema Data type language components
ƒ MPEG-7 Specific extension

15. MPEG-7 Extension used to describe
„ Content
„ Form
„ Condition for accessing the material
ƒ Links to registry
ƒ Intellectual property rights
ƒ Price
„ Classification
ƒ Parental rating
ƒ Content classification(into pre-defined categories)
„ Storage features on the content
ƒ Storage format
ƒ Encoding
„ Creation –director , title, short feature moive

16. MPEG-7 Extension used to describe
„ Structural information(spatial ,teporal or spatio-temporal components)
ƒ Scene cuts
ƒ Segmentation in region
ƒ Region motion tracking
„ Low level features of content
ƒ Colors ,textures, sound timbres, Melody description
„ Conceptual information of the reality captured by the content
ƒ Objects
ƒ Events
ƒ Interaction among objects
„ User interaction (with the contents)
ƒ User preferences
ƒ Usage history

17. MPEG-7 Terminology
Data,
AV Content
Description Definition
1..* Item
Feature, Language (DDL)
defines 1..*
Descriptor (D),
0..* Description
Descriptor value, Scheme
*
Description Scheme (DS),
1..* 1..*
Description, describes signifies
Descriptor Feature Data
*..1 1..*
Coded Description and
To
Description Definition Language (DDL) Human or System

18. MPEG-7: Major Parts
„ Systems (ISO / IEC 15938 - 1)
„ Description Definition Language (ISO / IEC 15938 - 2)
„ Visual (ISO / IEC 15938 - 3)
„ Audio (ISO / IEC 15938 - 4)
„ Multimedia Description Schemes (ISO / IEC 15938 - 5)
„ Reference Software

19. Objective of MPEG-7
„ Standardize content-based description for various types of
audiovisual information
ƒ Enable fast and efficient content searching, filtering and
identification
ƒ Describe several aspects of the content (low-level features,
structure, semantic, models, collections, creation, etc.)
ƒ Address a large range of applications
(⇒ user preferences)
s Types of audiovisual information:
x Audio, speech
x Moving video, still pictures, graphics, 3D models
x Information on how objects are combined in scenes

20. Example of application areas
„ Storage and retrieval of audiovisual databases (image, film, radio
archives)
„ Broadcast media selection (radio, TV programs)
„ Surveillance(traffic control, surface transportation, production
chains)
„ E-commerce and Tele-shopping (searching for clothes / patterns)
„ Remote sensing(cartography, ecology, natural resources
management)
„ Entertainment (searching for a game, for a karaoke)
„ Cultural services (museums, art galleries)
„ Journalism (searching for events, persons)
„ Personalized news service on Internet (push media filtering)
„ Intelligent multimedia presentations
„ Educational applications
„ Bio-medical applications

21. Example of queries
„ Text:
ƒ Find AV material with the concepts described by the text
„ Semantic:
ƒ Find AV material corresponding to the specified semantic
„ Image:
ƒ Find an image with a similar characteristic (global or local)
„ Music:
ƒ Play a few notes and search for corresponding musical
pieces
„ Motion:
ƒ Find video with specific object motion trajectories

22. Relation content / description
„ Description may be separated from the content
AV material
Description
AV material AV material
AV material
s Description may be multiplexed with the content
AV Desc AV Desc AV Desc

23. Type of description
„ Information about the content: recording date & conditions, title,
author, copyright, coding format, classification, etc.
„ Information present in the content: Combination of low level and high
level descriptors
ƒ High level description: x Low level description
‚ Efficient and powerful 3 Generic and flexible
3 Intelligent / efficient search engine
‚ Lack of flexibility
Indexing Search
Feature extrac Retrieval
High level Low level
Recognition Recognition No restriction
Efficiency
process process on the search

24. Why do we need a standard ?
Having a standard will ease the task of fast and efficient identification of content
that is of interest to the user by
s allowing the same described s allowing the same search engine
content to be accessed by more
and filters to identify described
search engines and filters
content from more sources

25. Scope of MPEG-7
Description Description
Description
generation consumption
Research and Scope of MPEG-7
future competition
„ The description generation
ƒ Feature extraction, Indexing process, Annotation &Authoring
tools,...)
„ consumption
ƒ Search engine, Filtering tool, Retrieval process, Browsing device, ...)
„ are non normative parts of MPEG-7
„ The goal is to define the minimum that enables interoperability

26. MPEG-21 (11-2001)
„ Vision
ƒ To define a multimedia framework to enable transparent use of
multimedia resources across a wide range of networks and
devices used by different communities
„ Purpose
ƒ Enable electronic creation, delivery, trade of digital multimedia
content
„ Goals
ƒ Provide access to information and services from almost anywhere
at anytime with ubiquitous terminals and networks
ƒ Identify, describe, manage, and protect multimedia content to
support delivery chain of content creation, production, delivery,
and consumption