1. MPEG‐V Sensory Informa3on (SI)
a.k.a. RoSE WD v3.0
Chris3an Timmerer
Klagenfurt University (UNIKLU)  Faculty of Technical Sciences (TEWI)
Department of Informa3on Technology (ITEC)  Mul3media Communica3on (MMC)
hquot;p://research.,mmerer.com  hquot;p://blog.,mmerer.com  mailto:chris,an.,mmerer@itec.uni‐klu.ac.at

2. What is MPEG‐V Sensory Informa,on?
2009/02/06 Chris,an Timmerer, Klagenfurt University, Austria 2

3. System Architecture
Digital Content
Adaptation VV
Provider
(Virtual World,
(serious) game,
Virtual World Data
Representation R
simulator, DVD, …)
Adapta3on RV/VR Virtual World Data Representa3on V
Scope of this interna/onal
standard
Adapta3on RV Adapta3on VR
S S A A
Device Commands
Real Real
Real
World World World
2009/02/06 Chris,an Timmerer, Klagenfurt University, Austria 3
Dev2 Dev3
Dev1

4. Author’s Sensory Sensory
Inten3on to Effect Device
trigger Metadata Capabili3es
<elem‐1…/> <cap‐1…/>
single
<elem‐2…/> <cap‐2…/>
sense
RoSE
<elem‐3…/> <cap‐3…/>
. .
Engine
mul3ple
(inform.)
. .
senses
. .
<elem‐n…/> <cap‐n…/>
Scope of Standardiza/on
SEM elements/types provides tools for expressing sensory effects, i.e., the elements
may be used by content authors to trigger a single or mul,ple human senses. Note
that there is not necessarily a one‐to‐one mapping between senses and elements of
the sensory effect metadata.
SEM elements/types are mapped to commands that control sensory devices based on
their capabili,es. Note that there is not necessarily a one‐to‐one mapping between 4
2009/02/06 Chris,an Timmerer, Klagenfurt University, Austria
SEM elements and sensory device capabili,es.

5. Working Dra Structure
• Sensory Effect Descrip,on Language
– Basic building blocks: Descrip,onMetadata, Declara,on, Effect,
GroupOfEffects, Parameter
– Common aquot;ributes: XSI, ac,vate, dura,on, fade‐in, fade‐out, alt,
priority, intensity, posi,on, adaptType, adaptRange, autoExtrac,on,
– Low‐level datatypes: vacant
• Sensory Effect Vocabulary
– (Color) Light, Temperature, Wind, Vibra,on
– Flash Light, Water Sprayer, Perfumer/Scent, Fog, Window Blind/
Shadow, Sound, Color Correc,on
• Sensory Effect Context Descrip,ons
– User sensory preferences moved to MPEG‐V
– Sensory device capabili,es Control Informa3on
– Sensory device commands
2009/02/06 Chris,an Timmerer, Klagenfurt University, Austria 5

6. MPEG‐V SI References
• N9896, A Summary of the Representa,on of
Sensory Effects (RoSE)
• N10498, Requirements for MPEG‐V Version 3.2
• WD of Sensory Informa,on
• Ad‐hoc Group
N10475
– metaverse@lists.uni‐klu.ac.at
– hquot;p://lists.uni‐klu.ac.at/mailman/lis,nfo/metaverse
2009/02/06 Chris,an Timmerer, Klagenfurt University, Austria 6

7. Thank you for your aquot;en,on
... ques,ons, comments, etc. are welcome …
Thanks to the contributors
ETRI, Klagenfurt University, MyongJi University,
Philips, and Sharp
Ass.‐Prof. Dipl.‐Ing. Dr. Chris,an Timmerer
Klagenfurt University, Department of Informa,on Technology (ITEC)
Universitätsstrasse 65‐67, A‐9020 Klagenfurt, AUSTRIA
chris,an.,mmerer@itec.uni‐klu.ac.at
hquot;p://research.,mmerer.com/
Tel: +43/463/2700 3621 Fax: +43/463/2700 3699
© Copyright: Chris.an Timmerer
2009/02/06 Chris,an Timmerer, Klagenfurt University, Austria 7