1. Distributed (networked), Immersive & Interactive Multimedia Systems. Quality of Service (QoS) & Quality of Experience (QoE). MulSeMedia: Multi-Sensorial Media experiences. Stimulation of all senses: olfactory, haptics/touch... 3D AR apps and VR immersive scenarios (E.g. VR games). Caves, Head Mounted Displays or HMD (e.g., Oculus Rift...) Motion Capture (MOCAP) & Gesture Interaction. Professional IR Tracking Systems, and Kinnectv2, Leap Motion… Distributed, Interactive and Immersive TV (eg. Based on HbbTV). 2. Media Streaming (Multicast, RTP/RTCP, RTSP, HTTP-based Adaptive Streaming). 3. Types and solutions for Media Synchronization (MediaSync). Inter-Media Sync (lip-sync, subtitles sync…); Inter-Device Sync or IDES (e.g. multi-screen scenarios); Inter-Destination Media Sync or IDMS (e.g. Social TV); and Hybrid Broadcast Broadband Sync (e.g. multi-view hybrid TV) 4. Multi-Touch Collaborative Screens.

1. INVESTIGACIÓN EN EL CAMPUS DE GANDIA
Immersive and Interactive
Media R&D Group
(http://iim.webs.upv.es)
www.gandia.upv.es/investigacion

2. IIM (http://iim.webs.upv.es) es un grupo emergente de I+D, integrado en el
Departamento de Comunicaciones de la UPV, y localizado en el Campus de Gandia.
• Formado por:
- Profesores de áreas multidisciplinares.
- Personal contratado.
- Becarios de investigación.
- Alumnos de grado y máster.
• Áreas muy relacionadas con la docencia en el Campus: Telecomunicaciones y
Electrónica (interconexión, protocolos, diseño de dispositivos); Audiovisuales (contenido,
diseño); Matemáticas (algoritmos, modelado y estadística); Informática (programación
multi-dispositivo, virtualización...); Turismo (aplicaciones RV, RA, sensoriales...).
• Proyectos I+D en vigor: 3 regionales (GV + 2 Polisabios) y 2 locales (Cátedras IVIO y
Telefónica).
• Colaboraciones externas: CWI y TNO (Holanda); i2CAT y UAB (España).
Immersive and Interactive Media R&D Group (IIM)
INVESTIGACIÓN
www.gandia.upv.es/investigacion

3. 1. Distributed (networked), Immersive & Interactive Multimedia Systems.
• Quality of Service (QoS) & Quality of Experience (QoE).
• MulSeMedia: Multi-Sensorial Media experiences.
− Stimulation of all senses: olfactory, haptics/touch...
• 3D AR apps and VR immersive scenarios (E.g. VR games).
− Caves, Head Mounted Displays or HMD (e.g., Oculus Rift...)
• Motion Capture (MOCAP) & Gesture Interaction.
− Professional IR Tracking Systems, and Kinnectv2, Leap Motion…
• Distributed, Interactive and Immersive TV (eg. Based on HbbTV).
2. Media Streaming (Multicast, RTP/RTCP, RTSP, HTTP-based Adaptive Streaming).
3. Types and solutions for Media Synchronization (MediaSync).
• Inter-Media Sync (lip-sync, subtitles sync…); Inter-Device Sync or IDES (e.g. multi-screen
scenarios); Inter-Destination Media Sync or IDMS (e.g. Social TV); and Hybrid Broadcast
Broadband Sync (e.g. multi-view hybrid TV)
4. Multi-Touch Collaborative Screens.
Líneas de I+D+i
www.gandia.upv.es/investigacion
Immersive and Interactive Media R&D Group (IIM)

4. 1. Distributed (networked), Immersive & Interactive Multimedia Systems
Quality of Service (QoS) & Quality of Experience (QoE).
• QoS: Network-level and Application-level QoS metrics (delay, jitter, packet loss,
throughput, asynchrony…)
• QoE: Subjective assessments (performance, usability, usefulness, applicability...)
• Market studies (users’ trends, expectations, preferences and needs, interactions with
the professional field…)
Líneas de I+D+i
www.gandia.upv.es/investigacion
Immersive and Interactive Media R&D Group (IIM)

5. 1. Distributed (networked), Immersive & Interactive Multimedia Systems
MulSeMedia: Multi-Sensorial Media experiences.
• Stimulation of all senses: olfactory, haptics/touch, wind, temperature, humidity,
vibration...
Olfactory:
Touch/force/pressure(Haptics)...
Líneas de I+D+i
www.gandia.upv.es/investigacion
Immersive and Interactive Media R&D Group (IIM)
Click for
Demo
Videos

6. 1. Distributed (networked), Immersive & Interactive Multimedia Systems
3D AR apps and VR immersive scenarios (E.g. VR games).
• Caves, Head Mounted Displays or HMD (e.g., Oculus Rift...):
Líneas de I+D+i
www.gandia.upv.es/investigacion
Immersive and Interactive Media R&D Group (IIM)
Click for
Demo
Videos

7. 1. Distributed (networked), Immersive & Interactive Multimedia Systems
Motion Capture (MOCAP) & Gesture Interaction.
• Professional IR Tracking Systems, and no professional systems (Kinnectv2, Leap Motion…):
Líneas de I+D+i
www.gandia.upv.es/investigacion
Immersive and Interactive Media R&D Group (IIM)
Click for
Demo
Videos

8. 1. Distributed (networked), Immersive & Interactive Multimedia Systems
Social TV and synchronous e-Learning Platform
Líneas de I+D+i
www.gandia.upv.es/investigacion
Immersive and Interactive Media R&D Group (IIM)
Click for
Demo
Videos
• Cross-platform, cross-device support.
• Online Video library.
• Distributed Media Sharing,
Consumption and Synchronization:
⁻ Inter-Destination and Inter-Media Sync.
⁻ Shared navigation control.
⁻ Master/Slave (M/S) Scheme.
⁻ M/S Role switching.
• Social Interaction Channels:
⁻ Synchronized text chat.
⁻ AV conferencing tools.
• Presence Mechanisms:
⁻ List of active sessions, members, and media
being consumed.
⁻ Twitter (#Wersync, #session_id, #user_nick,
URL).

9. 1. Distributed (networked), Immersive & Interactive Multimedia Systems
Interactive and Immersive TV
• Immersive TV (VR and 360º)
- TV
- Tablets, smartphones.
- HMD
• Interactive displays.
• Personalized media experiences (Freeview multicamera TV,
adaptive and customizable subtitles…)  Accesibility (impaired)
Líneas de I+D+i
www.gandia.upv.es/investigacion
Immersive and Interactive Media R&D Group (IIM)
T
V Second screen
Click for
Demo
Videos

10. 2. Media Streaming (Multicast, RTP/RTCP, RTSP, HTTP-based Adaptive Streaming).
Interactive and Immersive TV
• Protocols for Multimedia Communications (SIP, SDP, RTSP, RTP/RTCP, RSVP, multicast…).
• RTP/RTCP and RTSP based streaming.
• HTTP-based Adaptive Streaming (MS Smooth Streaming, HLS, HDS and MPEG-DASH).
• Convergence between broadcast and broadband (HbbTV, DVB, IP…
Líneas de I+D+i
www.gandia.upv.es/investigacion
Immersive and Interactive Media R&D Group (IIM)
Click for
Demo
Videos

11. 3. Media Synchronization (MediaSync)
Types and solutions for Media Synchronization (MediaSync)
• Inter-Media Sync: lip-sync, subtitles sync.
• Inter-Device Sync (IDES): e.g. multi-screen scenarios.
• Inter-Destination Media Sync (IDMS): e.g. Social TV.
• Hybrid Broadcast Broadband Sync: e.g. multi-view TV
Ej: Hybrid and IDES Sync: Adaptive Synchronized Subtitles
Líneas de I+D+i
www.gandia.upv.es/investigacion
Immersive and Interactive Media R&D Group (IIM)
Click for
demo
videos

12. 4. Multi-Touch Collaborative Screens
Líneas de I+D+i
www.gandia.upv.es/investigacion
Immersive and Interactive Media R&D Group (IIM)
Click for
Demo
Videos

13. • HbbTV 2.0 compliant and Gstreamer-based testbeds for Hybrid
broadcast/broadband media delivery/consumption by using DVB, RTP
and HTTP-based adaptive streaming (HLS and MPEG-DASH).
• VR immersive collaborative scenarios 3D and VR Lab.
• HMDs (e.g. Oculus Rift DK2).
• Semi-Cave (L format) 3D projection Lab with
movement tracking system.
• Gesture Control and Capture Devices (based on
IR cameras, Microsoft Kinectv2 for Windows or
leap motion) -> Motion Capture Lab.
• Generators of multi-sensorial effects (e.g., smell, wind, heat/cold…).
• Interactive multi-taction display
(e.g. interactive multi-user table-display)
• Rpi-based HD Video wall.
• Haptic devices (Geomagic Touch-X)
• Media and Networking Lab with computers,
media and networking devices.
• Professional Software.
Equipamiento disponible para I+D+i

14. www.gandia.upv.es/investigacion
Muchas Gracias por su atención!!!!
Contacto
Fernando Boronat Seguí
C/Paranimf,1 46730
Grau de Gandia (Valencia, Spain)
Teléfono: +34 96 2849341
fboronat@dcom.upv.es
http://iim.webs.upv.es/
Youtube Channel
Twitter: @ImInMediaGroup