LNF2010: Was kommt nach 3DTV? Ein Fernseherlebnis für alle Sinne!

•

1 gefällt mir•600 views

Bei gewöhnlichem Fernsehen werden nur zwei menschliche Sinne angesprochen, nämlich Hören und Sehen (2D/3D), jedoch besitzt der Mensch noch weitere Sinne wie Riechen, Tasten, Fühlen, usw. Um auch diese Sinne anzusprechen werden TV-Inhalte mit Metadaten angereichert, um, über spezielle Geräte (z.B. Ventilatoren), zusätzliche Effekte zu erzeugen, welche beim Anwender alle Sinne stimulieren sollen, frei nach dem Motto „mitten drin statt nur dabei“!

Technologie Unterhaltung & Humor

Was kommt
nach 3DTV?
Ein Fernseherlebnis für
alle Sinne!
Christian Timmerer, Markus Waltl, Benjamin Rainer und Hermann Hellwagner
Universität Klagenfurt (UNIKLU)  Fakultät für Technische Wissenschaften (TEWI)
Institut für Informationstechnologie (ITEC)  Multimediakommunikation (MMC)
http://research.timmerer.com  http://blog.timmerer.com  mailto:christian.timmerer@itec.uni-klu.ac.at
Lange Nacht der Forschung, 5. November 2010, Universität Klagenfurt
Acknowledgments. This work was supported in part by the EC in the context of
the NoE INTERMEDIA (NoE 038419) and the ALICANTE project (FP7-ICT-248652).

Was kommt nach 3DTV?
Ein Fernseherlebnis für alle Sinne!
Warum?
• (3D)TV => Hören und Sehen (2D/3D)
• Mensch besitzt noch weitere Sinne wie Riechen, Tasten, Fühlen, usw.
Was?
• Alle Sinne sollen stimuliert werden, frei nach dem Motto „mittendrin statt nur
dabei“!
Wie?
• Anreicherung von TV/Video/Web mit zusätzlichen Information (Metadaten)
• Verwendung spezieller Geräte (z.B. Ventilatoren, Vibratoren, Klima- und
Lichtanlagen)
• Erzeugung von Zusatzeffekte (z.B. Explosion, Erdbeben, Sturm), welche alle Sinne
stimmulieren sollen
Wo?
• Institut für Informationstechnologie, Multimediakommunikation
• Raum: U31, Südtrackt, 2. Stock, E.2.42
5. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV? 2

Konzept
5. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV? 3
Mittendrin statt nur dabei!

Hardware
5. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV? 4
Wandfluter mit Steuereinheit
Leuchten links und rechts Subwoofer
Ventilatoren
Vibrations-Handgelenkauflage
Lautsprecher
für 2.1-
Sound

Forschungsaspekte / -fragen
Qualität greifbar machen
• (Qualitäts-)Erfahrungen quantifizieren
• Gefühle/Emotionen: reale vs. fiktive Inhalte
Zusatzeffekte automatisiert bereitstellen
• Lichteffekte aus visuellen Inhalten extrahieren: durchschnittliche,
dominante Farbwerte in Echtzeit
• Vibrations- und Windeffekte basierend auf Inhaltsanalyse (geplant)
Effizienter Transport und Darstellung der Zusatzeffekte
• Geringer Overhead, einfaches Erzeugen/Editieren/Verteilen/etc.
• Synchronisierung der Zusatzeffekte mit traditionellen Medien
(audio/video)
• Effiziente Berechnung der Lichteffekte
5. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV? 5

Vorführungen
Station 1
• Herkömmliche Filme (Fernsehen, DVD, Blu-ray)
– Zusatzeffekte: Licht, Vibration, Wind
Station 2
• Webseiten, Webvideos, YouTube
– Zusatzeffekte: Licht
Station 3
• Computerspiele, DTM Racer 3
– Zusatzeffekte: Licht, Vibration, Wind
„Außer Konkurrenz“
• P2P-NextTV
– Live-Fernsehen (BBC)
– BitTorrent Peer-to-Peer
5. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV? 6

Danke für Ihre Aufmerksam
... auf zu den Stationen …
Ass.-Prof. Dipl.-Ing. Dr. Christian Timmerer
Universität Klagenfurt, Institut für Informationstechnologie (ITEC)
Universitätsstrasse 65-67, A-9020 Klagenfurt, AUSTRIA
christian.timmerer@itec.uni-klu.ac.at
http://research.timmerer.com/
Tel: +43/463/2700 3621 Fax: +43/463/2700 3699
© Copyright: Christian Timmerer
75. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV?

Empfohlen

LNF2010: Was kommt nach 3DTV?

Alpen-Adria-Universität

Plataformas de redes sociales en la web

Jhon Edison Forero Salamanca

Anna Schmidt's Resume (3)

Anna Schmidt

Anna Schmidt has over 15 years of experience in administrative and project management roles across various industries including healthcare, finance, and education. She has a proven track record of managing multi-million dollar projects and budgets, developing staff, and ensuring smooth daily operations. Schmidt holds a Bachelor's degree in Education from Felician College and an Associate's degree from Lincoln College.

Ramons Cv Update2012

ramonguthrie

17 12-10

nabu1907

Y tú te llamas poeta,celina

Celina Arencibia

PAC1: Qué son los nuevos medios?

Javi Millán Molina

Este documento describe los principios fundamentales de los nuevos medios como la representación numérica, la modularidad, la automatización, la variabilidad y la transcodificación. Explica cómo a lo largo de la historia hubo avances paralelos entre los medios de masas y el procesamiento de datos que dieron lugar a los nuevos medios basados en ordenadores como Internet, multimedia y videojuegos.

Herramientas web 2.0 recopilacion

Tatiana P. A.

Empfohlen

LNF2010: Was kommt nach 3DTV?

Alpen-Adria-Universität

Plataformas de redes sociales en la web

Jhon Edison Forero Salamanca

Anna Schmidt's Resume (3)

Anna Schmidt

Ramons Cv Update2012

ramonguthrie

17 12-10

nabu1907

Y tú te llamas poeta,celina

Celina Arencibia

PAC1: Qué son los nuevos medios?

Javi Millán Molina

Herramientas web 2.0 recopilacion

Tatiana P. A.

Ln carta&comentario lector ley-ogden

Sierra Francisco Justo

Profesionalismo en la era digital

Rafael Bravo Toledo

El documento discute la necesidad de redefinir el profesionalismo médico en la era digital. Con la omnipresencia de Internet, es más difícil separar las identidades personales y profesionales de los médicos. Los médicos deben ser conscientes de lo que publican en línea y cómo esto puede afectar su relación con los pacientes. Se recomienda que realicen auditorías periódicas de su presencia digital y mantengan perfiles separados para fines personales y profesionales.

Revista steviana v6

Claudia Pereira

Steviana es una publicación de investigación primaria que cubre todas las líneas de trabajo en el campo de la Ciencias Botánicas y áreas relacionadas. Las subsecciones temáticas son: Conservación, Ecología, Etnobotánica y Botánica Económica Ficología, Fisiología y Biotecnología, Fitoquímica, Flora y Vegetación, Genética y Biología Molecular, Micología, Morfo-anatomía Vegetal, Sistemática y Taxonomía, Toxicología, entre otras. Cuenta con dos versiones, impresa (ISSN 2077-8430) y on line (ISSN 2304-2907) ambas con tirada anual. La revista se encuentra indexada desde el 2012 al Catálogo de Latindex con Nº de Folio 21767. Se publican investigaciones originales (artículos) y revisiones (reviews) sin costo para los autores. Los artículos publicados en Steviana, son de interés para especialistas dentro de este campo, cuyos resultados y conclusiones principales son inéditos. Los mismos pasan por una evaluación imparcial y critica realizado por especialistas ajenos al Comité Editorial, respaldando así la calidad de los trabajos publicados.

Procesadores de textos

Diego del Rio

El documento describe la evolución de los procesadores de texto desde las primeras máquinas de escribir mecánicas hasta los procesadores de texto modernos como Microsoft Word y OpenOffice. Se detalla el desarrollo de las máquinas de escribir eléctricas e IBM Selectric y cómo introdujeron medios de almacenamiento como cintas magnéticas y tarjetas, permitiendo la edición y corrección de textos. Posteriormente, surgen los primeros procesadores de texto para computadoras personales como WordPerfect, WordStar y MS Word, sentando las bases

Informe de Gestión 2013

mairenauribe18

Este documento presenta el informe de rendición de cuentas 2013 del municipio de Nariño, Antioquia. Bajo el lema "Por un cambio con igualdad", el alcalde Abelardo Antonio Arraut Bustamante describe las acciones realizadas en educación, salud, deporte, desarrollo comunitario y otras áreas. Se resaltan logros como la titulación de tierras a familias desplazadas, la inauguración de una tienda de paz, y el mejoramiento de indicadores como el puntaje en transparencia contractual. El documento detalla

Huellas de la escritura materna en español L2

Daniel Cassany

El documento resume investigaciones sobre la escritura en español como segunda lengua. Presenta dos casos de estudio sobre cómo personas de Taiwán y Túnez aprendieron a leer y escribir en su lengua materna, y cómo esto afectó su aprendizaje posterior del español. Concluye que debemos considerar la diversidad de experiencias de alfabetización de los estudiantes para ofrecer recursos flexibles que apoyen su aprendizaje del español.

Perfil candidato - inmigrante

INternacionalización y Desarrollo de ORganizaciones SAL

Acuam #ehealth credenciales 2015

PharmaChannel ®

Este documento resume las credenciales y servicios de Acuam Healthcare, una consultora especializada en estrategia de eHealth. La compañía se enfoca en la activación de pacientes y mapeo de salud para ayudar a empresas e instituciones a digitalizarse e innovar. Ofrece servicios como consultoría digital, desarrollo de sitios web y aplicaciones, investigación de mercado, gestión de redes sociales y más, utilizando un método basado en datos para medir el éxito de las campañas. Acuam trabaja con el objetivo de lograr

The CIOs new Job: Drive Customer-Centric Innovation Throughout Your Business ...

Integra

Mitel presents on customer-centric innovation at the 2014 Integra Tech Expo series. In today's global, consumer-driven economy, the only survivors will be those companies that are able to put the customer at the center of all their thinking and processes. Technology is the indispensable toolset that holds everything together and delivers the seamless connections customers are demanding. Will your IT department continue to be regarded as a cost center primarily concerned with internal processes rather than as a front-edge source of product innovation and customer engagement? Learn about innovations and trends to help you deliver on this new imperative.

Uc20 localizar gestionar_aplicar_automatizacion_almacenes

Geo Vásquez

Este documento describe los conocimientos y habilidades necesarios para localizar, gestionar y aplicar la automatización en almacenes. Explica cómo estudiar la metodología y aspectos determinantes de la ubicación de instalaciones, definir la localización internacional y métodos de análisis, llevar a cabo la gestión, planificación y diseño de almacenes, conocer la zonificación de almacenes y realizar la automatización y preparación de pedidos. También cubre las habilidades de trabajo individual, casos prácticos colaborativos

I Estudio de temáticas en la publicidad display

Adpv

Este documento presenta los resultados de un estudio sobre las temáticas en la publicidad display online. Se analizaron datos internos de 3,500 soportes y 1,619 campañas entre abril de 2009 y octubre de 2011. Se encontró una importante desviación entre la oferta de soportes y la demanda de anunciantes, aunque entretenimiento tuvo un buen balance. Entretenimiento, internet y tecnología fueron las temáticas más ofertadas, mientras que entretenimiento, viajes y finanzas tuvieron mayor demanda.

El arte románico (ii)

FRS1

Guardavidas

Maria Leticia Ditrani

Este documento proporciona información sobre un curso de guardavidas dictado por la Cruz Roja Argentina en Rosario entre 1947 y 2012. Detalla los requisitos para inscribirse en el curso, incluyendo la edad mínima, estudios completos y certificados médicos requeridos. También describe el examen de ingreso, el plan de estudios teórico y práctico, los títulos otorgados, los costos y las fechas clave del curso.

Kreativitätstechniken

christophc

Ce hv6 module 54 proxy server technologies

Vi Tính Hoàng Nam

WHO Global Tuberculosis report 2015

Niraj Bartaula

The 2015 Global Tuberculosis Report provides an overview of TB epidemiology and programmatic data from countries and regions around the world. It finds that in 2014 there were an estimated 9.6 million new TB cases and 1.5 million TB deaths. While case detection and treatment success rates have improved, global targets for reductions in prevalence and mortality rates by 2015 were not achieved. Drug-resistant TB also remains a major public health problem, with an estimated 480,000 new cases of MDR-TB in 2014. The report calls for increased investment and accelerated progress to end the global TB epidemic.

EL CULTO A DIOS SEGUN LA BIBLIA

alianzaevangelica

1. El documento define el culto a Dios según la Biblia como el reconocimiento de la persona y obras de Dios con una actitud de humildad, sumisión, veneración y adoración. 2. Explica que el culto verdadero a Dios es ordenado y producido por él mismo en los creyentes, no buscando lo que les gusta a los hombres. 3. Detalla diferentes actitudes requeridas para el culto como esclavo, representante, siervo y sacerdote, enfatizando la obediencia a lo ordenado por Dios

Gestión por categorías

Carmen Sanz Arilla

El documento describe los principales elementos de la gestión por categorías, incluyendo la definición de la categoría, el papel de la categoría, la valoración de la categoría, la tarjeta de puntuación de la categoría, la estrategia de la categoría, las tácticas de la categoría e implantación de la categoría. El objetivo general es desarrollar un enfoque estructurado para administrar cada categoría de productos de acuerdo con su contribución al negocio.

Clase a clase economía ii, phgcs, 2014

Emilio Jara Benavides

Este documento presenta la programación de las 9 sesiones de la asignatura de Economía II. Cada sesión incluye una descripción, lectura previa, preguntas de inicio y bibliografía. Las sesiones se enfocan en temas macroeconómicos como la medición del PIB, inflación, desempleo, demanda agregada e identidades macroeconómicas. El objetivo es que los estudiantes comprendan conceptos clave de la macroeconomía y puedan aplicarlos al análisis de la economía.

Immersive Social Television

Alpen-Adria-Universität

ScienceWednesday: Projekte des igdv und des Fb Media

mediencampus (h_da Darmstadt University of Applied Sciences)

MMP1 Vorbesprechung 2010Multimedia Production

Weitere ähnliche Inhalte

Andere mochten auch

Ln carta&comentario lector ley-ogden

Sierra Francisco Justo

Profesionalismo en la era digital

Rafael Bravo Toledo

Revista steviana v6

Claudia Pereira

Procesadores de textos

Diego del Rio

Informe de Gestión 2013

mairenauribe18

Huellas de la escritura materna en español L2

Daniel Cassany

Perfil candidato - inmigrante

INternacionalización y Desarrollo de ORganizaciones SAL

Acuam #ehealth credenciales 2015

PharmaChannel ®

The CIOs new Job: Drive Customer-Centric Innovation Throughout Your Business ...

Integra

Uc20 localizar gestionar_aplicar_automatizacion_almacenes

Geo Vásquez

I Estudio de temáticas en la publicidad display

Adpv

El arte románico (ii)

FRS1

Guardavidas

Maria Leticia Ditrani

Kreativitätstechniken

christophc

Ce hv6 module 54 proxy server technologies

Vi Tính Hoàng Nam

WHO Global Tuberculosis report 2015

Niraj Bartaula

EL CULTO A DIOS SEGUN LA BIBLIA

alianzaevangelica

Gestión por categorías

Carmen Sanz Arilla

Clase a clase economía ii, phgcs, 2014

Emilio Jara Benavides

Andere mochten auch (19)

Ln carta&comentario lector ley-ogden

Profesionalismo en la era digital

Revista steviana v6

Procesadores de textos

Informe de Gestión 2013

Huellas de la escritura materna en español L2

Perfil candidato - inmigrante

Acuam #ehealth credenciales 2015

The CIOs new Job: Drive Customer-Centric Innovation Throughout Your Business ...

Uc20 localizar gestionar_aplicar_automatizacion_almacenes

I Estudio de temáticas en la publicidad display

El arte románico (ii)

Guardavidas

Kreativitätstechniken

Ce hv6 module 54 proxy server technologies

WHO Global Tuberculosis report 2015

EL CULTO A DIOS SEGUN LA BIBLIA

Gestión por categorías

Clase a clase economía ii, phgcs, 2014

Ähnlich wie LNF2010: Was kommt nach 3DTV? Ein Fernseherlebnis für alle Sinne!

Immersive Social Television

Alpen-Adria-Universität

ScienceWednesday: Projekte des igdv und des Fb Media

mediencampus (h_da Darmstadt University of Applied Sciences)

MMP1 Vorbesprechung 2010Multimedia Production

MMP1 Videovorlesung 2010Multimedia Production

FKT Mediadaten 2010guest91e476f

Wie kommt der Professor auf mein Handy?

Martin Ebner

HoloLens in der Neurochirurgie

Netcetera

2015 06-30 ho-r_2ndscreen@lrftLokalrundfunktage

Ähnlich wie LNF2010: Was kommt nach 3DTV? Ein Fernseherlebnis für alle Sinne! (9)

Immersive Social Television

ScienceWednesday: Projekte des igdv und des Fb Media

MMP1 Vorbesprechung 2010

MMP1 Videovorlesung 2010

FKT Mediadaten 2010

Wie kommt der Professor auf mein Handy?

HoloLens in der Neurochirurgie

2015 06-30 ho-r_2ndscreen@lrft

Mehr von Alpen-Adria-Universität

Energy Efficient Video Encoding for Cloud and Edge Computing Instances

Alpen-Adria-Universität

Video Streaming: Then, Now, and in the Future

Alpen-Adria-Universität

In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.

VEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instances

Alpen-Adria-Universität

Video streaming constitutes 65 % of global internet traffic, prompting an investigation into its energy consumption and CO2 emissions. Video encoding, a computationally intensive part of streaming, has moved to cloud computing for its scalability and flexibility. However, cloud data centers’ energy consumption, especially video encoding, poses environmental challenges. This paper presents VEED, a FAIR Video Encoding Energy and CO2 Emissions Dataset for Amazon Web Services (AWS) EC2 instances. Additionally, the dataset also contains the duration, CPU utilization, and cost of the encoding. To prepare this dataset, we introduce a model and conduct a benchmark to estimate the energy and CO2 emissions of different Amazon EC2 instances during the encoding of 500 video segments with various complexities and resolutions using Advanced Video Coding (AVC) and High-Efficiency Video Coding (HEVC). VEED and its analysis can provide valuable insights for video researchers and engineers to model energy consumption, manage energy resources, and distribute workloads, contributing to the sustainability of cloud-based video encoding and making them cost-effective. VEED is available at Github.

GREEM: An Open-Source Energy Measurement Tool for Video Processing

Alpen-Adria-Universität

Addressing climate change requires a global decrease in greenhouse gas (GHG) emissions. In today’s digital landscape, video streaming significantly influences internet traffic, driven by the widespread use of mobile devices and the rising popularity of streaming platforms. This trend emphasizes the importance of evaluating energy consumption and the development of sustainable and eco-friendly video streaming solutions with a low Carbon Dioxide (CO2) footprint. We developed a specialized tool, released as an open-source library called GREEM , addressing this pressing concern. This tool measures video encoding and decoding energy consumption and facilitates benchmark tests. It monitors the computational impact on hardware resources and offers various analysis cases. GREEM is helpful for developers, researchers, service providers, and policy makers interested in minimizing the energy consumption of video encoding and streaming.

Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...

Alpen-Adria-Universität

In HTTP adaptive live streaming applications, video segments are encoded at a fixed set of bitrate-resolution pairs known as bitrate ladder. Live encoders use the fastest available encoding configuration, referred to as preset, to ensure the minimum possible latency in video encoding. However, an optimized preset and optimized number of CPU threads for each encoding instance may result in (i) increased quality and (ii) efficient CPU utilization while encoding. For low latency live encoders, the encoding speed is expected to be more than or equal to the video framerate. To this light, this paper introduces a Just Noticeable Difference (JND)-Aware Low latency Encoding Scheme (JALE), which uses random forest-based models to jointly determine the optimized encoder preset and thread count for each representation, based on video complexity features, the target encoding speed, the total number of available CPU threads, and the target encoder. Experimental results show that, on average, JALE yield a quality improvement of 1.32 dB PSNR and 5.38 VMAF points with the same bitrate, compared to the fastest preset encoding of the HTTP Live Streaming (HLS) bitrate ladder using x265 HEVC open-source encoder with eight CPU threads used for each representation. These enhancements are achieved while maintaining the desired encoding speed. Furthermore, on average, JALE results in an overall storage reduction of 72.70%, a reduction in the total number of CPU threads used by 63.83%, and a 37.87% reduction in the overall encoding time, considering a JND of six VMAF points.

VEEP: Video Encoding Energy and CO₂ Emission Prediction

Alpen-Adria-Universität

In the context of rising environmental concerns, this paper introduces VEEP, an architecture designed to predict energy consumption and CO2 emissions in cloud-based video encoding. VEEP combines video analysis with machine learning (ML)-based energy prediction and real-time carbon intensity, enabling precise estimations of CPU energy usage and CO2 emissions during the encoding process. It is trained on the Video Complexity Dataset (VCD) and encoding results from various AWS EC2 instances. VEEP achieves high accuracy, indicated by an 𝑅2-score of 0.96, a mean absolute error (MAE) of 2.41 × 10−5, and a mean squared error (MSE) of 1.67 × 10−9. An important finding is the potential to reduce emissions by up to 375 times when comparing cloud instances and their locations. These results highlight the importance of considering environmental factors in cloud computing.

Content-adaptive Video Coding for HTTP Adaptive Streaming

Alpen-Adria-Universität

In today’s dynamic streaming landscape, where viewers access content on various devices and en- counter fluctuating network conditions, optimizing video delivery for each unique scenario is imperative. Video content complexity analysis, content-adaptive video coding, and multi-encoding methods are fundamental for the success of adaptive video streaming, as they serve crucial roles in delivering high-quality video experiences to a diverse audience. Video content complexity analysis allows us to comprehend the video content’s intricacies, such as motion, texture, and detail, providing valuable insights to enhance encoding decisions. By understanding the content’s characteristics, we can effi- ciently allocate bandwidth and encoding resources, thereby improving compression efficiency without compromising quality. Content-adaptive video coding techniques built upon this analysis involve dy- namically adjusting encoding parameters based on the content complexity. This adaptability ensures that the video stream remains visually appealing and artifacts are minimized, even under challenging network conditions. Multi-encoding methods further bolster adaptive streaming by offering faster encoding of multiple representations of the same video at different bitrates. This versatility reduces computational overhead and enables efficient resource allocation on the server side. Collectively, these technologies empower adaptive video streaming to deliver optimal visual quality and uninter- rupted viewing experiences, catering to viewers’ diverse needs and preferences across a wide range of devices and network conditions. Embracing video content complexity analysis, content-adaptive video coding, and multi-encoding methods is essential to meet modern video streaming platforms’ evolving demands and create immersive experiences that captivate and engage audiences. In this light, this dissertation proposes contributions categorized into four classes:

Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video...

Alpen-Adria-Universität

Quality of Experience (QoE) and QoE models are of an increasing importance to networked systems. The traditional QoE modeling for video streaming applications builds a one-size-fits-all QoE model that underserves atypical viewers who perceive QoE differently. To address the problem of atypical viewers, this paper proposes iQoE (individualized QoE), a method that employs explicit, expressible, and actionable feedback from a viewer to construct a personalized QoE model for this viewer. The iterative iQoE design exercises active learning and combines a novel sampler with a modeler. The chief emphasis of our paper is on making iQoE sample-efficient and accurate. By leveraging the Microworkers crowdsourcing platform, we conduct studies with 120 subjects who provide 14,400 individual scores. According to the subjective studies, a session of about 22 minutes empowers a viewer to construct a personalized QoE model that, compared to the best of the 10 baseline models, delivers the average accuracy improvement of at least 42% for all viewers and at least 85% for the atypical viewers. The large-scale simulations based on a new technique of synthetic profiling expand the evaluation scope by exploring iQoE design choices, parameter sensitivity, and generalizability.

Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Vid...

Alpen-Adria-Universität

Optimizing Video Streaming for Sustainability and Quality: The Role of Prese...

Alpen-Adria-Universität

HTTP Adaptive Streaming (HAS) methods divide a video into smaller segments, encoded at multiple pre-defined bitrates to construct a bitrate ladder. Bitrate ladders are usually optimized per title over several dimensions, such as bitrate, resolution, and framerate. This paper adds a new dimension to the bitrate ladder by considering the energy consumption of the encoding process. Video encoders often have multiple pre-defined presets to balance the trade-off between encoding time, energy consumption, and compression efficiency. Faster presets disable certain coding tools defined by the codec to reduce the encoding time at the cost of reduced compression efficiency. Firstly, this paper evaluates the energy consumption and compression efficiency of different x265 presets for 500 video sequences. Secondly, optimized presets are selected for various representations in a bitrate ladder based on the results to guarantee a minimal drop in video quality while saving energy. Finally, a new per-title model, which optimizes the trade-off between compression efficiency and energy consumption, is proposed. The experimental results show that decreasing the VMAF score by 0.15 and 0.39 while choosing an optimized preset results in encoding energy savings of 70% and 83%, respectively.

Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Str...

Alpen-Adria-Universität

With the emergence of multiple modern video codecs, streaming service providers are forced to encode, store, and transmit bitrate ladders of multiple codecs separately, consequently suffering from additional energy costs for encoding, storage, and transmission. To tackle this issue, we introduce an online energy-efficient Multi-Codec Bitrate ladder Estimation scheme (MCBE) for adaptive video streaming applications. In MCBE, quality representations within the bitrate ladder of new-generation codecs (e.g., HEVC, AV1) that lie below the predicted rate-distortion curve of the AVC codec are removed. Moreover, perceptual redundancy between representations of the bitrate ladders of the considered codecs is also minimized based on a Just Noticeable Difference (JND) threshold. Therefore, random forest-based models predict the VMAF of bitrate ladder representations of each codec. In a live streaming session where all clients support the decoding of AVC, HEVC, and AV1, MCBE achieves impressive results, reducing cumulative encoding energy by 56.45%, storage energy usage by 94.99%, and transmission energy usage by 77.61% (considering a JND of six VMAF points). These energy reductions are in comparison to a baseline bitrate ladder encoding based on current industry practice.

Machine Learning Based Resource Utilization Prediction in the Computing Conti...

Alpen-Adria-Universität

This paper presents UtilML, a novel approach for tackling resource utilization prediction challenges in the computing continuum. UtilML leverages Long-Short-Term Memory (LSTM) neural networks, a machine learning technique, to forecast resource utilization accurately. The effectiveness of UtilML is demonstrated through its evaluation of data extracted from a real GPU cluster in a computing continuum infrastructure comprising more than 1800 computing devices. To assess the performance of UtilML, we compared it with two related approaches that utilize a Baseline-LSTM model. Furthermore, we analyzed the LSTM results against User-Predicted values provided by GPU cluster owners for task deployment with estimated allocation values. The results indicate that UtilML outperformed user predictions by 2% to 27% for CPU utilization prediction. For memory prediction, UtilML variants excelled, showing improvements of 17% to 20% compared to user predictions.

Evaluation of Quality of Experience of ABR Schemes in Gaming Stream

Alpen-Adria-Universität

The exponential growth of computer game streaming has led to the development of Quality of Experience (QoE) metrics to evaluate user satisfaction and enjoyment during online gameplay and live streaming. Adaptive Bitrate (ABR) streaming is a recent technology that has been suggested to improve QoE. This method enhances the streaming experience, upholds visual quality, minimizes stall events, and boosts player retention. It achieves this by estimating network bottlenecks and selecting appropriate versions of the content that best match the available bandwidth rather than adjusting encoding parameters. To investigate the correlation between quality switching and stall events, a subjective test was conducted separately and comparatively with 71 participants. For more detailed and in-depth research, video games were analyzed with the Video Complexity Analyzer (VCA) tool and divided into three categories of different genres, camera view, and temporal complexity heatmap from the two sets of normal and action scenes. This study seeks to shed light on three unresolved issues pertinent to QoE in game streaming: (i) the user preferences towards quality switching and stall events across varied scenes and games, (ii) the user inclinations towards either a single, prolonged stall event or multiple, shorter stall events, and (iii) the impact of conspicuous quality switching on the user’s QoE. Results from the study provided valuable insights, both qualitatively and quantitatively. The study found a marked preference among users for quality switching over stall events across all types of game streaming, irrespective of the scene’s intensity. Furthermore, it was observed that multiple short-stall events were generally favored over a single long-stall event in streaming first-person shooting games. Interestingly, approximately half of the participants remained oblivious to quality switching during their game viewing sessions, and among those who noticed a change in quality, the alteration did not significantly impact their perceived QoE.

Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, S...

Alpen-Adria-Universität

Multimedia applications, mainly video streaming services, are currently the dominant source of network load worldwide. In recent Video-on-Demand (VoD) and live video streaming services, traditional streaming delivery techniques have been replaced by adaptive solutions based on the HTTP protocol. Current trends toward high-resolution (e.g., 8K) and/or low- latency VoD and live video streaming pose new challenges to end-to-end (E2E) bandwidth demand and have stringent delay requirements. To do this, video providers typically rely on Content Delivery Networks (CDNs) to ensure that they provide scalable video streaming services. To support future streaming scenarios involving millions of users, it is necessary to increase the CDNs’ efficiency. It is widely agreed that these requirements may be satisfied by adopting emerging networking techniques to present Network-Assisted Video Streaming (NAVS) methods. Motivated by this, this thesis goes one step beyond traditional pure client- based HAS algorithms by incorporating (an) in-network component(s) with a broader view of the network to present completely transparent NAVS solutions for HAS clients.

Multi-access Edge Computing for Adaptive Video Streaming

Alpen-Adria-Universität

The document discusses research on using multi-access edge computing (MEC) to improve adaptive video streaming. It presents several contributions, including developing a MEC and HAS simulator called ANGELA, proposing dynamic segment repackaging at the edge to increase bandwidth savings, and designing edge-assisted adaptation schemes (EADAS and ECAS-ML) that leverage edge resources to guide client-based ABR algorithms and improve QoE and fairness. It also investigates segment prefetching policies at the edge such as ones based on last quality, Markov models, transrating, machine learning, and super-resolution.

Policy-Driven Dynamic HTTP Adaptive Streaming Player Environment

Alpen-Adria-Universität

In the last decades, video streaming has been developing significantly. Among current technologies, HTTP Adaptive Streaming (HAS) is considered the de-facto approach in multimedia transmission over the internet. In HAS, the video is split into temporal segments with the same duration (e.g., 4s), each of which is then encoded into different quality versions and stored at servers. The end user sends requests to the server to retrieve segments with specific quality versions determined by an Adaptive Bitrate (ABR) algorithm for the purpose of adapting the throughput fluctuation. Though the majority of HAS-based media services function well even under throughput restrictions and variations, there are still significant challenges for multimedia systems, especially the tradeoff among the increasing content complexity, various time-related requirements, and Quality of Experience (QoE). Content complexity encompasses the increased demands for data, such as high-resolution videos and high frame rates, as well as novel content formats, such as virtual reality (VR) and augmented reality (AR). Time-related requirements include – but are not limited to – start-up delay and end-to-end latency. QoE can be defined as the level of satisfaction or frustration experienced by the user of an application or service. Optimizing for one aspect usually negatively impacts at least one of the other two aspects. This thesis tackles critical open research questions in the context of HAS that significantly impact the QoE at the client side.

VE-Match: Video Encoding Matching-based Model for Cloud and Edge Computing In...

Alpen-Adria-Universität

The considerable surge in energy consumption within data centers can be attributed to the exponential rise in demand for complex computing workflows and storage resources. Video streaming applications are both compute and storage-intensive and account for the majority of today’s internet services. In this work, we designed a video encoding application consisting of codec, bitrate, and resolution set for encoding a video segment. Then, we propose VE-Match, a matching-based method to schedule video encoding applications on both Cloud and Edge resources to optimize costs and energy consumption. Evaluation results on a real computing testbed federated between Amazon Web Services (AWS) EC2 Cloud instances and the Alpen-Adria University (AAU) Edge server reveal that VE-Match achieves lower costs by 17%-78% in the cost-optimized scenarios compared to the energy-optimized and tradeoff between cost and energy. Moreover, VE-Match improves the video encoding energy consumption by 38%-45% and gCO2 emission by up to 80 % in the energy-optimized scenarios compared to the cost-optimized and tradeoff between cost and energy.

Energy Consumption in Video Streaming: Components, Measurements, and Strategies

Alpen-Adria-Universität

This document discusses energy consumption in video streaming. It identifies the key components that consume energy, including encoding, storage, networks, edge components, decoding, and displays. Measurement tools and challenges are also covered. Strategies to reduce energy usage at each component are proposed, such as efficient encoding, optimized bitrates, CDN optimization, and energy-aware networking. A holistic, end-to-end approach is needed to minimize total energy consumption in video streaming.

Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...

Alpen-Adria-Universität

The rapid growth of video streaming usage is a significant source of energy consumption, driven by improved internet connections and service offerings, the quick development of video entertainment, the deployment of Ultra High-Definition, Virtual and Augmented Reality, as well as an increasing number of video surveillance and IoT applications. However, it is essential to note that these advancements come at the cost of energy consumption. To address this challenge, it is essential to understand the various components involved in energy consumption during video streaming, ranging from video encoding to decoding and displaying the video on the end user’s screen. Then, it is critical to accurately measure energy consumption for each component and conduct an in-depth analysis to develop energy-efficient strategies that optimize video streaming. I categorize these components into three categories: (i) data centers, (ii) networks, and (iii) end-user devices. In this talk, my objective is to provide insights into the components of video streaming that contribute to energy consumption and highlight the challenges associated with measuring their energy usage. I will also introduce the tools that can be used for energy measurements for those components and the possible and associated strategies that lie within energy efficiency. By accurately measuring energy consumption, digital media companies can effectively monitor and control their energy usage, ultimately leading to cost savings and improved sustainability.

Video Coding Enhancements for HTTP Adaptive Streaming Using Machine Learning

Alpen-Adria-Universität

Video is evolving into a crucial tool as daily lives are increasingly centered around visual communication. The demand for better video content is constantly rising, from entertainment to business meetings. The delivery of video content to users is of utmost significance. HTTP adaptive streaming, in which the video content adjusts to the changing network circumstances, has become the de-facto method for delivering internet video. As video technology continues to advance, it presents a number of challenges, one of which is the large amount of data required to describe a video accurately. To address this issue, it is necessary to have a powerful video encoding tool. Historically, these efforts have relied on hand-crafted tools and heuristics. However, with the recent advances in machine learning, there has been increasing exploration into using these techniques to enhance video coding performance. This thesis proposes eight contributions that enhance video coding performance for HTTP adaptive streaming using machine learning.

Mehr von Alpen-Adria-Universität (20)

Energy Efficient Video Encoding for Cloud and Edge Computing Instances

Video Streaming: Then, Now, and in the Future

VEED: Video Encoding Energy and CO2 Emissions Dataset for AWS EC2 instances

GREEM: An Open-Source Energy Measurement Tool for Video Processing

Optimal Quality and Efficiency in Adaptive Live Streaming with JND-Aware Low ...

VEEP: Video Encoding Energy and CO₂ Emission Prediction

Content-adaptive Video Coding for HTTP Adaptive Streaming

Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video...

Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Vid...

Optimizing Video Streaming for Sustainability and Quality: The Role of Prese...

Energy-Efficient Multi-Codec Bitrate-Ladder Estimation for Adaptive Video Str...

Machine Learning Based Resource Utilization Prediction in the Computing Conti...

Evaluation of Quality of Experience of ABR Schemes in Gaming Stream

Network-Assisted Delivery of Adaptive Video Streaming Services through CDN, S...

Multi-access Edge Computing for Adaptive Video Streaming

Policy-Driven Dynamic HTTP Adaptive Streaming Player Environment

VE-Match: Video Encoding Matching-based Model for Cloud and Edge Computing In...

Energy Consumption in Video Streaming: Components, Measurements, and Strategies

Exploring the Energy Consumption of Video Streaming: Components, Challenges, ...

Video Coding Enhancements for HTTP Adaptive Streaming Using Machine Learning

LNF2010: Was kommt nach 3DTV? Ein Fernseherlebnis für alle Sinne!

1. Was kommt nach 3DTV? Ein Fernseherlebnis für alle Sinne! Christian Timmerer, Markus Waltl, Benjamin Rainer und Hermann Hellwagner Universität Klagenfurt (UNIKLU)  Fakultät für Technische Wissenschaften (TEWI) Institut für Informationstechnologie (ITEC)  Multimediakommunikation (MMC) http://research.timmerer.com  http://blog.timmerer.com  mailto:christian.timmerer@itec.uni-klu.ac.at Lange Nacht der Forschung, 5. November 2010, Universität Klagenfurt Acknowledgments. This work was supported in part by the EC in the context of the NoE INTERMEDIA (NoE 038419) and the ALICANTE project (FP7-ICT-248652).

2. Was kommt nach 3DTV? Ein Fernseherlebnis für alle Sinne! Warum? • (3D)TV => Hören und Sehen (2D/3D) • Mensch besitzt noch weitere Sinne wie Riechen, Tasten, Fühlen, usw. Was? • Alle Sinne sollen stimuliert werden, frei nach dem Motto „mittendrin statt nur dabei“! Wie? • Anreicherung von TV/Video/Web mit zusätzlichen Information (Metadaten) • Verwendung spezieller Geräte (z.B. Ventilatoren, Vibratoren, Klima- und Lichtanlagen) • Erzeugung von Zusatzeffekte (z.B. Explosion, Erdbeben, Sturm), welche alle Sinne stimmulieren sollen Wo? • Institut für Informationstechnologie, Multimediakommunikation • Raum: U31, Südtrackt, 2. Stock, E.2.42 5. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV? 2

3. Konzept 5. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV? 3 Mittendrin statt nur dabei!

4. Hardware 5. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV? 4 Wandfluter mit Steuereinheit Leuchten links und rechts Subwoofer Ventilatoren Vibrations-Handgelenkauflage Lautsprecher für 2.1- Sound

5. Forschungsaspekte / -fragen Qualität greifbar machen • (Qualitäts-)Erfahrungen quantifizieren • Gefühle/Emotionen: reale vs. fiktive Inhalte Zusatzeffekte automatisiert bereitstellen • Lichteffekte aus visuellen Inhalten extrahieren: durchschnittliche, dominante Farbwerte in Echtzeit • Vibrations- und Windeffekte basierend auf Inhaltsanalyse (geplant) Effizienter Transport und Darstellung der Zusatzeffekte • Geringer Overhead, einfaches Erzeugen/Editieren/Verteilen/etc. • Synchronisierung der Zusatzeffekte mit traditionellen Medien (audio/video) • Effiziente Berechnung der Lichteffekte 5. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV? 5

6. Vorführungen Station 1 • Herkömmliche Filme (Fernsehen, DVD, Blu-ray) – Zusatzeffekte: Licht, Vibration, Wind Station 2 • Webseiten, Webvideos, YouTube – Zusatzeffekte: Licht Station 3 • Computerspiele, DTM Racer 3 – Zusatzeffekte: Licht, Vibration, Wind „Außer Konkurrenz“ • P2P-NextTV – Live-Fernsehen (BBC) – BitTorrent Peer-to-Peer 5. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV? 6

7. Danke für Ihre Aufmerksam ... auf zu den Stationen … Ass.-Prof. Dipl.-Ing. Dr. Christian Timmerer Universität Klagenfurt, Institut für Informationstechnologie (ITEC) Universitätsstrasse 65-67, A-9020 Klagenfurt, AUSTRIA christian.timmerer@itec.uni-klu.ac.at http://research.timmerer.com/ Tel: +43/463/2700 3621 Fax: +43/463/2700 3699 © Copyright: Christian Timmerer 75. November 2010 Lange Nacht der Forschung, Was kommt nach 3DTV?