Suche senden
Hochladen
08 android multimedia_framework_overview
•
7 gefällt mir
•
4,759 views
Arjun Reddy
Folgen
android+multimedia framework
Weniger lesen
Mehr lesen
Technologie
Melden
Teilen
Melden
Teilen
1 von 29
Jetzt herunterladen
Downloaden Sie, um offline zu lesen
Empfohlen
Embedded Android : System Development - Part III (Audio / Video HAL)
Embedded Android : System Development - Part III (Audio / Video HAL)
Emertxe Information Technologies Pvt Ltd
Embedded Android : System Development - Part IV
Embedded Android : System Development - Part IV
Emertxe Information Technologies Pvt Ltd
Embedded Android : System Development - Part I
Embedded Android : System Development - Part I
Emertxe Information Technologies Pvt Ltd
Android media framework overview
Android media framework overview
Jerrin George
Embedded Android : System Development - Part II (HAL)
Embedded Android : System Development - Part II (HAL)
Emertxe Information Technologies Pvt Ltd
Android Audio System
Android Audio System
Yi-Hsiang Huang
Android Multimedia Support
Android Multimedia Support
Jussi Pohjolainen
Android's Multimedia Framework
Android's Multimedia Framework
Opersys inc.
Empfohlen
Embedded Android : System Development - Part III (Audio / Video HAL)
Embedded Android : System Development - Part III (Audio / Video HAL)
Emertxe Information Technologies Pvt Ltd
Embedded Android : System Development - Part IV
Embedded Android : System Development - Part IV
Emertxe Information Technologies Pvt Ltd
Embedded Android : System Development - Part I
Embedded Android : System Development - Part I
Emertxe Information Technologies Pvt Ltd
Android media framework overview
Android media framework overview
Jerrin George
Embedded Android : System Development - Part II (HAL)
Embedded Android : System Development - Part II (HAL)
Emertxe Information Technologies Pvt Ltd
Android Audio System
Android Audio System
Yi-Hsiang Huang
Android Multimedia Support
Android Multimedia Support
Jussi Pohjolainen
Android's Multimedia Framework
Android's Multimedia Framework
Opersys inc.
Android Things : Building Embedded Devices
Android Things : Building Embedded Devices
Emertxe Information Technologies Pvt Ltd
Embedded Android : System Development - Part II (Linux device drivers)
Embedded Android : System Development - Part II (Linux device drivers)
Emertxe Information Technologies Pvt Ltd
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
Opersys inc.
"Learning AOSP" - Android Hardware Abstraction Layer (HAL)
"Learning AOSP" - Android Hardware Abstraction Layer (HAL)
Nanik Tolaram
Learning AOSP - Android Linux Device Driver
Learning AOSP - Android Linux Device Driver
Nanik Tolaram
MediaPlayer Playing Flow
MediaPlayer Playing Flow
Javid Hsu
Android audio system(audioflinger)
Android audio system(audioflinger)
fefe7270
Understanding open max il
Understanding open max il
Chethan Pchethan
Embedded Android : System Development - Part III
Embedded Android : System Development - Part III
Emertxe Information Technologies Pvt Ltd
Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
Opersys inc.
Multimedia on android
Multimedia on android
Ramesh Prasad
U boot-boot-flow
U boot-boot-flow
BabuSubashChandar Chandra Mohan
Android audio system(오디오 플링거 서비스 초기화)
Android audio system(오디오 플링거 서비스 초기화)
fefe7270
Uboot startup sequence
Uboot startup sequence
Houcheng Lin
Android's HIDL: Treble in the HAL
Android's HIDL: Treble in the HAL
Opersys inc.
Linux Audio Drivers. ALSA
Linux Audio Drivers. ALSA
GlobalLogic Ukraine
Bootloaders
Bootloaders
Anil Kumar Pugalia
Q4.11: Porting Android to new Platforms
Q4.11: Porting Android to new Platforms
Linaro
Linux device drivers
Linux device drivers
Emertxe Information Technologies Pvt Ltd
Android Automotive
Android Automotive
Opersys inc.
A slightly deeper dive into Stagefright
A slightly deeper dive into Stagefright
Alexy Joseph
Fuzzing the Media Framework in Android
Fuzzing the Media Framework in Android
E Hacking
Weitere ähnliche Inhalte
Was ist angesagt?
Android Things : Building Embedded Devices
Android Things : Building Embedded Devices
Emertxe Information Technologies Pvt Ltd
Embedded Android : System Development - Part II (Linux device drivers)
Embedded Android : System Development - Part II (Linux device drivers)
Emertxe Information Technologies Pvt Ltd
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
Opersys inc.
"Learning AOSP" - Android Hardware Abstraction Layer (HAL)
"Learning AOSP" - Android Hardware Abstraction Layer (HAL)
Nanik Tolaram
Learning AOSP - Android Linux Device Driver
Learning AOSP - Android Linux Device Driver
Nanik Tolaram
MediaPlayer Playing Flow
MediaPlayer Playing Flow
Javid Hsu
Android audio system(audioflinger)
Android audio system(audioflinger)
fefe7270
Understanding open max il
Understanding open max il
Chethan Pchethan
Embedded Android : System Development - Part III
Embedded Android : System Development - Part III
Emertxe Information Technologies Pvt Ltd
Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
Opersys inc.
Multimedia on android
Multimedia on android
Ramesh Prasad
U boot-boot-flow
U boot-boot-flow
BabuSubashChandar Chandra Mohan
Android audio system(오디오 플링거 서비스 초기화)
Android audio system(오디오 플링거 서비스 초기화)
fefe7270
Uboot startup sequence
Uboot startup sequence
Houcheng Lin
Android's HIDL: Treble in the HAL
Android's HIDL: Treble in the HAL
Opersys inc.
Linux Audio Drivers. ALSA
Linux Audio Drivers. ALSA
GlobalLogic Ukraine
Bootloaders
Bootloaders
Anil Kumar Pugalia
Q4.11: Porting Android to new Platforms
Q4.11: Porting Android to new Platforms
Linaro
Linux device drivers
Linux device drivers
Emertxe Information Technologies Pvt Ltd
Android Automotive
Android Automotive
Opersys inc.
Was ist angesagt?
(20)
Android Things : Building Embedded Devices
Android Things : Building Embedded Devices
Embedded Android : System Development - Part II (Linux device drivers)
Embedded Android : System Development - Part II (Linux device drivers)
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
Using and Customizing the Android Framework / part 4 of Embedded Android Work...
"Learning AOSP" - Android Hardware Abstraction Layer (HAL)
"Learning AOSP" - Android Hardware Abstraction Layer (HAL)
Learning AOSP - Android Linux Device Driver
Learning AOSP - Android Linux Device Driver
MediaPlayer Playing Flow
MediaPlayer Playing Flow
Android audio system(audioflinger)
Android audio system(audioflinger)
Understanding open max il
Understanding open max il
Embedded Android : System Development - Part III
Embedded Android : System Development - Part III
Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
Multimedia on android
Multimedia on android
U boot-boot-flow
U boot-boot-flow
Android audio system(오디오 플링거 서비스 초기화)
Android audio system(오디오 플링거 서비스 초기화)
Uboot startup sequence
Uboot startup sequence
Android's HIDL: Treble in the HAL
Android's HIDL: Treble in the HAL
Linux Audio Drivers. ALSA
Linux Audio Drivers. ALSA
Bootloaders
Bootloaders
Q4.11: Porting Android to new Platforms
Q4.11: Porting Android to new Platforms
Linux device drivers
Linux device drivers
Android Automotive
Android Automotive
Andere mochten auch
A slightly deeper dive into Stagefright
A slightly deeper dive into Stagefright
Alexy Joseph
Fuzzing the Media Framework in Android
Fuzzing the Media Framework in Android
E Hacking
Android Multimedia Framework
Android Multimedia Framework
Picker Weng
Video Streaming
Video Streaming
University of Salford
Android audio system(audio_hardwareinterace)
Android audio system(audio_hardwareinterace)
fefe7270
The Streaming Audio Marketplace
The Streaming Audio Marketplace
RAINNews
Building an Android Scale Incident Response Process
Building an Android Scale Incident Response Process
Priyanka Aash
Art of public speaking
Art of public speaking
Imprint Training Center
Android audio system(오디오 출력-트랙활성화)
Android audio system(오디오 출력-트랙활성화)
fefe7270
Android Training (Media)
Android Training (Media)
Khaled Anaqwa
Farewell, Stagefright bugs!
Farewell, Stagefright bugs!
Tsukasa Oi
Stagefright (1)
Stagefright (1)
Mamoon Ismail Khalid
Android binder-ipc
Android binder-ipc
magoroku Yamamoto
4 multimedia basics
4 multimedia basics
Vedpal Yadav
Flash Video Streaming Business Models
Flash Video Streaming Business Models
Yoss Cohen
Stagefright
Stagefright
Imprint Training Center
Android audio system(오디오 출력-트랙생성)
Android audio system(오디오 출력-트랙생성)
fefe7270
The android activity lifecycle
The android activity lifecycle
Eng Chrispinus Onyancha
Video Streaming - 4.ppt
Video Streaming - 4.ppt
Videoguy
Surface flingerservice(서피스 출력 요청 jb)
Surface flingerservice(서피스 출력 요청 jb)
fefe7270
Andere mochten auch
(20)
A slightly deeper dive into Stagefright
A slightly deeper dive into Stagefright
Fuzzing the Media Framework in Android
Fuzzing the Media Framework in Android
Android Multimedia Framework
Android Multimedia Framework
Video Streaming
Video Streaming
Android audio system(audio_hardwareinterace)
Android audio system(audio_hardwareinterace)
The Streaming Audio Marketplace
The Streaming Audio Marketplace
Building an Android Scale Incident Response Process
Building an Android Scale Incident Response Process
Art of public speaking
Art of public speaking
Android audio system(오디오 출력-트랙활성화)
Android audio system(오디오 출력-트랙활성화)
Android Training (Media)
Android Training (Media)
Farewell, Stagefright bugs!
Farewell, Stagefright bugs!
Stagefright (1)
Stagefright (1)
Android binder-ipc
Android binder-ipc
4 multimedia basics
4 multimedia basics
Flash Video Streaming Business Models
Flash Video Streaming Business Models
Stagefright
Stagefright
Android audio system(오디오 출력-트랙생성)
Android audio system(오디오 출력-트랙생성)
The android activity lifecycle
The android activity lifecycle
Video Streaming - 4.ppt
Video Streaming - 4.ppt
Surface flingerservice(서피스 출력 요청 jb)
Surface flingerservice(서피스 출력 요청 jb)
Ähnlich wie 08 android multimedia_framework_overview
Transcoding 101
Transcoding 101
Videoguy
Audio and video streaming
Audio and video streaming
Rohan Bhatkar
Mpeg 7-21
Mpeg 7-21
Higher Education Department KPK, Pakistan
MPEG Standards. Know What Video Format to Choose MPEG-2 or MPEG-4.pdf
MPEG Standards. Know What Video Format to Choose MPEG-2 or MPEG-4.pdf
John Peterson
Video Transcoding Terms Explained
Video Transcoding Terms Explained
nerodude
Mini Project- Digital Video Editing
Mini Project- Digital Video Editing
University of Hertfordshire, School of Electronic Communications and Electrical Engineering
Slide
Slide
Videoguy
Pv Android Slides For Posting
Pv Android Slides For Posting
Marco Thompson
Windows7: Video Improvements
Windows7: Video Improvements
wonderu
Performance Analysis of Various Video Compression Techniques
Performance Analysis of Various Video Compression Techniques
International Journal of Science and Research (IJSR)
Video formats guide
Video formats guide
Paulo Vasques
Mpeg7
Mpeg7
Sanjeev Kumar Jaiswal
QuickTime and MPEG-4: Now Featuring H.264
QuickTime and MPEG-4: Now Featuring H.264
Videoguy
JPEG2000 Alliance IBC 2009
JPEG2000 Alliance IBC 2009
Hal J. Reisiger
Codecs
Codecs
Arpan Patel
DVO FAQ - Architecture Summary
DVO FAQ - Architecture Summary
Wm. Andrew Osterman
Audio and Video streaming.ppt
Audio and Video streaming.ppt
Videoguy
The H.264/AVC Advanced Video Coding Standard: Overview and ...
The H.264/AVC Advanced Video Coding Standard: Overview and ...
Videoguy
Hw2
Hw2
guest8244b5f
Web 2.0 Media
Web 2.0 Media
jrappold
Ähnlich wie 08 android multimedia_framework_overview
(20)
Transcoding 101
Transcoding 101
Audio and video streaming
Audio and video streaming
Mpeg 7-21
Mpeg 7-21
MPEG Standards. Know What Video Format to Choose MPEG-2 or MPEG-4.pdf
MPEG Standards. Know What Video Format to Choose MPEG-2 or MPEG-4.pdf
Video Transcoding Terms Explained
Video Transcoding Terms Explained
Mini Project- Digital Video Editing
Mini Project- Digital Video Editing
Slide
Slide
Pv Android Slides For Posting
Pv Android Slides For Posting
Windows7: Video Improvements
Windows7: Video Improvements
Performance Analysis of Various Video Compression Techniques
Performance Analysis of Various Video Compression Techniques
Video formats guide
Video formats guide
Mpeg7
Mpeg7
QuickTime and MPEG-4: Now Featuring H.264
QuickTime and MPEG-4: Now Featuring H.264
JPEG2000 Alliance IBC 2009
JPEG2000 Alliance IBC 2009
Codecs
Codecs
DVO FAQ - Architecture Summary
DVO FAQ - Architecture Summary
Audio and Video streaming.ppt
Audio and Video streaming.ppt
The H.264/AVC Advanced Video Coding Standard: Overview and ...
The H.264/AVC Advanced Video Coding Standard: Overview and ...
Hw2
Hw2
Web 2.0 Media
Web 2.0 Media
Kürzlich hochgeladen
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
apidays
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
MadyBayot
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
Andrey Devyatkin
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Drew Madelung
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
debabhi2
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
The Digital Insurer
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
Khem
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
Igalia
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
sammart93
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
MIND CTI
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
rafiqahmad00786416
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Jeffrey Haguewood
presentation ICT roal in 21st century education
presentation ICT roal in 21st century education
jfdjdjcjdnsjd
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
sudhanshuwaghmare1
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
apidays
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
Overkill Security
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
Nanddeep Nachan
Kürzlich hochgeladen
(20)
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
presentation ICT roal in 21st century education
presentation ICT roal in 21st century education
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
08 android multimedia_framework_overview
1.
Android Multimedia Framework Overview Li
Li, Solution and Service Wind River
2.
Agenda
What is Multimedia in a mobile device – MPEG standard – File format – Codec Android Multimedia Framework – OpenCORE – OpenMAX – What we can do with this 2 | © 2010 Wind River. All Rights Reserved.
3.
What is Multimedia
in mobile device Multimedia is the most important component in modern mobile device with modem – Multimedia framework is used to process video/audio input and output to satisfy certain functionality including Video and Audio – Storage video and audio in media Perfect! – Playback video and audio – Record video and audio Audio Audio, Video devices/input Video 3 | © 2010 Wind River. All Rights Reserved.
4.
Codec/Decode and File
Format What is their relationship – Container format specify how to wrap various meta-data/stream, most is coded data by codec – Theoretically, a container format could wrap any kinds of data, most container formats are specialized for specific data requirements – Container does not describe how the data warped is encoded. Always a program be able to identify and open a file ,but not be able to decode contained data. You maybe were told to download right decoder. 4 | © 2010 Wind River. All Rights Reserved.
5.
Codec/Decode and File
Format Codec/Decode – device or computer program capable of encoding and/or decoding a digital data stream or signal – A codec encodes a data stream or signal for transmission, storage or encryption and decode it for playback or editing. codec = coder + decoder – Raw multimedia data is huge, codec compress them to facilitate store and transfer 5 | © 2010 Wind River. All Rights Reserved.
6.
Codec/Decode and File
Format File Format – Also call container or wrapper format – Specify how different data elements and metadata coexist in a computer file or stream – Always contain coded video, coded audio, subtitles, chapter- information, maybe advertisement and synchronization information needed to playback various streams together 6 | © 2010 Wind River. All Rights Reserved.
7.
Codec/Decode and File
Format Codec - Audio – AAC, MPEG-4 Audio Part 3 subpart 4 – AC-3, Dolby Digital codec – AMR, Adaptive Multi-Rate Audio codec – AMR-WB, Adaptive Multi-Rate Wideband – MP2, MPEG1/2 Audio Layer II – MP3, MPEG2 Audio Layer III – Vorbis, OGG audio, opensource project – Wma, Windows Media Audio – RealAudio, RealNetwork – ALAC, Apple Lossless Audio Codec 7 | © 2010 Wind River. All Rights Reserved.
8.
Codec/Decode and File
Format Codec -Video – MPEG –1, MPEG –1 Part 2 – MPEG –2/H.262, MPEG –2 part 2 – MPEG –4 ASP, MPEG –4 Part 2 – MPEG –4 AVC/H.264, MPEG –4 Part 10 – VC –1 The informal name of SMTP 421M video codec standard Initially developed as a propriety video format by Microsoft before it was released as a formal SMPTE standard video format on April 3, 2006 – VC –2 An open and royalty-free video compression format, Dirac. 2010 the SMPTE standardized Dirac Pro as VC –2. – VC –3 DNXHD, Digital Nonlinear Extensible High Definition a lossy high-definition video post-production codec engineered for multi-generation compositing with reduced storage and bandwith requirements The DNXHD codec was submitted to the SMPTE organization as the framework for the VC-3 family of standard. 8 | © 2010 Wind River. All Rights Reserved.
9.
Codec/Decode and File
Format Standard MPEG – Moving Picture Experts Group. – A working group of ISO/IEC in charge of the development of international standards for compression, decompression, processing and coded representation of moving pictures audio and their combination The standard for storage and retrieval of moving pictures and audio on storage media. Approved Nov. 1992 – VCD – MP2, MPEG-1 Audio Layer II The standard for digital television. Approved Nov. 1994 – DVD – MP3, MPEG-2 Audio Layer III 9 | © 2010 Wind River. All Rights Reserved.
10.
Codec/Decode and File
Format MPEG -4 – The standard for multimedia application – a developing standard – divided into a number of parts Most are left to individual developers to decided whether to implement probably no complete implementations of the entrire MPEG-4 set of standards To deal with this, the standard includes concept of “profiles” and “levels” – allowing a specific set of capabilities to be defined in a manner appropriate for a subset of applications 10 | © 2010 Wind River. All Rights Reserved.
11.
Codec/Decode and File
Format – MPEG-4 part 2, Advanced Simple Profile used by codecs such as DiVX, Xvid, Nero Digital and 3ivx, Quicktime 6 – MPEG-4 part 10, MPEG-4 AVC (Advanced Video Coding)/H.264 used by x264 encoder, Nero Digital AVC, Quicktime 7, and high- definition video media like Blu-ray Disc 11 | © 2010 Wind River. All Rights Reserved.
12.
Codec/Decode and File
Format Video/Audio container – MPEG program stream standard container for MPEG-1 and MPEG-2 elementary streams on reasonably reliable media such as disks; used also on DVD- Video discs – MPEG-2 program stream, MPEG-TS Standard container for digital broadcasting and for transportation over unreliable media; used also on Blu-ray Disc Vedio; typically contains multiple video and audio stream, and an electronic program guide – MP4 Standard audio and video container for the MPEG-4 multimedia portfolio, based on MPEG-4 Part 12 and JPEG 2000 Part 12 12 | © 2010 Wind River. All Rights Reserved.
13.
What need to
do with Multimedia Container format parser to recognize and unwrap file Codec to encode/decode data. Synchronization among various stream Memory/Buffer management Stream track control, playback, backwards play, forward play Integrated into video/audio output system Take advantage of hardware accleration – Hardware codec – Hardware overlay – Hardware audio flinger 13 | © 2010 Wind River. All Rights Reserved.
14.
Android Multimedia Framework 14
| © 2010 Wind River. All Rights Reserved.
15.
OpenCORE – Initial
Android Multimedia Framework Android multimedia subsystem provided by PacketVideo – modular, extensible framework Combining independent media processing components file formats, codecs, streaming protocol components rendering compoments other elements in different ways to implement a wide variety of multimedia scenarios – abstraction a conception of NODE the base of the modulization Implementation in form of NODE for recognizer module, parser module, codec module, sink module 15 | © 2010 Wind River. All Rights Reserved.
16.
OpenCORE – Initial
Android Multimedia Framework 16 | © 2010 Wind River. All Rights Reserved.
17.
OpenCORE – Initial
Android Multimedia Framework ADEC Node Sink Node AMIO Sync Paser Node VDEC Node Sink Node VMIO File Handler OMX HW Codec OMX SW Codec Data Control Linux hardware codec driver 17 | © 2010 Wind River. All Rights Reserved.
18.
OpenCORE – Initial
Android Multimedia Framework Container Format Parser Composer MPEG4 yes yes 3GPP yes yes 3GPP2 yes no MP3 yes no AAC yes no AMR yes yes WAV yes no Type Codec Decoder Encoder Comments Video H.263 yes yes Baseline Profile MPEG-4 yes yes Simple Profile AVC/H.264 yes yes Constrained Baseline Profile Audio MP3 yes no AAC yes no AAC, HE-AAC v1/v2 AMR-NB yes yes AMR-WB yes no 18 | © 2010 Wind River. All Rights Reserved.
19.
OpenMAX – Bridge
Codec/Decode to Multimedia Framework the Integration Layer (IL) interface with Open Core – royalty-free, cross-platform API for comprehensive streaming media codec and application portability enable accelerated multimedia components to be developed, integrated and programmed across multiple operating systems and silicon platform – The OpenMAX API will be shipped with processors to enable library and codec Rapidly and effectively make use of the full acceleration potential of new silicon regardless of the underlying hardware architecture 19 | © 2010 Wind River. All Rights Reserved.
20.
OpenMAX - Framework 20
| © 2010 Wind River. All Rights Reserved.
21.
OpenMAX Position in
Android Multimedia Framework OpenCore OMX core OMX core (Software) (Hardware) Decoder Decoder Decoder Decoder Decoder Decoder Component Component Component Component Component Component H.263 H.264 AAC H263 H263 H263 21 | © 2010 Wind River. All Rights Reserved.
22.
OpenMAX API list
For each OMX core, there are function points need to be implmented. – pOMX_Init – pOMX_Deinit – pOMX_ComponentNameEnum – pOMX_GetHandle – pOMX_FreeHandle – pOMX_GetComponentsOfRole – pOMX_GetRoleofComponent – pOMX_SetupTunel – pOMX_GetContentPipe – pOMXConfigParser 22 | © 2010 Wind River. All Rights Reserved.
23.
One Sample of
Openmax Design 23 | © 2010 Wind River. All Rights Reserved.
24.
Commercialization
Functionality – Does you support enough container format – Does you support necessary codec – Does you support stream, video over air Performance, critical – Video performance. Frame per second – Audio performance. High quality sound – Synchronization between video and audio 24 | © 2010 Wind River. All Rights Reserved.
25.
Commercialization
Take advantage of SoC capability – Design OMX IL layer for specific hardware codec component – Design Overlay take advantage of hardware gpu or video output controller – Design high quality audio solution Whole system video buffer management scheme – Share memory buffer between various hardware component – Decrease memory copy as possible Synchronization scheme. Esp for some fault file – Choose the right point to fix sync problem. In parser or codec. 25 | © 2010 Wind River. All Rights Reserved.
26.
Commercialization
Video output Surface Flinger Overlay Data Overlay Control Gralloc V4L2 driver Framebuffer Video data Video Control GPU Other data&control 26 | © 2010 Wind River. All Rights Reserved.
27.
OpenCORE and Stagefright
Android introduce Stagefright to replace OpenCORE start from éclair Either OpenCORE or Stagefright is linked to MediaPlayerService, so application level never know about them Both of them based on same conecption, but take different implementation – Stagefright take parser and decode as a whole. Opencore take them as individual node – Stagefright take parser, decoder, sink/output as serial operation. Opencore take them as parallel – Different Sychronization mechanism Easier for Stagefright to develop parser Adopt OMX from OpenCORE 27 | © 2010 Wind River. All Rights Reserved.
28.
OpenCORE and Stagefright
Short point and Stong point – OpenCORE more stable and mature, low risk – OpenCORE supports more container format and codec – Stragefright is more easier to development. 28 | © 2010 Wind River. All Rights Reserved.
29.
29
| © 2010 Wind River. All Rights Reserved.
Jetzt herunterladen