Maemo Multimedia Framework for OMAP3 presentation on Maemo Summit in Berlin 2008

1. Multimedia Framework
Maemo Summit Berlin 2008
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

2. MMFs Delivery
●
MM APIs: GStreamer, Helix, OpenMAX, ...
●
Codecs on ARM and DSP
●
PulseAudio
●
A few UIs for settings
●
Accessory detection
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

3. Usage
●
existing
– Media Player
– VoIP/Video Call and Skype
●
new
– Metadata
– Media Capture
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

4. GStreamer
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

5. MMF Challenges
●
Hardware acceleration for codecs
●
Reuse for new hardware
●
Multimedia Policy & Routing
●
Stable & coherent middleware
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

6. Past Architecture
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

7. Issues & Problems
●
Audio on DSP Video on ARM
– Not so good for power-management
– Not enough processing power on arm side for video
●
Combined decoder sinks / encoder sources
– dspmp3sink, dspilbcsrc
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

8. New Architecture
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

9. Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

10. OMAP 3430
●
500 MHz
●
Can be up to 3 times faster
●
http://www.ti.com/omap3430
140
120
100
80
omap 2
60
omap 3
40
20
0
MPEG4 h264
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

11. New Software I
●
OpenMAX
– Used for codecs
– No more dsp sinks and sources
●
PulseAudio
– Audio routing & policy
– Audio pre- & postprocessing
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

12. New Software II
●
gst-qa-system : insanity
– Improved testing
●
Camera-bin
– High level api for still-image and video capture
– GStreamer plugin
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

13. Developer Support
●
TI DSP Bridge, OpenMAX, DSP examples
●
https://omapzoom.org/gf/
●
BeagleBoard wiki
●
http://elinux.org/BeagleBoard
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

14. Demos
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

15. Thank you!
Questions?
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras