Developing the Next Generation Embedded HMIs – Phil Burr With more and more people using smartphones it is no surprise that more and more people are demanding better HMIs in other products: whether it is in their set top box, refrigerator, or car, users have come to expect graphically rich dynamic HMIs. This is all very well, but what is a humble developer to do when confronted with the constraints of their embedded device. This presentation examines the options for embedded developers needing to implement these latest HMIs and looks at tools and techniques which can help developers meet or exceed their customer’s HMI expectations.

1. Developing
Embedded
Automotive HMI
& IVI
Phil Burr,
Director, HMI Product Marketing
mentor.com/embedded

2. Overview
Mentor Graphics
Established in 1981
Over 4,700 Employees
Annual Revenues of ~$1Bn
The only EDA company with embedded
software since 1996
Award winning support in 53 locations
worldwide
Mentor Embedded
Comprehensive product and services for embedded development
Solutions include Nucleus, software, tools, and services
Independent software provider with 300 engineers and worldwide support
Acquired Montavista automotive business - Mentor now #1 automotive
Linux company!

3. When HMI was simple
3

4. HMIs today
4

5. Embedded Software in Transportation
Complexity & Cost Rising…
Millions of Lines
Source: http://spectrum.ieee.org/green-tech/advanced-cars/this-car-runs-on-code
5

6. IVI Design Challenges …
Open Source Driver
Distraction
Migration to Linux Best
Hardware
Telematics
HMI
Performance
Connected
Car
Android
Multi-Mode
Function Support
User Inputs
Consolidation
Apps

7. Linux-based IVI systems now available
Linux has strong pedigree in consumer electronics and
enterprise networking
– A natural fit for advanced IVI systems
Rather than adding consumer features to a traditional
―automotive OS,‖ OEMs using Linux can
– Take advantage of a vibrant ecosystem
– Work with active communities of world-class developers
– Re-use mountains of pre-existing open source code, which
can be modified for automotive use

8. Cultural challenges
The automotive industry is very competitive.
Sharing even non-differentiating software elements
among competitors is a relatively new phenomenon.
Putting your own work, your own code, your own IP
into the ―wilds‖ of open source
– The benefits difficult to grasp versus the risks
– Often a hard sell within any company, even those with
some Linux experience in their enterprise

9. A second challenge: IVI is different than consumer
In-vehicle infotainment can
– work side-by-side with consumer device
– share many of the same features
– even compete with consumer products
Good fit for Linux-based software found in CE devices
But IVI devices
– have more stringent requirements
– include automotive-specific functions
– will almost always have features proprietary to the device
maker
– require a long product life

10. The GENIVI Alliance
A non-profit organization of over 130 of the top
automotive OEMs and their suppliers
Driving adoption of open source in IVI
– Addressing automotive/cultural concerns
– Providing a collaboration environment for its members to
contribute jointly on essential but non-differentiating
middleware
GENIVI members then each build competitive products
with unique HMI and advanced applications

11. HTML5

12. What is HTML5?
Core app execution and Web
Audio &
GUI rendering model Video Sockets
Touch SVG
Additional APIs for events
functions, services,
utilities, connectivity Geo
etc. Canvas HTML CSS3 Location
2D
Supports offline as well
as connected apps Javascript Web
Workers
WebGL
Browser-specific app …and
Drag & more!
packaging and Drop Web
installation Storage

13. HTML5 platform
HTML5 APPS BROWSER
- Navigation
- Tabs
WEB CORE - Bookmarks
- Execution - History
- Rendering HTML CSS3 - Cache
- App lifecycle - Cookies
- Security - Etc.
- Performance Javascript
- Etc.
Vehicle HTML5
APIs APIs

14. Why HTML5?
Ubiquitous technology Audio &
Video
Web
Sockets
SVG
Touch
events
Open (de-facto) standard Geo
Canvas HTML CSS3 Location
2D
Guaranteed longevity Web
Javascript Workers
WebGL
Wide availability of skills Drag &
…and
more!
Drop Web
Storage
High-level, easy app development
Native system secure from app layer
Good for enabling app ecosystems
Model for late app deployment/customization
Portability of apps

15. Challenges with HTML5
Performance Audio &
Video
Web
Sockets
SVG
Touch
events
Resource requirements Geo
Canvas HTML CSS3 Location
2D
Weak for high-end 3D graphics Web
Javascript Workers
WebGL
Security concerns Drag &
…and
more!
Drop Web
Storage
Mentor provides technology and services to OEMs
and Tier-1 suppliers to enable our customers to
successfully make the transition to HTML5

16. Mentor Embedded Tools and Services for
IVI

17. Infotainment Solution Components
HMI
• 3D Design Tools
• HTML5, Qt
• Smart Phone Integration
Applications
• Demo templates & 3rd-
party Alliances
IVI Foundation
• Services, Libraries and
middleware
Operating System
• GENIVI Linux and
Software Device Drivers
Hardware
• High-performance CPU,
GPU, Peripherals

18. Mentor’s HTML5 Solution
HTML5 application platform based on Chromium
– Integrated and tested as a component of Mentor
Embedded IVI Platform
– GENIVI compliant or integrated through GENIVI APIs, as
appropriate
Our global team of HTML5 and Linux professionals
– Support, maintenance and updates
– Porting and testing services on new platforms
– Integration and development services

19. GENIVI Participation
Mentor is on main GENIVI board
GENIVI Expert Group tracking / participation
– System Infrastructure (Loaders, Initialization)
– Automotive (Diagnostics, Software tools)
– Media and Graphics (Tuners, Broadcast, DVD)
– Location Based Services (Positioning, Navigation)
– Networking
– Consumer Electronics, Social Media, Connectivity, Bluetooth, iPad,..
– Mobile Office
– Application Framework (Speech Recognition, HMI, Text to speech)
19

20. Making the transition to open source
Mentor Embedded is helping both OEMs and Tier One
suppliers make this transition
– Simplifying the design process
– Cost-effective differentiated solutions
– Silicon supplier choice, HMI differentiation, and overall cost
savings
– Open innovation without sacrificing product control

21. Mentor Beyond GENIVI
 Human Machine Interface – HMI
 Inflexion, Qt, HTML5
 3rd party User Applications / Integration Services
 Hardware Platform and software drivers (BSPs)
 Other domains
 Android, AutoSAR, ADAS
 System Integration and Test
 Design Tool Support
 Services
21

22. HMI Design – Mentor Inflexion
Design Host Run-time target
Inflexion UI Express Inflexion Runtime

23. HMI Design : Inflexion UI Express
 Desktop solution for capturing HMIs, later driven by run-time engine
 Features include: 3D, Glossing, Shading, Reflections
 OpenGL ES Support
23

24. Connected Smart Phone with CCC
■ Benefits:
— In-Car Internet
— In-Car Android App Access
— Technology Refresh solved
■ CCC connection via USB, WiFi
■ Android Phones now Networking Speech Engine
IVI
Navigation Audio
— Galaxy III Stack
Entertainment Telephony
— Nokia Mobile Office Cloud
■ Apple iOS also needed

25. Android Guest OS via Hypervisor
Common HMI
Graphics Layer Management
Networking
Android
Navigation
IVI Apps.
Stack Entertainment
Mobile Office
Linux OS Android OS
HyperVisor Hypervisor Partner
ARM Multi-core CPU
SoC
GPU, Peripherals
25

26. Linux Container (LXC) Android Solution
Common HMI
Graphics Layer Management
Android Apps
Networking
Navigation
IVI Android OS
Entertainment
Stack
Mobile Office
Linux Container
Mentor IVI Linux OS / LXC Resource Management
Hardware Layer Multi-Core CPU GPU

27. Mentor advantages …
• We Understand HMI
• We know how to build complex, performant HMI’s, implementing Graphics Layer
Manager technology, with multiple video sources, (Qt, HTML5, Ifx etc).
• Complete Solution Stack
• We have the relationships and expertise from HMI down to hardware platforms.
Tools, Product IP, OSS, Services
• Safe Choice
• Mentor Graphics is a global > $1bn company, able to manage the risk and
commit to on-time, on-budget deliveries
• Embedded OS
• We have a GENIVI compliant Linux, Nucleus RTOS, Android and Automotive
Autosar solutions
• Design Environment
• Market-leading design capture and debug with Codebench , MESA, Probes
• BSP
• Close relationships with SoC vendors, BSP hardening

28. Integrated IVI Solutions from Mentor
GENIVI LINUX
HTML5 & Qt
SoC
Open
Platforms
Source
3rd-party IVI Software
software
Mentor Software
Mentor Services

29. Thank you!
Questions?
For more information, please contact:
phillip_burr@mentor.com
mentor.com/embedded