1. ARTIFICIAL PASSENGER By, Mohammad Iqbal 3PG05CS024

2. Contents Introduction Background of the invention Why Such System ? Architecture Working Components Applications Advantages and Disadvantages Future Applications Conclusion Bibliography

3. Introduction What is an artificial passenger? “ The AP is an artificial intelligence–based companion that will be resident in software and chips embedded in the automobile dashboard ”. What does it do? Detects alarm conditions through sensors. Broadcasts pre-stored voice messages over the speakers. Captures images of the driver

4. Background of the invention IBM (International Business Machines Corporation, Newyork ) has developed a software that holds the conversation with driver to determine whether the driver can respond alertly enough, called “Artificial Passenger”. The name was firstly suggested in an article in new scientist magazine. This was designed to make solo journey safer and more bearable.

5. Why Such System? According to a national survey in UK and USA, it is observed that the driver fatigue annually causes, 100000 crashes 15000 deaths 71000 injuries which causes annual cost of $12.5 billions. Majority of off-road accidents observed were preceded by eye closure of half and even2-3 seconds where the normal human eye blinks at 0.2-0.3 seconds.

6. Fig: Showing the dashboard of the car where the whole artificial system is generally attached

7. Devices used in AP The main devices that are used in this artificial passenger are:- Eye tracker or Camera. Voice recognizer or speech recognizer. Touch sensors.

8. Architecture Server Temperature indicator Microphone Camera Network Artificial Passenger Speaker Door lock Odor sensor Key

9. Working Components There are some of the components which supports for the working of the system: Automatic Speech Recognizer (ASR) Natural Language Processor (NLP) Driver analyzer Conversational planner (CP) Alarm Microphone Camera

10. Working Components( contd.) Automatic speech recognition :- There are two ASRs used in the system: First one is “speaker independent” and used for decoding voice signals of the driver. Second one operates with voice car media and decodes tapes, audio book, telephone mails etc.

11. Working Components (contd.) Natural language processor : - Processes the decoded signals of textual data provided from the ASR. Identifies related meanings from the contents of the decoded messages. Produces variant of responses. This output goes to the driver analyzer as an input.

12. Working Components (contd.) Driver analyzer :- Receives the textual data and voice data. Measures the time response using a clock. Analysis is both subjective and objective. Time responses, conclusions about driver’s alertness will output to the conversational planner.

13. Working Components (contd.) Conversational planner:- It is the heart of the system. Instructs the language generator to produce the response. If the driver is in perfect condition CP instructs the language generator to continue the conversation otherwise it is instructed to change the conversation.

14. Working Components (contd.) Alarm:- If the CP (conversational planner) receives information that the driver is about to fall asleep an alarm system is activated. Microphone:- For picking up the words and separate them by some internally used software for conversation.

15. Working Components (contd.) Camera:- This will track the lip movements of the driver. Used for the improvement for the accuracy of the speech recognition.

16. Working … External Service Provider Adapter Driver Analyzer NLP Tapes Car Media Voice Text Clock Books Phone Conversational Planner Driver Profile ASR ASR Radio Word Spotting Web Language generator Language Constraints Intelligent text Processor Speaker Recognizer Speech generator Alarm Driver Camera

17. Advantages and Disadvantages Advantages:- Artificial Passenger is broadly used to prevent accident. Artificial Passenger component establishes interface with other drivers very easily. If the driver gets a heart attack or he is drunk it will send signals to vehicles nearby about this so driver there become alert Disadvantages:- It is costly. It can only be installed to high profiled cars.

18. Application Prevents the driver, falling asleep during long and solo trip. In any problem it alerts the vehicles near by this, so the driver there become alert. Opens and closes the doors and windows of the car automatically. It is also used for the entertainment. This system can also be used in other situations such as Security guard Operators at nuclear plants Pilots of airplane

19. Future Application Will provide us with a shortest-time routing based on road conditions changing because of weather and traffic, information of about the cars on the route, destination requirement (as flight has been delayed).

20. Conclusion Successful implementation of artificial passenger would allow use of various services in car like reading e-mails, navigation, downloading music files, voice games without compromising a driver safety.

21. Bibliography L R Bhal et al. “Performance of the IBM speech recognition system ” www.ieee.org www.esnips.com www.wikipedia.com www.slideshare.com www.answers.com www.google.com

22. Thank you