The normal interaction with computers is with keyboard and a mouse. For display a rectangular somewhat small screen is used with 2D windowing systems. The mouse was invented more the 40 years ago and has been for 20 years dominant input. Now we are seeing new types of input devices. Multi-touch adds new dimensions and new applications. Natural user interfaces or gesture interfaces where people point to drag objects. Computers are also beginning to recognize facial expressions of people, so it knows if you are smiling. Voice and natural language understanding is getting to a usable stage. All this calls all types of new applications. Displays are getting bigger. What if any surface was a screen? If you could spray the wall with screen? Or have you phone project images to the wall. This lectures explores some of these new types of interactions with computers and software. It makes the old mouse look old.

1. Lecture L14
INTERACTING WITH TECHNOLOGY

2. Evolution of Computers
2

3. 3

4. 4

5. 5

6. 6

7. Consumer Devices
The Computer and the
Internet
disappear

9. Future of PC
Big Brian, Small Brain
Cloud Computing and home Serves
Everything will be connected: computer, TV, Phone, etc.
Cloud computing
Ubiquitous network access
Wireless
Simpler specialised operating systems
Better friction of devices
Computers will be smaller and integrated into things
Better interfaces
New input methods

10. Future of the Desktop Metaphor

11. Xerox Early GUIs
Goal: Emulate the
office environment
in a computer

12. Macintosh 1984

13. Windows 3.0

14. Operating Systems Today
More choices, less important
Ubuntu
Mac
OS
X
Windows

15. Is the desktop metaphor dead?
15

16. 16

17. FORGOT TO
SAVE YOUR FILE?
17

20. What do people do with computes desktop, laptop, tablet, smartphone - today?
Communication - talk, messages
Reading
Take/View Photos
Watch Movies
Shopping
Browse the Internet
Read news
Write documents, blogs
Financial transactions
Learning

21. Microsoft Bill Buxton on
Natural User Interfaces
21

23. “My
specialty
is
people.”
–
Bill
Buxton
23

24. The Next Device

25. IBM 5150 - 33 years ago

26. Macintosh - 30 years ago

27. Dell Desktop PC - Today
27

28. Lenovo Carbon X1 Laptop - Today

29. The world in 2010
Computers
Smartphone
Netbooks
Laptop
Desktop
29

30. iPad 2010 - “The iPad Effect”
30

31. 31

32. The iPad Effect
Multi-touch input
Software Platform – apps
Real OS
The computer just became
a consumer device
32

33. The iPad Effect
Tablets are disrupting the netbook/laptop/PC market
Killing papers and magazines
Change in life style
Is this new market disruption also?
33

35. The world in 2014
Smartphone
Netbooks
Tablet
Laptop
Desktop

36. DIGITAL WORLD
VIDEO
WATCHING
RELAXED
SOFTWARE
WORK
FOCUS
APPS
VIEW/BROWSE
ENTERTAIN
APPS
CHECK
NOW!

37. From Mary Meeker’s slide deck.

38. What’s the next device?

40. Device on your arm

42. Virtual Reality Headset

44. Glasses
44

45.
Bluedouche
45

46. How can Augmented Reality improve
our live and work?
46

48. Augmented Reality

53. Gesture-control system
!
Leap Motion
53

55. Gesture Control Armband
!
Myo
55

57. Brian waves as input
57

62. Voice Recognition

63. BEFORE
Desktop, laptops
Now
Mobile, tablets, smartphones
66

64. BEFORE
Desktop metaphor, mouse
keyboard
Now
Gesture, audio, touch
67

65. INTERACTING WITH TECHNOLOGY!
!
NEXT:
THE BROADCAST CENTURY

66. New Technology 2014