1. ARPA (later DARPA) funded groundbreaking early research in augmented reality and human-computer interaction in the 1960s, including Ivan Sutherland's head-mounted display, JCR Licklider's concepts of human-computer symbiosis, and Douglas Engelbart's augmentation of human intellect.
2. Key ARPA researchers like Licklider and Bob Taylor established a culture of funding university research to advance these fields in new ways.
3. This early research in augmented displays, artificial intelligence, and network communication helped establish many of the foundational concepts that current AR technology is building upon.
6. NOTES:
What is Augmented Reality?
AR is not a technology unto itself, but a collection of technologies brought together to
achieve a given result, so it is not a simple question to answer.
7. NOTES: (shown: Bruce Sterling, Vernor Vinge, Amber Case)
Bruce asked the same question of attendees at the Augmented Reality Event keynote
speakersâ dinner in May of last year. It would be the subject of his opening keynote. At
the time, my self-serving special effects house answer was, âSpecial effects, rendered
in real time, over real life.â A broader definition might be, âInterjection of virtual content into oneâs
sensory perception, within the context of the real world.â
8. NOTES:
For the purposes of our presentation, we are going to make some assumptions.
Augmented Reality defined as some combination of these four technologies, when used
together.
9. NOTES:
Also â What this talk is, and is not.
It is not a claim that ARPA invented Augmented Reality half a century ago and weâre
just catching up with them. It is, however, an argument that many of the core concepts
behind what we know of as AR were part-and-parcel of the research being funded by ARPA,
and furthermore, that this work was being done without our preconceived notions about what a
personal computer is. Human augmentation was, in fact, at the core of their research.
15. NOTES:
The US responded by creating ARPA, the Advanced Research Projects Agency, with
the mandate to fund rocket and missile research, and to put satellites into space.
17. NOTES:
This was all during the Eisenhower administration. Eisenhower was an advocate of
NASA.
From the start, ARPA faced a crisis of purpose: Its mandate was taken from it â rocket research
was transferred to NASA, missile research was assumed by the various branches of the military,
and ARPA was adrift. The need for its very existence questioned.
18. NOTES:
In 1962 ARPAâs third Director, Jack Ruina, was busy managing the design of an
incoming-missile early warning system. He was tasked by the Pentagon to create two
new departments ...
19. NOTES:
Both new departments would fund research into computer / human interaction.
One was a Behavioral Sciences department, and the other was for Command and
Control.
Jack believe he had the perfect candidate to lead both, and they would shortly be merged into
what became the IPTO: the Information Processing and Techniques Office.
20. NOTES:
Tell anecdote: âJCR Licklider, but you can call me âLickâ.â
Tell anecdote: Much to colleagues dismay, Licklider resigned from MIT the year he
made tenure. After joining Bolt, Beranek & Newman, he would shift again to the public sector, as
the founding director of the IPTO.
21. NOTES:
There was another candidate: Lickliderâs friend Fred Frick, of MITâs Lincoln Laboratory.
24. NOTES:
Lickliderâs background was in Psycho-Acoustics.
Not an electrical engineer, or engineer of any kind. An HR department would have never
considered him for this position.
26. NOTES:
According to Licklider â henceforth, man and computer would co-evolve ... this, at a
time when computers were rare, huge and expensive; punchcards were the common
interface, and even by those who used them, were generally looked upon as little more
than glorified calculators.
28. NOTES:
1930s â A âComputerâ was a title given to women who did computations by calculator.
29. NOTES:
1936 â Alan Turing creates the Turing machine, a conceptual machine for binary
computation and algorithms.
30. NOTES:
1946 â transition from mechanical analog to electrical analog. Eniac has a patch cable
interface. In its lifespan, Eniac alone did more calculations than all of mankind up until
that point in human history.
37. NOTES:
The Univac was the first commercially available computer with magnetic storage and
direct keyboard access.
Tell anecdote: Though innovative, not a commercial success, due to companiesâ large
investments in existing IBM standards, including punchcards.
39. NOTES:
1958 âLight Gun interface, shown here used on SAGE (Semi Automatic Ground
Environment) aircraft tracking system.
40. NOTES:
One point worth noting about Lickliderâs Man Computer Symbiosis is that he made clear
this was not a âtoolâ relationship. The computer was not the newest tool along the lines
of the wheel, or the locomotive, this was true symbiosis.
41. NOTES:
He anticipated a time when our interface with computers would be through talking to
them. It cannot be overstated, that this was in the time of punch-cards.
42. NOTES:
Possibly the most important thing Licklider brought to ARPA was agency culture.
He was nicknamed, Johnny Appleseed.
Tell anecdote: Declined purchase of or building of agency laboratories, choosing instead to
fund research done at different universities and other institutions. It did not have to be this way.
Licklider established that, and it has been maintained, now via DARPA, to this day.
44. NOTES:
ARPA financed Artificial Intelligence research done by Marvin Minsky, inventor of the
worldâs first artificial neural network.
45. NOTES:
Due to its discretion in dispersing money, ARPA had a huge influence over what kind
of research was done, and what work was not, and the director of the IPTO could
essentially steer research across the field.
48. NOTES:
Then Sutherland became the 3rd Director of the IPTO. Shown here, he took an idea of
his mentorâs, the head mounted display, and saw it to actualization. It was stereoscopic,
and transparent (viewing virtual content over oneâs view of the real world).
Tell anecdote: My phone call with Ivan Sutherland in 2011, attempting to hire him as a speaker.
49. NOTES:
Sutherlandâs description of the use of a transparent lens head mounted display from his
paper, The Ultimate Display, gives what is still one of the most common use-cases for
advanced AR eyewear.
51. NOTES:
The invention and adoption of the integrated circuit. Gordon Moore (cofounder of Intel)
and Mooreâs Law: The number of transistors that can be placed on an integrated circuit
doubles approximately every two years.
56. NOTES:
Was poached by ARPA from NASA.
Taylor was first interviewed by Licklider, and hired by Sutherland to be his Deputy
Director. He was groomed to take the helm â the succession plan.
57. NOTES:
Tell anecdote: Amazing parallels in Taylor & Lickliderâs lives.
Both were sons of ministers. Both were psychologist. Both studied psycho-acoustics.
Got his masters in psycho-acoustics at The University of Texas at Austin.
58. NOTES:
Another thing Licklider and Taylor had in common: They were both already funding
research being done at the Stanford Research Institute.
60. NOTES:
At his Augmentation Research Center.
Tell anecdote: The invention of the mouse (with Bill English).
61. NOTES:
Douglas wrote an influential paper, itself influenced by Lickliderâs Man Computer
Symbiosis, titled Augmented Human Intellect, a Conceptual Framework.
And as the name says, it is a framework.
62. NOTES:
In it, he makes the case for advancing human-computer interface design, whereby
computers would come to be âAugmentation Systemsâ to the human mind.
63. NOTES:
All of this work culminated in a presentation that has now come to be know as the
Mother of All Demos, performed by Douglas Engelbart at the Fall Joint Computer
Conference held at the San Francisco Convention Center in December of 1968.
First public demonstration of a Mouse, of hyper-text, of video conferencing, and ...
64. NOTES:
The first public announcement of the ARPAnet, predecessor to the Internet.
Tell anecdote: How Bob Taylor got the financing to build the ARPAnet in one
20 minute conversation with Charlie Herzfeld.
66. NOTES:
1. Ivan Sutherlandâs head mounted display.
2. JCR Lickliderâs Man Computer Symbiosis.
3. Douglas Engelbartâs Augmented Human Intellect & Augmentation Research Center.
4. Marvin Minskyâs artificial intelligence research.
But itâs clearly more than just a checklist.
67. NOTES:
Some post ARPA history.
Bob Taylor became the Founding Director of Xerox Parc Research Center, poaching a
lot of talent from Douglas Engelbart, in the process.
Tell anecdote: Bob Taylor on the myth that Xerox didnât capitalize on Xerox Parc.
Tell anecdote: Where Steve Jobs first saw the graphical user interface that inspired the Mac.
69. NOTES:
Boeing engineer, Tom Caudel coined the term âAugmented Realityâ in 1991.
Tell anecdote: Caudel, safety goggles, and the Boeing assembly line.
70. NOTES:
The same year that Caudel coined the term Augmented Reality,
the top grossing action film was, Terminator 2.
71. NOTES:
In the mid-90s Paul Milgram and Haruo Takemura publish a paper that introduces what
has come to be known as Milgramâs Continuum.
72. NOTES:
By the late 90s the first functional mobile Augmented Reality system was developed for
the PhD project of Blair MacIntyre and his professor, Steve Feiner. Blair is now Director
of the Augmented Environments Lab at Georgia Tech, and Steve continues to teach
Computer Science at Columbia.
75. NOTES:
A Vision for whatâs to come.
Before dedicated AR eyewear ever have potential to go mainstream, I expect to see
Bluetooth mobile accessories ... for your eyes.
76. NOTES:
Was impressed with the form factor of the Docomo/Olympus collaboration from 2011.
Whether by docomo/olympus, or another brand or team, this is the form factor I expect
the first successful eyewear to take. I also speculate we will see something in market in the next
12 to 18 months.
80. NOTES:
You can learn more about the state of AR at Augmented Reality Event, held this year
on May 8-9, 2012, at the Santa Clara Convention Center, in Santa Clara, CA.