2. Outline of Presentation
•
•
•
•
•
•
Introduction to Animated Pedagogical Agents
Perceptual User Interface Design
Emotionality Expressive Pedagogical Agents
Conclusions and Future Considerations
Acknowledgements
References

3. Introduction
What is an
animated
pedagogical
agent?

4. Characteristics
• Navigation
• Browsing
• Informational
Retrieval
• Sorting
• organization
• Filtering
• Reminding
• Programming
• Scheduling
• Advising
Work
Learning
• Coaching
• Tutoring
• Help
Information
Entertaining
• Playing against
• Playing with
• Performing
B. Laurel, “Interface Agents: Metaphors with Character,” in The Art of Human Computer Interface Design, B. Laurel, Ed. Readings, MA:
Addison-Wesley Publishing, 1990, pp. 355-365.

5. Characteristics
Agency
Accessibility
Animation
Gestures
Communication
Personality
Emotions
Competence
Responsiveness

6. Character Building Qualities
Herman The Bug

7. Perceptual User Interfaces
B. Reeves and C. Nass, “Perceptual Bandwidth,” Communications of the ACM, vol. 43, no. 3, pp. 65-70, 2000.
M. Turk and G. Robertson, “Perceptual User Interfaces,” Communications of ACM, vol. 43, no. 3, pp. 65-70, 2000.

8. Emotionality Expressive Pedagogical
Agents
Why integrate
emotion in
animated
pedagogical
agents?

9. Facial Expression of Emotions

10. Technology for Perception of Emotion

11. Conclusions and Future Research

12. Conclusions and Future Research
Perceptual
User Interface
Design
Integration of
facial
expressions
Six commonly
recognized
facial
expressions

13. Conclusions and Future Research
Perceptual
User Interface
Design
Experimental
investigation
Integration of
facial
expressions
Integration of
Face Reader
to behavioral
space
Six commonly
recognized
facial
expressions
Validation of
Face Reader
readings

14. Acknowledgements
Special thanks to:
A2-T2 and the Traumatic Brain Injury &
Hearing Rehabilitation Team for sharing
access to the Noldus Face Reader® application

15. References
[1] B. Laurel, “Interface Agents: Metaphors with Character,” in The Art
of Human Computer Interface Design, B. Laurel, Ed. Readings,
MA: Addison-Wesley Publishing, 1990, pp. 355-365.
[2] C.E. Heckman and J.O. Wobbrock, “Put Your Best Face Forward:
Anthropomorphic Agents, E-Commerce Consumers, and the Law,”
in Proceedings of the Fourth International Conference on
Autonomous Agents, 2000, pp. 435-442.
[3] B. Reeves and C. Nass, “Perceptual Bandwidth,” Communications
of the ACM, vol. 43, no. 3, pp. 65-70, 2000.
[4] M. Turk and G. Robertson, “Perceptual User Interfaces,”
Communications of ACM, vol. 43, no. 3, pp. 65-70, 2000.

16. References
[5] Y. Kim, A.L. Baylor and E. Shen, “Pedagogical Agents as Learning
Companions: The Impact of Agent Emotion and Gender,” Journal of
Computer Assisted Learning, vol. 23, pp. 220-234, 2007.
[6] S.D. Craig, B. Gholson and D.M. Driscoll, “Animated Pedagogical
Agents in Multimedia Educational Environments: Effects of Agent
Properties, Picture Features, and Redundancy,” Journal of
Educational Psychology, vol. 94, no. 2, pp. 428-434, 2002.
[7] L. Johnson, E. Shaw and R. Ganeshan (1998) Pedagogical Agent on
the Web. Available: http://www.isi.edu/isd/ADE/papers/its98/ITS98WW.htm
[8] W. L. Johnson, J.W. Rickel, and J.C. Lester, “Animated Pedagogical
Agents: Face-to-Face Interaction in Interactive Learning
Environments.” International Journal of Artificial Intelligence in
Education, vol. 11, 47-78, 2000.

17. References
[9] A.B. Adcock, M.H. Duggan, E.K. Nelson and C. Nickel, “Teaching
Effective Helping Skills at a Distance: The Development of Project
CATHIE,” The Quarterly Review of Distance Education, vol. 7, no.
4, pp. 349-360, 2006.
[10] T.W. Bickmore and R.W. Picard, “Establishing and Maintaining
Long-term Human Computer Relationships,” ACM Transaction of
Computer-Human Interaction, 12(2), 293-327.
[11] J.C. Lester, S.A. Converse, S.E. Kahler, S.T. Barlow, B.A. Stone
and R.S. Bhogal, “The Persona Effect: Affective Impact of
Animated Pedagogical Agents,” in Proceedings of 1997 Conference
on Human Factors in Computing Systems, 1997.
[12] R.K. Atkinson, “Optimizing Learning from Examples Using
Animated Pedagogical Agents,” Journal of Educational Psychology,
vol. 94, no. 2, pp. 416-427, 2002.

18. References
[13] B. Reeves and C. Nass, The Media Equation: How People
Treat Computers, Television, and New Media Like People and
Places. New York: Cambridge University Press, 1996.
[14] J. Bates, “The Role of Emotions in Believable Agents,”
Communications of ACM, vol. 37, no. 7, pp. 122-125, 1994.
[15] R.W. Picard, Affective Computing. Cambridge, MA: AddisonWesley Publishing.
[16] P. Ekman, Emotions Revealed. New York, NY: Holts
Paperbacks. 2007.
[17] H. Leventhal, “A Perceptual-Motor Processing Model of
Emotion,” in Perception of Emotions in Self and Others, vol. 5, P.
Pliner, K.R. Blankstein and I.M. Spinel, Ed. New York: Plenum.

19. References
[18] P. Ekman and W.V. Friesen, Unmasking the Face: A Guide to Recognizing
Emotions from Facial Expressions. Cambridge, MA: Malor Books, 2003.
[19] F. Thomas ad O. Johnson, Disney Animation: The Illusion of Life.
New York: Abbeville Press, 1981.
[20] B.E. Barbat and R. Cretulscu., “Affordable Affective Avatars:
Persuasion, Emotions and Language,” in Proceedings of the First
Balkan Conference in Informatics, 2003.
[21] J.C. Lester, S.G. Towns and P.J. Fitzgerald, “Achieving
Affective Impact: Visual Emotive Communication in Lifelike
Pedagogical Agent.” International Journal of Artificial
Intelligence in Education, vol. 10, 278-291, 1999.

20. Questions, comments and/or
suggestions?
For more information: eromero@odu.edu