SlideShare ist ein Scribd-Unternehmen logo
1 von 32
Understanding
Cognitive Systems
Jim Spohrer (IBM)
HICSS 50th, January 4, 2017
http://www.slideshare.net/spohrer/understanding_20170104_v10
1/5/2017 Understanding Cognitive Systems 1
1/5/2017 Understanding Cognitive Systems 2
Today’s Talk: Understanding Cognitive Systems
• What is a cognitive system (entity)…
• Biological?
• Digital?
• How to…
• Build them?
• Understand them?
• Work with them?
• Steps toward a next generation
cognitive curriculum…
• Types of digital cognitive systems?
• Types of courses?
1/5/2017 Understanding Cognitive Systems 3
Jim Spohrer
(Maine, MIT, Verbex, Yale, Apple, IBM, …)
What is a biological cognitive system (BCS entity)?
1/5/2017 Understanding Cognitive Systems 4
What is a digital cognitive system (DCS entity)?
1/5/2017 Understanding Cognitive Systems 5
Build them (BCS)?
10 million minutes of experience
1/5/2017 Understanding Cognitive Systems 6
Build them (BCS)?
2 million minutes of experience
1/5/2017 Understanding Cognitive Systems 7
Build them (DCS)?
Computers, data, building blocks & service offerings
1/5/2017 Understanding Cognitive Systems 8
Build them (BCS + DCS)?
Socio-technical system design
hardware < software < data < experience < transformation
1/5/2017 Understanding Cognitive Systems 9
Understand them?
• Observe Them: Predictable and Auditable?
• BCS: Sometimes predictable and auditable (natural, evolved, experiences, free will)
• DCS: Mostly predictable and auditable (artificial, designed, algorithms, blockchain)
• Hardware:
• BCS: Brain-based (neurons)
• DCS: Microprocessor-based (transistors)
• Software:
• BCS: (People and Experiences) Evolution & Psychology, Cognitive Science
• DCS: (Machines and Algorithms) Design & Engineering, Computer Science
• Data, Experience, Transformation?
• BCS & DCS: External environment & sensing (Data), Internal processes,
communications, storage (Information & experience), Philosophy of life, values
(Transformation)
1/5/2017 Understanding Cognitive Systems 10
Work with them? Circa 2016…
1/5/2017 Understanding Cognitive Systems 11
Steps Toward a Next Generation
Cognitive Curriculum
• 2016
• “How to build a cognitive system for Q&A task.”
• 9 months to 40% question answering accuracy
• 1-2 years for 90% accuracy, which questions to reject
• 2026
• “How to use cognitive assistants to be a better professional X.”
• Tools to build a student level Q&A from textbook in 1 week
• 2036
• “How to use your cognitive mediator to build a startup.”
• Tools to build faculty level Q&A for textbook in one day
• Cognitive mediator knows a person better (in some ways)
than they know themselves (identity & responsibility)
• 2046 & 2056
• “How to manage your workforce of digital workers.”
• 2046: 10 digital workers each; 2056: 100 digital workers each
1/5/2017 12
Next Generation Cognitive Curriculum:
Intelligence Building Blocks
1/5/2017 Understanding Cognitive Systems 13
• Intelligence
Augmentation (IA)
• Science
• Design
• Business
• Society
• Interdisciplinary
• Artificial
Intelligence (AI)
• Learning
• Perception
• Reasoning
• Interaction
• Knowledge
1/5/2017 Understanding Cognitive Systems 14
Prof. Pieter Abbeel (UC Berkeley)
1/5/2017 Understanding Cognitive Systems 15
1/5/2017 Understanding Cognitive Systems 16
1/5/2017 Understanding Cognitive Systems 17
1/5/2017 Understanding Cognitive Systems 18
1/5/2017 Understanding Cognitive Systems 19
Commonsense Reasoning
Fluid Conversations
Ingesting Textbooks
What types of digital cognitive systems (DCS)?
• Cognitive Build: Outthink Challenge (250K people)
• Imagine a digital cognitive system to help you do
something important in your personal or professional
lives
• Team to design it and advocate for it, and then everyone
votes
• Winners: reduce waste and human suffering, screen for
health issues and safety threats, learn life skills and make
better choices, find what you are looking for, move
around more effectively, provide emotional support,
provide IT support, learn about important public policy
goals and make better choices
• Types: Tool, Assistant, Collaborator, Coach, Mediator
1/5/2017 Understanding Cognitive Systems 20
Types
• Tool
• Assistant
• Collaborator
• Coach
• Mediator
1/5/2017 Understanding Cognitive Systems 21
Types:
Model/Capability/Challenge (+ = relative difficulty level)
1/5/2017 Understanding Cognitive Systems 22
DCS Type Improvement Model/
Learning/
Data
Task Model/
Perception/
Variety
Self Model/
Reasoning/
Commonsense
User Model/
Interaction/
Episodic Memory
World Model/
Knowledge/
Legal Trust
Tool + ++ + + +
Assistant ++ +++ +++ ++ ++
Collaborator +++ +++ +++ ++++ +++
Coach ++++ ++++ ++++ +++++ +++++
Mediator +++++ +++++ +++++ +++++ +++++++
tool assistant collaborator coach mediator
Sample existing courses
• AI MOOCs (Next Slide)
• Watson Innovation Course
• http://crowdtruth.org/course/watson-innovation-course-2016/
1/5/2017 Understanding Cognitive Systems 23
AI MOOCs: Circa 2016
1/5/2017 Understanding Cognitive Systems 24
1/5/2017 25
1956 1976 1996 2016 2036 2056
Personal Reflections:
The building blocks are getting better
Maine MIT, Verbex, Yale Apple IBM
1/5/2017 26
Come visit IBM Research – Almaden
in San Jose, CA USA – monthly university day!
Dedication: Douglas C. Engelbart
Father of the mouse and augmentation theory
1/5/2017
© IBM 2015, IBM Upward University Programs Worldwide
accelerating regional development
27
Remember, this stuff is still really hard…
1/5/2017
© IBM UPWard 2016
28
Cognitive Science, a young field
• Society
• cognitivesciencesociety.org
• People
• Founders: Roger Schank, Donald Norman,
Allan Collins
• Others: David Rumelhart, Herbert Simon,
Allen Newell
• Today: Patrick Langley, Wayne Gray,
Kenneth Forbus, Ashok Goel, Paul Maglio,
etc.
• Systems Conference
• cogsys.org
• (JCS wishes this was part of HICSS)
1/5/2017 Understanding Cognitive Systems 29
Advances in Cognitive Systems - cogsys.org
1/5/2017 Understanding Cognitive Systems 30
Google Search: August 26, 2016
1/5/2017 Understanding Cognitive Systems 31
Work with them?
1/5/2017 Understanding Cognitive Systems 32

Weitere ähnliche Inhalte

Andere mochten auch

Cases for chesbrough 201304122 v2
Cases for chesbrough 201304122 v2Cases for chesbrough 201304122 v2
Cases for chesbrough 201304122 v2
ISSIP
 

Andere mochten auch (8)

Rebuilding evolution 20170106 v4
Rebuilding evolution 20170106 v4Rebuilding evolution 20170106 v4
Rebuilding evolution 20170106 v4
 
Empowering makers in the cognitive era 20161203 v5
Empowering makers in the cognitive era 20161203 v5Empowering makers in the cognitive era 20161203 v5
Empowering makers in the cognitive era 20161203 v5
 
Ken Forbus presented “Software Social Organisms: Implications for measuring ...
Ken Forbus  presented “Software Social Organisms: Implications for measuring ...Ken Forbus  presented “Software Social Organisms: Implications for measuring ...
Ken Forbus presented “Software Social Organisms: Implications for measuring ...
 
Cases for chesbrough 201304122 v2
Cases for chesbrough 201304122 v2Cases for chesbrough 201304122 v2
Cases for chesbrough 201304122 v2
 
Infosys Amplifying Human Potential
Infosys Amplifying Human PotentialInfosys Amplifying Human Potential
Infosys Amplifying Human Potential
 
Cognitive Computing: Challenges and opportunities in Building an Artificial I...
Cognitive Computing: Challenges and opportunities in Building an Artificial I...Cognitive Computing: Challenges and opportunities in Building an Artificial I...
Cognitive Computing: Challenges and opportunities in Building an Artificial I...
 
Ibm welcome and cognitive 20170322 v7
Ibm welcome and cognitive 20170322 v7Ibm welcome and cognitive 20170322 v7
Ibm welcome and cognitive 20170322 v7
 
Culture
CultureCulture
Culture
 

Ähnlich wie Understanding 20170104 v10

NCME Big Data in Education
NCME Big Data  in EducationNCME Big Data  in Education
NCME Big Data in Education
Philip Piety
 

Ähnlich wie Understanding 20170104 v10 (20)

T shaped cognitive 20170221 v2
T shaped cognitive 20170221 v2T shaped cognitive 20170221 v2
T shaped cognitive 20170221 v2
 
Nas integrated education 20170406 v2
Nas integrated education 20170406 v2Nas integrated education 20170406 v2
Nas integrated education 20170406 v2
 
Csls 20160821 v1
Csls 20160821 v1Csls 20160821 v1
Csls 20160821 v1
 
Nas integrated education 20170406 v7
Nas integrated education 20170406 v7Nas integrated education 20170406 v7
Nas integrated education 20170406 v7
 
Nsf 20180124 v18
Nsf 20180124 v18Nsf 20180124 v18
Nsf 20180124 v18
 
Nas integrated education 20170406 v5
Nas integrated education 20170406 v5Nas integrated education 20170406 v5
Nas integrated education 20170406 v5
 
Smart 20171006 v20
Smart 20171006 v20Smart 20171006 v20
Smart 20171006 v20
 
Smart 20171006 v19
Smart 20171006 v19Smart 20171006 v19
Smart 20171006 v19
 
Wow 20161023 v1
Wow 20161023 v1Wow 20161023 v1
Wow 20161023 v1
 
Classroom of the futurev3
Classroom of the futurev3Classroom of the futurev3
Classroom of the futurev3
 
China caas 20161015 v5
China caas 20161015 v5China caas 20161015 v5
China caas 20161015 v5
 
Issip nsf smart service systems 20170329 v1
Issip nsf smart service systems 20170329 v1Issip nsf smart service systems 20170329 v1
Issip nsf smart service systems 20170329 v1
 
NCME Big Data in Education
NCME Big Data  in EducationNCME Big Data  in Education
NCME Big Data in Education
 
Korea day1 keynote 20161013 v6
Korea day1 keynote 20161013 v6Korea day1 keynote 20161013 v6
Korea day1 keynote 20161013 v6
 
Future 20171110 v14
Future 20171110 v14Future 20171110 v14
Future 20171110 v14
 
Learning Analytics in Higher Education
Learning Analytics in Higher EducationLearning Analytics in Higher Education
Learning Analytics in Higher Education
 
Chabot 20180404 v5
Chabot 20180404 v5Chabot 20180404 v5
Chabot 20180404 v5
 
Ai trends 20170627 v9
Ai trends 20170627 v9Ai trends 20170627 v9
Ai trends 20170627 v9
 
On data-driven systems analyzing, supporting and enhancing users’ interaction...
On data-driven systems analyzing, supporting and enhancing users’ interaction...On data-driven systems analyzing, supporting and enhancing users’ interaction...
On data-driven systems analyzing, supporting and enhancing users’ interaction...
 
Digital Business
Digital BusinessDigital Business
Digital Business
 

Mehr von ISSIP

AI and Education 20240327 v16 for Northeastern.pptx
AI and Education 20240327 v16 for Northeastern.pptxAI and Education 20240327 v16 for Northeastern.pptx
AI and Education 20240327 v16 for Northeastern.pptx
ISSIP
 
Brno-IESS 20240207 v11 service-science ai.pptx
Brno-IESS 20240207 v11 service-science ai.pptxBrno-IESS 20240207 v11 service-science ai.pptx
Brno-IESS 20240207 v11 service-science ai.pptx
ISSIP
 
Brno-IESS 20240205 v9 service-science ai.pptx
Brno-IESS 20240205 v9 service-science ai.pptxBrno-IESS 20240205 v9 service-science ai.pptx
Brno-IESS 20240205 v9 service-science ai.pptx
ISSIP
 
Spohrer Open Innovation Reflections 20230911 v2.pptx
Spohrer Open Innovation Reflections 20230911 v2.pptxSpohrer Open Innovation Reflections 20230911 v2.pptx
Spohrer Open Innovation Reflections 20230911 v2.pptx
ISSIP
 
Spohrer Terraces 20230711 v17.pptx
Spohrer Terraces 20230711 v17.pptxSpohrer Terraces 20230711 v17.pptx
Spohrer Terraces 20230711 v17.pptx
ISSIP
 

Mehr von ISSIP (20)

AI and Education 20240327 v16 for Northeastern.pptx
AI and Education 20240327 v16 for Northeastern.pptxAI and Education 20240327 v16 for Northeastern.pptx
AI and Education 20240327 v16 for Northeastern.pptx
 
Semiconductors 20240320 v14 corrected slides.pptx
Semiconductors 20240320 v14 corrected slides.pptxSemiconductors 20240320 v14 corrected slides.pptx
Semiconductors 20240320 v14 corrected slides.pptx
 
Semiconductors 20240320 v14 Narayanasamy event.pptx
Semiconductors 20240320 v14 Narayanasamy event.pptxSemiconductors 20240320 v14 Narayanasamy event.pptx
Semiconductors 20240320 v14 Narayanasamy event.pptx
 
UCSC-SV HCI_Masters 20240308 v13 AI.pptx
UCSC-SV HCI_Masters 20240308 v13 AI.pptxUCSC-SV HCI_Masters 20240308 v13 AI.pptx
UCSC-SV HCI_Masters 20240308 v13 AI.pptx
 
UCSC Tech4Good 20240306 v12 David_Lee Leadership_and_Career
UCSC Tech4Good 20240306 v12 David_Lee Leadership_and_CareerUCSC Tech4Good 20240306 v12 David_Lee Leadership_and_Career
UCSC Tech4Good 20240306 v12 David_Lee Leadership_and_Career
 
Brno-IESS 20240207 service-science ai-era v12.pptx
Brno-IESS 20240207 service-science ai-era v12.pptxBrno-IESS 20240207 service-science ai-era v12.pptx
Brno-IESS 20240207 service-science ai-era v12.pptx
 
Brno-IESS 20240207 v11 service-science ai.pptx
Brno-IESS 20240207 v11 service-science ai.pptxBrno-IESS 20240207 v11 service-science ai.pptx
Brno-IESS 20240207 v11 service-science ai.pptx
 
Brno-IESS 20240205 v9 service-science ai.pptx
Brno-IESS 20240205 v9 service-science ai.pptxBrno-IESS 20240205 v9 service-science ai.pptx
Brno-IESS 20240205 v9 service-science ai.pptx
 
Brno-IESS 20240206 v10 service science ai.pptx
Brno-IESS 20240206 v10 service science ai.pptxBrno-IESS 20240206 v10 service science ai.pptx
Brno-IESS 20240206 v10 service science ai.pptx
 
NordicHouse 20240116 AI Quantum IFTF dfiscussionv7.pptx
NordicHouse 20240116 AI Quantum IFTF dfiscussionv7.pptxNordicHouse 20240116 AI Quantum IFTF dfiscussionv7.pptx
NordicHouse 20240116 AI Quantum IFTF dfiscussionv7.pptx
 
20240104 HICSS Panel on AI and Legal Ethical 20240103 v7.pptx
20240104 HICSS  Panel on AI and Legal Ethical 20240103 v7.pptx20240104 HICSS  Panel on AI and Legal Ethical 20240103 v7.pptx
20240104 HICSS Panel on AI and Legal Ethical 20240103 v7.pptx
 
Bayesian_40Years_Celebration 20231217 v2.pptx
Bayesian_40Years_Celebration 20231217 v2.pptxBayesian_40Years_Celebration 20231217 v2.pptx
Bayesian_40Years_Celebration 20231217 v2.pptx
 
NextCollab Hallucinations 202311280 v1.pptx
NextCollab Hallucinations 202311280 v1.pptxNextCollab Hallucinations 202311280 v1.pptx
NextCollab Hallucinations 202311280 v1.pptx
 
EIT-Digital_Spohrer_AI_Intro 20231128 v1.pptx
EIT-Digital_Spohrer_AI_Intro 20231128 v1.pptxEIT-Digital_Spohrer_AI_Intro 20231128 v1.pptx
EIT-Digital_Spohrer_AI_Intro 20231128 v1.pptx
 
Ntegra 20231003 v3.pptx
Ntegra 20231003 v3.pptxNtegra 20231003 v3.pptx
Ntegra 20231003 v3.pptx
 
ICServ2023 20230914 v8.pptx
ICServ2023 20230914 v8.pptxICServ2023 20230914 v8.pptx
ICServ2023 20230914 v8.pptx
 
Spohrer Open Innovation Reflections 20230911 v2.pptx
Spohrer Open Innovation Reflections 20230911 v2.pptxSpohrer Open Innovation Reflections 20230911 v2.pptx
Spohrer Open Innovation Reflections 20230911 v2.pptx
 
Spohrer Terraces 20230711 v17.pptx
Spohrer Terraces 20230711 v17.pptxSpohrer Terraces 20230711 v17.pptx
Spohrer Terraces 20230711 v17.pptx
 
Worker Productivity 20230628 v1.pptx
Worker Productivity 20230628 v1.pptxWorker Productivity 20230628 v1.pptx
Worker Productivity 20230628 v1.pptx
 
Spohrer GAMP 20230628 v17.pptx
Spohrer GAMP 20230628 v17.pptxSpohrer GAMP 20230628 v17.pptx
Spohrer GAMP 20230628 v17.pptx
 

Kürzlich hochgeladen

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
SanaAli374401
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
MateoGardella
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
MateoGardella
 

Kürzlich hochgeladen (20)

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 

Understanding 20170104 v10

  • 1. Understanding Cognitive Systems Jim Spohrer (IBM) HICSS 50th, January 4, 2017 http://www.slideshare.net/spohrer/understanding_20170104_v10 1/5/2017 Understanding Cognitive Systems 1
  • 3. Today’s Talk: Understanding Cognitive Systems • What is a cognitive system (entity)… • Biological? • Digital? • How to… • Build them? • Understand them? • Work with them? • Steps toward a next generation cognitive curriculum… • Types of digital cognitive systems? • Types of courses? 1/5/2017 Understanding Cognitive Systems 3 Jim Spohrer (Maine, MIT, Verbex, Yale, Apple, IBM, …)
  • 4. What is a biological cognitive system (BCS entity)? 1/5/2017 Understanding Cognitive Systems 4
  • 5. What is a digital cognitive system (DCS entity)? 1/5/2017 Understanding Cognitive Systems 5
  • 6. Build them (BCS)? 10 million minutes of experience 1/5/2017 Understanding Cognitive Systems 6
  • 7. Build them (BCS)? 2 million minutes of experience 1/5/2017 Understanding Cognitive Systems 7
  • 8. Build them (DCS)? Computers, data, building blocks & service offerings 1/5/2017 Understanding Cognitive Systems 8
  • 9. Build them (BCS + DCS)? Socio-technical system design hardware < software < data < experience < transformation 1/5/2017 Understanding Cognitive Systems 9
  • 10. Understand them? • Observe Them: Predictable and Auditable? • BCS: Sometimes predictable and auditable (natural, evolved, experiences, free will) • DCS: Mostly predictable and auditable (artificial, designed, algorithms, blockchain) • Hardware: • BCS: Brain-based (neurons) • DCS: Microprocessor-based (transistors) • Software: • BCS: (People and Experiences) Evolution & Psychology, Cognitive Science • DCS: (Machines and Algorithms) Design & Engineering, Computer Science • Data, Experience, Transformation? • BCS & DCS: External environment & sensing (Data), Internal processes, communications, storage (Information & experience), Philosophy of life, values (Transformation) 1/5/2017 Understanding Cognitive Systems 10
  • 11. Work with them? Circa 2016… 1/5/2017 Understanding Cognitive Systems 11
  • 12. Steps Toward a Next Generation Cognitive Curriculum • 2016 • “How to build a cognitive system for Q&A task.” • 9 months to 40% question answering accuracy • 1-2 years for 90% accuracy, which questions to reject • 2026 • “How to use cognitive assistants to be a better professional X.” • Tools to build a student level Q&A from textbook in 1 week • 2036 • “How to use your cognitive mediator to build a startup.” • Tools to build faculty level Q&A for textbook in one day • Cognitive mediator knows a person better (in some ways) than they know themselves (identity & responsibility) • 2046 & 2056 • “How to manage your workforce of digital workers.” • 2046: 10 digital workers each; 2056: 100 digital workers each 1/5/2017 12
  • 13. Next Generation Cognitive Curriculum: Intelligence Building Blocks 1/5/2017 Understanding Cognitive Systems 13 • Intelligence Augmentation (IA) • Science • Design • Business • Society • Interdisciplinary • Artificial Intelligence (AI) • Learning • Perception • Reasoning • Interaction • Knowledge
  • 14. 1/5/2017 Understanding Cognitive Systems 14 Prof. Pieter Abbeel (UC Berkeley)
  • 19. 1/5/2017 Understanding Cognitive Systems 19 Commonsense Reasoning Fluid Conversations Ingesting Textbooks
  • 20. What types of digital cognitive systems (DCS)? • Cognitive Build: Outthink Challenge (250K people) • Imagine a digital cognitive system to help you do something important in your personal or professional lives • Team to design it and advocate for it, and then everyone votes • Winners: reduce waste and human suffering, screen for health issues and safety threats, learn life skills and make better choices, find what you are looking for, move around more effectively, provide emotional support, provide IT support, learn about important public policy goals and make better choices • Types: Tool, Assistant, Collaborator, Coach, Mediator 1/5/2017 Understanding Cognitive Systems 20
  • 21. Types • Tool • Assistant • Collaborator • Coach • Mediator 1/5/2017 Understanding Cognitive Systems 21
  • 22. Types: Model/Capability/Challenge (+ = relative difficulty level) 1/5/2017 Understanding Cognitive Systems 22 DCS Type Improvement Model/ Learning/ Data Task Model/ Perception/ Variety Self Model/ Reasoning/ Commonsense User Model/ Interaction/ Episodic Memory World Model/ Knowledge/ Legal Trust Tool + ++ + + + Assistant ++ +++ +++ ++ ++ Collaborator +++ +++ +++ ++++ +++ Coach ++++ ++++ ++++ +++++ +++++ Mediator +++++ +++++ +++++ +++++ +++++++ tool assistant collaborator coach mediator
  • 23. Sample existing courses • AI MOOCs (Next Slide) • Watson Innovation Course • http://crowdtruth.org/course/watson-innovation-course-2016/ 1/5/2017 Understanding Cognitive Systems 23
  • 24. AI MOOCs: Circa 2016 1/5/2017 Understanding Cognitive Systems 24
  • 25. 1/5/2017 25 1956 1976 1996 2016 2036 2056 Personal Reflections: The building blocks are getting better Maine MIT, Verbex, Yale Apple IBM
  • 26. 1/5/2017 26 Come visit IBM Research – Almaden in San Jose, CA USA – monthly university day!
  • 27. Dedication: Douglas C. Engelbart Father of the mouse and augmentation theory 1/5/2017 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development 27
  • 28. Remember, this stuff is still really hard… 1/5/2017 © IBM UPWard 2016 28
  • 29. Cognitive Science, a young field • Society • cognitivesciencesociety.org • People • Founders: Roger Schank, Donald Norman, Allan Collins • Others: David Rumelhart, Herbert Simon, Allen Newell • Today: Patrick Langley, Wayne Gray, Kenneth Forbus, Ashok Goel, Paul Maglio, etc. • Systems Conference • cogsys.org • (JCS wishes this was part of HICSS) 1/5/2017 Understanding Cognitive Systems 29
  • 30. Advances in Cognitive Systems - cogsys.org 1/5/2017 Understanding Cognitive Systems 30
  • 31. Google Search: August 26, 2016 1/5/2017 Understanding Cognitive Systems 31
  • 32. Work with them? 1/5/2017 Understanding Cognitive Systems 32

Hinweis der Redaktion

  1. This presentation provides an initial conceptual framework for “Understanding Cognitive Systems” – this presentation can be downloaded from slideshare.net/spohrer Spohrer, J (2016) Understanding Cognitive Systems. A CSIG weekly speaker series presentation, also for Marty Apple. URL: http://www.slideshare.net/spohrer/understanding_20161127_v8
  2. I’m Jim Spohrer, I work at IBM and I am the presenter, and in today’s short talk, I will briefly cover what is a cognitive system (entity) – both biological and digital. Then I will briefly discuss how to build, understand, and work with digital cognitive systems – and how this is steps towards a next generation cognitive curriculum, including types of digital cognitive systems.
  3. Biological cognitive system entities… and human intelligence… The best explanation of what a biological cognitive system entity is can be found in Terrence Deacon’s book- the Symbolic Species – the co-evolution of language and the brain. All easily recognizable biological cognitive systems from ants to wolves to crows to dolphins to monkeys to people have brains that have co-evolved with symbol systems - chemical, visual, auditory – that individuals of the species you as a type of language for communicating and coordinating reasoning and interactions and the accumulation of knowledge for successful multi-generational living in an environment. Less sophisticated languages and brains deal primarily with the physical world, but more sophisticated languages and brains are needed to deal with the social and in the case of people, the cultural and institutional world, of large numbers of others of their species living in close proximity with each other. Responds to environment (decision making – model of physical world, tasks), learning (memory – model of self), language (communications – model of other), institutions (collaboration, competition – model of institutional world, trust) Is the entity the individual, the collective, or the species? Or all of these levels of organization? Bionic ant design: https://www.youtube.com/watch?v=voNBzuI7IJ4
  4. Technological cognitive system entities, or what we will call digital cognitive system entities – are most easily explained from science fiction examples like Star Trek’s Mr. Data – an individual smart machine or AI (Artificial Intelligence). Artificial Intelligence (AI = MI) versus Intelligence Augmentations (IA = HI + MI) = Human Intelligence + Machine Intelligence Versus a Tony Stark and Jarvis in Iron Man – which is an example of an Augmented Intelligence that combines biological human intelligence with technological machine intelligence into a system. In Augmented Intelligence – human computer interactions are often aided by augmented reality symbol systems that allow a blending of the physical and virtual or cyber worlds, so that people in the physical world can directly interact with bits of information in the machine intelligence or AI world. So it is likely that over time augmented intelligence and augmented reality interfaces will co-evolve as complementary technologies and system components. Important property of Augmented Intelligence, must increase HI by use and not diminish it. Same as a parent and a child – the child must become more capable over time, and more dependent
  5. People take 10 million minutes of experience to go from conception to adult in today’s society with rights and responsibilities. Dogs, and some other biological cognitive systems, make the journey in about 500,000 minutes of experience (half a million minutes of experience).
  6. Building an expert BCS takes 10,000 hours of deliberate practice, or around 2 million minutes of experience. Building an expert DCS is still very heard work, and the rule-based approach of expert systems can be brittle and the bottom-up data-driven deep learning approaches can take an incredible amount of data.
  7. In the 60 year history of the new field called Artificial Intelligence (AI) the building blocks have been getting better, and now “cognition as a service” is being offered by industry and non-profit players.
  8. As the lower level building blocks get better and easier to use, value migrates to higher and higher levels…. Ultimately, building an expert BCS (person) or DCS (assistant) is not simply about the hardware/software/data/experience levels but about the design and transformation of socio-technical systems. Where is the variety? Hardware and even software standardizing into modules and algorithms…. Data will standardize next into categories and types…. Experience is where the uniqueness is, and variety and variability, and identity.
  9. Moving from science fiction to what exists today in 2016 – in the marketplace, we can see that more and more companies are developing intelligent assistants and augmented intelligence systems with technological components – in the cloud, on smartphones, in robots, and in cars, or as embedded in existing communication apps or other devices that people use when interacting with others or the world.
  10. Here is what I tell students.... ... to try to provoke their thinking about the cognitive era:     (0) 2015 - about 9 months to build a formative Q&A system - 40% accuracy;         - another 1-2 years and a team of 10-20, can get it to 90% accuracy, by reducing the scope ("sorry that question is out of scope")         - today's systems can only answer questions, if the answers are already existing in the text explicitly         - debater is an example of where we would like to get to though in 5 years: https://www.youtube.com/watch?v=7g59PJxbGhY         - more about the ambitions at  http://cognitive-science.info     (1) 2025: Watson will be able to rapidly ingest just about any textbooks and produce a Q&A system         - the Q&A system will rival C-grade (average) student performance on questions     (2) 2035 - above, but rivals C-level (average) faculty performance on questions     (3) 2035 - an exascale of compute power costs about $1000         - an exascale is the equivalent compute of one person's brain power (at 20W power)     (4) 2035 - nearly everyone has a cognitive mediator that knows them in many ways better than they know themselves          - memory of all health information, memory of everyone you have ever interacted with, executive assistant, personal coach, process and memory aid, etc.     (5) 2055 - nearly everyone has 100 cognitive assistants that "work for them"         - better management of your cognitive assistant workforce is a course taught at university In 2015, we are at the beginning of the beginning or the cognitive era... In 2025, we will be middle of beginning... easy to generate average student level performance on questions in textbook.... In 2035, we will be end of beginning (one brain power equivalent)... easy to generate average faculty level performance on questions in textbook....     http://www.slideshare.net/spohrer/spohrer-ubi-learn-20151103-v2 By 2055, roughly 2x 20 year generations out, the cognitive era will be in full force. Cellphones will likely become body suits - with burst-mode super-strength and super-safety features: Suits - body suit cell phones Cognitive Mediators will read everything for us, and relate the information to  us - and what we know and our goals. Think combined personal coach, executive assistant, personal research team.... The key is knowing which problem to work on next - see this long video for the answer - energy, water, food, wellness -  and note especially the wellness suit at the end:     https://www.youtube.com/watch?v=YY7f1t9y9a0&index=10&list=WL Do not be put off by the beginning of the video - it is a bit over hyped and trivial, to say the leasat... but the projects are really good if you have the patience to watch.
  11. So how far are we from the master algorithm? How far are we from having digital cognitive systems learn more like biological cognitive systems, rather than people programming with the rapidly improving building blocks? To begin to answer these questions, let’s look at the work of Prof. Peter Abbeel (UC Berkeley) – people may note that he has one of the top rated AI/Machine Learning MOOCs in the world fyi…
  12. In the video you can find by scrolling down on his home page, he provides a nice example of a simulated digital cognitive system entity learning from interactions with a simulated environment. The rewards are for forward speed, and head hitting ground less hard (impact with ground should be as low as possible). Re-enforcement for control, not just prediction. Control is interaction between entities and the environment, and entities and other entities – social interaction.
  13. In early 2016, IBM did an experiment to see what types of digital cognitive systems is employees where most interested in building. The experiment was called the “Cognitive Build” and over 250K employees took part in some way. I analyzed the top 400 projects, and with the help of ideas about Types of cognitive systems - co-created with the help of Don Norman and Paul Maglio – was able to identify five major types of cognitive systems that differ in the complexity of the models they possess.
  14. Tools are the simplest since the do one thing well Assistants are slightly more complex since they can help with a range of tasks. A collaborator is more complex, in that the best collaborators really know they user well. A coach must know the user even more deeply, not just today’s capabilities, but aspirations for the future. And finally a trusted mediator can take actions on behalf of the user – to help people interact better to co-create more value in complex interactions that require reasoning about institutional arrangements and laws, social and cultural conventions.
  15. These five types of digital cognitive systems and the types of models and capabilities they require are summarized in this table. Relate to learning, perception, reasoning, interaction, and knowledge – five parts of an AI course.
  16. The weakest link is what needs to be improved – according to system scientists. Accessing help, service, experts is the weakest link in most systems. By 2035 the phone may have the power of one human brain – by 2055 the phone may have the power of all human brains. Before trying to answer the question about which types of sciences are more important – the ones that try to explain the external world or the ones that try to explain the internal world – consider this, slide that shows the different telephones that I have used in my life. I grew up in rural Maine, where we had a party line telephone because we were somewhat remote on our farm in Newburgh, Maine. However, over the years phones got much better…. So in 2035 or 2055, who are you going to call when you need help?
  17. One of my heroes and mentors – Doug Engelbart (1925-2013) Doug and I had several conversations about the relationship between augmentation theory and service science. I wish we could have had many more. Before connecting augmentation theory to service science, I have to travel through some technical areas that are closer to my first two degrees physics at MIT and artificial intelligence at Yale university – but I promise you, I will connect this to service science and smarter service system research agenda….
  18. Reference Wikipedia “Cognitive Science”