SlideShare ist ein Scribd-Unternehmen logo
1 von 40
What you  understand  is what you get:   Assessment in SACHS Andrea Kohlhase a,b Michael Kohlhase b,a a German Center for Artificial Intelligence (DFKI), Bremen b School of Computer Science and Engineering, Jacobs University Bremen
Handles on Knowledge ,[object Object],“ 0“,“9“, “ 5“,“,“ Exchange rate 1 $ = 0,95  € Market mechanisms   concerning  exchange rates 0,95 Character  Set Context Networking Syntax Glyphs Data Information Knowledge
Semantic Technology: Motivation ,[object Object],Knowledge What is  available  is what you get! ≠
Semantic Technology: Metadata ,[object Object],Knowledge ≠ Data about Data ≠ What you  want  is what you get! K n o w l e d g e
Semantic Technology: Services ,[object Object],K n o w l e d g e Data about Data ≠ Semantic  Services ≠ What is  delivered  is what you get! K  n  o  w  l  e  d  g  e ≠
Semantic Technology: Interactions ,[object Object],K  n  o  w  l  e  d  g  e ≠ Data about Data ≠ Semantic  Services ≠ Semantic  Interactions What you  engage with  is what you get! ≠ K  n  o  w  l  e  d  g  e
Semantic Technology: Spirit ,[object Object],≠ Data about Data ≠ Semantic  Services ≠ Semantic  Interactions What you  understand  is what you get! ≠ K  n  o  w  l  e  d  g  e
Semantic Technology: Paradigms ,[object Object],≠ Data about Data ≠ Semantic  Services ≠ Semantic  Interactions Semantic Illustration Semantic  Web ≠ K  n  o  w  l  e  d  g  e
Semantic Illustration Architecture:   SACHS Semantic Document Financial Controlling System Interpretation Mapping
„ What is  available  is what you get!“    SACHS
Background Ontology
„ What  is delivered  is what you get!“: SACHS
„ What you  engage with  is what you get!“: SACHS
SACHS: Semantic Navigation
„ What you  understand  is what you get!“: SACHS
SACHS: Framing
The „Wizard of Oz“ Experiment Users System Requirements?
The „Wizard of Oz“ Experiment:  SACHS Author Expert MP3  Recordings Financial  Controlling SACHS  Semantic  Document
Analysis of MP3 Recordings „ Knowledge Items“: #39 „ Explanations“: #110 „ Explanation Types“: #7
Explanation Types ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Cover ratio  = Coverage of necessary costs Cover ratio  is a  performance figure. ,[object Object],[object Object],[object Object],[object Object]
Explanation Types ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Verification  of understanding Origin  of values Layout/content  evolution
Explanation Types How many times was each explanation type chosen for describing  a knowledge item? # Explanation Type # Knowledge Items Definition Purpose  Assessment of Purpose Assessment of Value Formula Provenance History
Relevance Ranking ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],How many times was each explanation type chosen for describing  a knowledge item? 71.8% 51.3% 46.2% 43.6% 30.8% 23.1% 15.4% # Explanation Type # Knowledge Items
Help Needed - but Where? How many times was an  explanation type chosen? # Explanation Type # Explanations
Our Conclusion ,[object Object],[object Object]
What is Assessment? Row 6 looks good! The revenues look good! ...  but that is a disaster! I like this ...
Assessment Model Generic  assessment theory with functions to judge
Assessment Model Concrete  assessment theories with  judgement functions
Assessment Model Concrete   theories with  domains
SACHS: Assessment Module
SACHS: Assessment Module + Explanations
SACHS: Assessment Module
Multicontext Assessment Upper Management  will be happy about the leftover funds, but the  PI  of the project will be angry that he got less work out of the projected than expected. Not to mention the  funding agency  and their policy ….
Multicontext Assessment Model Concrete  variants  of assessment theories
SACHS Conclusion ,[object Object],[object Object],[object Object]
General Conclusions Generic Assessment Concrete Assessment Concrete Assessment Concrete Assessment Concrete Assessment Concrete Assessment Concrete Assessment Concrete Assessment Concrete Assessment ,[object Object],[object Object],[object Object],[object Object]
Thank you!
 
SACHS as a Sand Box ,[object Object],[object Object],S emantic  A nnotation for a  C ontrolling  H elp  S ystem
User Assistance What you  see   is  what you get! Creator Reader What you  understand   is  what you get!

Weitere ähnliche Inhalte

Ähnlich wie Assessment In Spreadsheets

SXSWi '11: Beyond Wordclouds: Analyzing Trends with Social Media APIs
SXSWi '11: Beyond Wordclouds: Analyzing Trends with Social Media APIsSXSWi '11: Beyond Wordclouds: Analyzing Trends with Social Media APIs
SXSWi '11: Beyond Wordclouds: Analyzing Trends with Social Media APIsChris Busse
 
Semantic Analytics, Smart Data
Semantic Analytics, Smart DataSemantic Analytics, Smart Data
Semantic Analytics, Smart DataArthur Keen
 
Making light work of data- improving the UX of data rich interfaces- UX Austr...
Making light work of data- improving the UX of data rich interfaces- UX Austr...Making light work of data- improving the UX of data rich interfaces- UX Austr...
Making light work of data- improving the UX of data rich interfaces- UX Austr...Stephen Hall
 
Cognitive Systems
Cognitive SystemsCognitive Systems
Cognitive SystemsLukas Ott
 
AMES 2016 - The Human Side of Analytics
AMES 2016 - The Human Side of AnalyticsAMES 2016 - The Human Side of Analytics
AMES 2016 - The Human Side of AnalyticsStephen Tracy
 
A Topic Model of Analytics Job Adverts (Operational Research Society Annual C...
A Topic Model of Analytics Job Adverts (Operational Research Society Annual C...A Topic Model of Analytics Job Adverts (Operational Research Society Annual C...
A Topic Model of Analytics Job Adverts (Operational Research Society Annual C...Michael Mortenson
 
A Topic Model of Analytics Job Adverts (The Operational Research Society 55th...
A Topic Model of Analytics Job Adverts (The Operational Research Society 55th...A Topic Model of Analytics Job Adverts (The Operational Research Society 55th...
A Topic Model of Analytics Job Adverts (The Operational Research Society 55th...Michael Mortenson
 
Brochure data science learning path board-infinity (1)
Brochure   data science learning path board-infinity (1)Brochure   data science learning path board-infinity (1)
Brochure data science learning path board-infinity (1)NirupamNishant2
 
BAS 150 Lesson 1 Lecture
BAS 150 Lesson 1 LectureBAS 150 Lesson 1 Lecture
BAS 150 Lesson 1 LectureWake Tech BAS
 
Getting to Know Your Data with R
Getting to Know Your Data with RGetting to Know Your Data with R
Getting to Know Your Data with RStephen Withington
 
Barga Data Science lecture 2
Barga Data Science lecture 2Barga Data Science lecture 2
Barga Data Science lecture 2Roger Barga
 
Swot Analysis Essay.pdf
Swot Analysis Essay.pdfSwot Analysis Essay.pdf
Swot Analysis Essay.pdfEvelin Santos
 
xAPI: The Landscape
xAPI: The LandscapexAPI: The Landscape
xAPI: The LandscapeMegan Bowe
 
xAPI Camp - Learning Solutions
xAPI Camp - Learning SolutionsxAPI Camp - Learning Solutions
xAPI Camp - Learning SolutionsAaron Silvers
 
Data science 101 Masterclass
Data science 101 MasterclassData science 101 Masterclass
Data science 101 MasterclassBen Keen
 
Text-mining and Automation
Text-mining and AutomationText-mining and Automation
Text-mining and Automationbenosteen
 
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-share
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-shareBigData Visualization and Usecase@TDGA-Stelligence-11july2019-share
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-sharestelligence
 

Ähnlich wie Assessment In Spreadsheets (20)

SXSWi '11: Beyond Wordclouds: Analyzing Trends with Social Media APIs
SXSWi '11: Beyond Wordclouds: Analyzing Trends with Social Media APIsSXSWi '11: Beyond Wordclouds: Analyzing Trends with Social Media APIs
SXSWi '11: Beyond Wordclouds: Analyzing Trends with Social Media APIs
 
Semantic Analytics, Smart Data
Semantic Analytics, Smart DataSemantic Analytics, Smart Data
Semantic Analytics, Smart Data
 
Semantic Analytics
Semantic AnalyticsSemantic Analytics
Semantic Analytics
 
Making light work of data- improving the UX of data rich interfaces- UX Austr...
Making light work of data- improving the UX of data rich interfaces- UX Austr...Making light work of data- improving the UX of data rich interfaces- UX Austr...
Making light work of data- improving the UX of data rich interfaces- UX Austr...
 
Cognitive Systems
Cognitive SystemsCognitive Systems
Cognitive Systems
 
AMES 2016 - The Human Side of Analytics
AMES 2016 - The Human Side of AnalyticsAMES 2016 - The Human Side of Analytics
AMES 2016 - The Human Side of Analytics
 
A Topic Model of Analytics Job Adverts (Operational Research Society Annual C...
A Topic Model of Analytics Job Adverts (Operational Research Society Annual C...A Topic Model of Analytics Job Adverts (Operational Research Society Annual C...
A Topic Model of Analytics Job Adverts (Operational Research Society Annual C...
 
A Topic Model of Analytics Job Adverts (The Operational Research Society 55th...
A Topic Model of Analytics Job Adverts (The Operational Research Society 55th...A Topic Model of Analytics Job Adverts (The Operational Research Society 55th...
A Topic Model of Analytics Job Adverts (The Operational Research Society 55th...
 
Brochure data science learning path board-infinity (1)
Brochure   data science learning path board-infinity (1)Brochure   data science learning path board-infinity (1)
Brochure data science learning path board-infinity (1)
 
BAS 150 Lesson 1 Lecture
BAS 150 Lesson 1 LectureBAS 150 Lesson 1 Lecture
BAS 150 Lesson 1 Lecture
 
Getting to Know Your Data with R
Getting to Know Your Data with RGetting to Know Your Data with R
Getting to Know Your Data with R
 
Barga Data Science lecture 2
Barga Data Science lecture 2Barga Data Science lecture 2
Barga Data Science lecture 2
 
Swot Analysis Essay
Swot Analysis EssaySwot Analysis Essay
Swot Analysis Essay
 
Swot Analysis Essay.pdf
Swot Analysis Essay.pdfSwot Analysis Essay.pdf
Swot Analysis Essay.pdf
 
xAPI: The Landscape
xAPI: The LandscapexAPI: The Landscape
xAPI: The Landscape
 
xAPI Camp - Learning Solutions
xAPI Camp - Learning SolutionsxAPI Camp - Learning Solutions
xAPI Camp - Learning Solutions
 
Data science 101 Masterclass
Data science 101 MasterclassData science 101 Masterclass
Data science 101 Masterclass
 
Text-mining and Automation
Text-mining and AutomationText-mining and Automation
Text-mining and Automation
 
Selling Text Analytics to your boss
Selling Text Analytics to your bossSelling Text Analytics to your boss
Selling Text Analytics to your boss
 
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-share
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-shareBigData Visualization and Usecase@TDGA-Stelligence-11july2019-share
BigData Visualization and Usecase@TDGA-Stelligence-11july2019-share
 

Kürzlich hochgeladen

New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 

Kürzlich hochgeladen (20)

New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 

Assessment In Spreadsheets

Hinweis der Redaktion

  1. SACHS is a user assistance system for a financial controlling system at DFKI, which is realized in Excel. Evaluation of what SACHS as a user assistance system covers
  2. We will start as always with a model of (mathematical) knowledge. You may know this picture from last year's talk where we looked at the mks. There we concentrated on the content/form debate, and were led to the conclusion that certain (higher/semantic) aspects of kwowledge were actually subjective and dependent on the social context (whatever this may be). The work I will report today is a continuation of this path. Of course, when you look at a subject intensively, then your picture of the situation changes....
  3. Probst et al. 1997: Glyphs  Data  Information  Knowledge
  4. From sheer volume of data to quality of data …
  5. Semantic Services are understood as services that use reasoning about the formal objects introduced with the metadata to enhance the data
  6. Semantic Interactions are those services that use reasoning about the metadata to enhance the interaction. “ We will distinguish between services enabled by semantic data (i.e., the ones that make the machine smarter), and interaction enabled by semantic data (services that make the interaction with the smarter machine smarter)”
  7. The Semantic Web approach consists in enhancing resources into semi-formal ontologies and making use of resulting (semantic) services. The Semantic Illustration approach consists in complementing resources and making use of resulting (semantic) services and interactions
  8. So, SACHS is really aiming at supporting a user in her understanding. BUT: SACHS only addressed the intention of spreadsheets. Is that all what understanding is about? No.
  9. An ‚o‘ means that this explanation was given in form of an example; the number of ‚o‘s indicates the number of examples given.
  10. The field of Knowledge Management covers the management of knowledge by machines, but as well knowledge support for people  user assistance Generally, user assistance aims for help concerning handling of systems. But systems are very diverse by now  If a system is a document or a group of documents, then support means support of readers.