SlideShare ist ein Scribd-Unternehmen logo
1 von 41
Jodi Schneider
Frontiers and Connections between Argumentation Theory
and Natural Language Processing
BiCi seminar series, Bertinoro (Forlì-Cesena), Italy
24 July 2014
Topics
• Examples of argumentation support
• Supporting Collaborative Online Arguing
• Structuring scientific argument:
Micropublications model
Create new spaces for civic debate
http://Consider.It
"Supporting reflective public thought with ConsiderIt." CSCW 2012
Travis Kriplean, Jonathan Morgan, Deen Freelon, Alan Borning, and Lance Bennett.
Create new spaces for civic debate
http://Consider.It
"Supporting reflective public thought with ConsiderIt." CSCW 2012
Travis Kriplean, Jonathan Morgan, Deen Freelon, Alan Borning, and Lance Bennett.
Choose
task-
appropriate
formalisms:
SEAS
"Template-based structured argumentation." In Knowledge Cartography, Springer London, 2008.
John Lowrance, Ian Harrison, Andres Rodriguez, Eric Yeh, Tom Boyce, Janet Murdock, Jerome Thomere, and Ken Murray.
Choose
task-
appropriate
formalisms
discoursedb.
org
Support
incremental
formalization
argunet.org
ClimateCoLab
climatecolab.org
http://www.climatecolab.org/ Circa 2010
Topics
• Examples of argumentation support
• Supporting Collaborative Online Arguing
• Structuring scientific argument:
Micropublications model
General Approach (from Informatics)
1. Analyze requirements
2. Consider which argumentation models to use
3. Build a prototype support tool
4. Evaluate and iterate
500 Wikipedia debates each week:
Should we delete this article?
Requirements:
Support argumentation tasks
• Convince others of your position, using
community norms
• Determine the overall consensus decision
Compare two argumentation theories
• Walton’s Argumentation Schemes
(Walton, Reed, and Macagno 2008)
– Informal argumentation
(philosophical & computational argumentation)
– Identify & prevent errors in reasoning (fallacies)
– 60 patterns
• Factors/Dimensions Analysis
(Ashley 1991; Bench-Capon and Rissland, 2001)
– Case-based reasoning
– E.g. factors for deciding cases in trade secret law,
favoring either party (the plaintiff or the defendant).
Walton’s Argumentation Schemes
Example Argumentation Scheme:
Argument from Rules – “we apply rule X”
Critical Questions
1. Does the rule require carrying out this type of action?
2. Are there other established rules that might conflict
with or override this one?
3. Are there extenuating circumstances or an excuse for
noncompliance?
Walton, Reed, and Macagno 2008
“Rule” Argumentation Scheme
“Arguments about Deletion: How Experience Improves the Acceptability of Arguments in Ad-hoc Online Task Groups”
CSCW 2013
“Evidence” Argumentation Scheme
“Arguments about Deletion: How Experience Improves the Acceptability of Arguments in Ad-hoc Online Task Groups”
CSCW 2013
Evidence + Rule -> Conclusion
“Arguments about Deletion: How Experience Improves the Acceptability of Arguments in Ad-hoc Online Task Groups”
CSCW 2013
Supporting Tasks with Walton
• Convince others of your position, using
community norms
– To win an argument, use popular schemes:
• Argument from Evidence to Hypothesis (19%)
• Argument from Rules (17%)
• Determine the overall consensus decision
– Ask critical questions to check others' arguments
Factors/Dimensions Analysis
• Factors (case-based reasoning)
– All or nothing
• Either present ("applicable") or absent
• When present, a factor always favors the same side
• Dimensions
– More complex/subtle
• Can be applicable to a varying degree ("sliding scale")
• Favor plantiff on one extreme; defendant on the other
Ashley 1991; Bench-Capon and Rissland, 2001
Example factors analysis
(Aleven 1997)
Aleven 1997
Wikipedia Factors Analysis
Factors determined
by iterative annotation
4 Factors cover
– 91% of comments
– 70% of discussions
“Other” as 5th catchall
Factor Example (used to justify `keep')
Notability Anyone covered by another
encyclopedic reference is
considered notable enough for
inclusion in Wikipedia.
Sources Basic information about this
album at a minimum is certainly
verifiable, it's a major label
release, and a highly notable
band.
Maintenance …this article is savable but at its
current state, needs a lot of
improvement.
Bias It is by no means spam (it does
not promote the products).
**Other I'm advocating a blanket
"hangon" for all articles on
newly-drafted players
Wikipedia Factors Analysis
Factors determined
by iterative annotation
4 Factors cover
– 91% of comments
– 70% of discussions
“Other” as 5th catchall
Factor Example (used to justify `keep')
Notability Anyone covered by another
encyclopedic reference is
considered notable enough for
inclusion in Wikipedia.
Sources Basic information about this
album at a minimum is certainly
verifiable, it's a major label
release, and a highly notable
band.
Maintenance …this article is savable but at its
current state, needs a lot of
improvement.
Bias It is by no means spam (it does
not promote the products).
**Other I'm advocating a blanket
"hangon" for all articles on
newly-drafted players
Wikipedia Factors Analysis
Factor Example (used to justify 'keep') Example (used to justify 'delete'
Notability Anyone covered by another
encyclopedic reference is considered
notable enough for inclusion in
Wikipedia.
There is simply no coverage in
reliable sources to establish
notability.
Sources Basic information about this album
at a minimum is certainly verifiable,
it's a major label release, and a
highly notable band.
There are no independent
secondary sources (books, magazine
articles, documentaries, etc.) about
her.
Maintenance …this article is savable but at its
current state, needs a lot of
improvement.
Too soon for a page likely to be
littered with rumour and
speculation.
Bias It is by no means spam (it does not
promote the products).
The article seems to have been
created by her or her agent as a
promotional device.
**Other I'm advocating a blanket "hangon"
for all articles on newly-drafted
players
it appears to be original research by
synthesis
Deletion Discussions in Wikipedia: Decision Factors and Outcomes. WikiSym 2012.
Supporting Tasks with Factors
• Convince others of your position, using
community norms
– To win an argument, talk about the right topics
• Notability, Sources, Maintenance, Bias
• Determine the overall consensus decision
– Group messages by factor
– Summarize prevalence
Factor-based Summarization
Argument Schemes vs. Factors?
• Argument Schemes (kappa=.48)
Details of how to put together an argument
– Could support WRITING detailed arguments
– Critical Questioning
• Factors (kappa=.64-.82, based on factor)
Topics of discussion
– Basic support for writing arguments
– Summarization supports decision-making
Argument prevalence depends on the
corpus
• Wikipedia
– Argument from Evidence to Hypothesis (19%)
– Argument from Rules (17%)
• Arucaria
– Argument from example (38%)
– Argument from cause to effect (27%)
– Practical reasoning (14%)
– Argument from consequences (11%)
– Argument from verbal classification (10%)
Topics
• Examples of argumentation support
• Supporting Collaborative Online Arguing
• Micropublications model: Structuring
scientific argument
Micropublications
Model Data,
Methods,
Materials,
References
Micropublications: a Semantic Model for
Claims, Evidence, Arguments and
Annotations in Biomedical
Communications
Tim Clark, Paolo N. Ciccarese, Carole A.
Goble
http://arxiv.org/abs/1305.3506
Direct Annotation with Domeo
http://swan.mindinformatics.org/ Paolo N Ciccarese
Micropublication: Claim + Support
(e.g. Attribution)
Micropublications: a Semantic Model for Claims, Evidence, Arguments and Annotations in Biomedical Communications
Tim Clark, Paolo N. Ciccarese, Carole A. Goble
http://arxiv.org/abs/1305.3506
Constructs claim-argument network
across scientific papers
Micropublications: a Semantic Model for Claims, Evidence, Arguments and Annotations in Biomedical Communications
Tim Clark, Paolo N. Ciccarese, Carole A. Goble
http://arxiv.org/abs/1305.3506
Argumentation Mining papers
Arguing on Wikipedia
• “Arguments about Deletion: How Experience Improves the Acceptability of Arguments
in Ad-hoc Online Task Groups” CSCW 2013.
• “Deletion Discussions in Wikipedia: Decision Factors and Outcomes” WikiSym2012.
Arguing in Social Media
• “Dimensions of Argumentation in Social Media" EKAW 2012
• “Why did they post that argument? Communicative intentions of Web 2.0 arguments.”
Arguing on the Web 2.0 at ISSA 2014
Arguing in Reviews
• “Identifying Consumers' Arguments in Text” SWAIE 2012
• “Semi-Automated Argumentative Analysis of Online Product Reviews" COMMA 2012
• “Arguing from a Point of View” Agreement Technologies 2012
Structuring Arguments on the Social Semantic Web
• “A Review of Argumentation for the Social Semantic Web” Semantic Web –
Interoperability, Usability, Applicability, 2013.
• “Identifying, Annotating, and Filtering Arguments and Opinions in Open Collaboration
Systems" 2013 Thesis: purl.org/jsphd
• “Modeling Arguments in Scientific Papers” at ArgDiaP 2014
http://jodischneider.com/jodi.html
Argumentation mining today
• No unified vision of the field. Multiple:
– Interrelated problems
– Application domains
– Tools handling one aspect of annotation
• Few corpora
• Need for
– Common definition(s) of argumentation
– "Challenge problems"
– Shared corpora
– Applications
Example: "Stop at a red light"
1. Does the rule require carrying out this type of action?
Were you driving a vehicle?
2. Are there other established rules that might conflict
with or override this one?
Did a police officer direct you to continue without
stopping?
3. Are there extenuating circumstances or an excuse for
noncompliance?
Were you driving an ambulance with its siren on?
Critical Questions from Argument from Rules based on Walton, Reed, and Macagno 2008
None of Wikipedia's top-used schemes
are prevalent in Arucaria.
Classifying Arguments by Scheme. Vanessa Wei Feng. Master's thesis, Toronto, 2010.
Goal: large-scale arguing
• Search for issues, claims, and opinion clusters
• Link to evidence when writing your opinion
• Publish and navigate claims networks
Online argumentation support
interfaces can:
• Promote "listening" in online conversations
• Support incremental formalization
• Slice and dice the views
• Collect crisp examples
• Support distributed sensemaking
Argumentation mining could be the
basis for support tools
• Help participants write persuasive arguments
– How: provide personalized feedback on drafts
– Requires: knowing which arguments are accepted;
identifying argumentation in a drafts
• Find weaknesses in others’ arguments
– How: suggest & instantiate relevant critical questions
– Requires: identifying argumentation schemes
• Summarize the overall conclusions of the debate
– How: identify the winning and losing rationales
– Requires: identifying rationales and contradictions

Weitere ähnliche Inhalte

Mehr von jodischneider

Towards knowledge maintenance in scientific digital libraries with the keysto...
Towards knowledge maintenance in scientific digital libraries with the keysto...Towards knowledge maintenance in scientific digital libraries with the keysto...
Towards knowledge maintenance in scientific digital libraries with the keysto...jodischneider
 
Methods Pyramids as an Organizing Structure for Evidence-Based Medicine--SIGC...
Methods Pyramids as an Organizing Structure for Evidence-Based Medicine--SIGC...Methods Pyramids as an Organizing Structure for Evidence-Based Medicine--SIGC...
Methods Pyramids as an Organizing Structure for Evidence-Based Medicine--SIGC...jodischneider
 
Annotation examples--Fribourg--2019-09-03
Annotation examples--Fribourg--2019-09-03Annotation examples--Fribourg--2019-09-03
Annotation examples--Fribourg--2019-09-03jodischneider
 
Argumentation mining--an introduction for linguists--Fribourg--2019-09-02
Argumentation mining--an introduction for linguists--Fribourg--2019-09-02Argumentation mining--an introduction for linguists--Fribourg--2019-09-02
Argumentation mining--an introduction for linguists--Fribourg--2019-09-02jodischneider
 
Beyond Randomized Clinical Trials: emerging innovations in reasoning about he...
Beyond Randomized Clinical Trials: emerging innovations in reasoning about he...Beyond Randomized Clinical Trials: emerging innovations in reasoning about he...
Beyond Randomized Clinical Trials: emerging innovations in reasoning about he...jodischneider
 
Problem-citations--CrossrefLive18--2018-11-13
Problem-citations--CrossrefLive18--2018-11-13Problem-citations--CrossrefLive18--2018-11-13
Problem-citations--CrossrefLive18--2018-11-13jodischneider
 
Problematic citations--Workshop-on-Open-Citations--2018-09-03
Problematic citations--Workshop-on-Open-Citations--2018-09-03Problematic citations--Workshop-on-Open-Citations--2018-09-03
Problematic citations--Workshop-on-Open-Citations--2018-09-03jodischneider
 
Modeling Alzheimer’s Disease research claims, evidence, and arguments from a ...
Modeling Alzheimer’s Disease research claims, evidence, and arguments from a ...Modeling Alzheimer’s Disease research claims, evidence, and arguments from a ...
Modeling Alzheimer’s Disease research claims, evidence, and arguments from a ...jodischneider
 
Innovations in reasoning about health: the case of the Randomized Clinical Tr...
Innovations in reasoning about health: the case of the Randomized Clinical Tr...Innovations in reasoning about health: the case of the Randomized Clinical Tr...
Innovations in reasoning about health: the case of the Randomized Clinical Tr...jodischneider
 
Viewing universities as landscapes of scholarship, VIVO keynote, 2017-08-04
Viewing universities as landscapes of scholarship, VIVO keynote, 2017-08-04Viewing universities as landscapes of scholarship, VIVO keynote, 2017-08-04
Viewing universities as landscapes of scholarship, VIVO keynote, 2017-08-04jodischneider
 
Rhetorical moves and audience considerations in the discussion sections of ra...
Rhetorical moves and audience considerations in the discussion sections of ra...Rhetorical moves and audience considerations in the discussion sections of ra...
Rhetorical moves and audience considerations in the discussion sections of ra...jodischneider
 
Citation practices and the construction of scientific fact--ECA-facts-preconf...
Citation practices and the construction of scientific fact--ECA-facts-preconf...Citation practices and the construction of scientific fact--ECA-facts-preconf...
Citation practices and the construction of scientific fact--ECA-facts-preconf...jodischneider
 
What WikiCite can learn from biomedical citation networks--Wikicite2017--2017...
What WikiCite can learn from biomedical citation networks--Wikicite2017--2017...What WikiCite can learn from biomedical citation networks--Wikicite2017--2017...
What WikiCite can learn from biomedical citation networks--Wikicite2017--2017...jodischneider
 
Acquiring and representing drug-drug interaction knowledge and evidence, Litm...
Acquiring and representing drug-drug interaction knowledge and evidence, Litm...Acquiring and representing drug-drug interaction knowledge and evidence, Litm...
Acquiring and representing drug-drug interaction knowledge and evidence, Litm...jodischneider
 
Acquiring and representing drug-drug interaction knowledge and evidence, TRIA...
Acquiring and representing drug-drug interaction knowledge and evidence, TRIA...Acquiring and representing drug-drug interaction knowledge and evidence, TRIA...
Acquiring and representing drug-drug interaction knowledge and evidence, TRIA...jodischneider
 
Persons, documents, models: organising and structuring information for the We...
Persons, documents, models: organising and structuring information for the We...Persons, documents, models: organising and structuring information for the We...
Persons, documents, models: organising and structuring information for the We...jodischneider
 
Synthesizing knowledge from disagreement -- Manchester -- 2015-05-06
Synthesizing knowledge from disagreement -- Manchester -- 2015-05-06Synthesizing knowledge from disagreement -- Manchester -- 2015-05-06
Synthesizing knowledge from disagreement -- Manchester -- 2015-05-06jodischneider
 
Synthesizing knowledge from disagreement -cwi-2015-04-23
Synthesizing knowledge from disagreement -cwi-2015-04-23Synthesizing knowledge from disagreement -cwi-2015-04-23
Synthesizing knowledge from disagreement -cwi-2015-04-23jodischneider
 
Packaging ideas--nanopublications-in-the-humanities--Europeana--2015-04-21
Packaging ideas--nanopublications-in-the-humanities--Europeana--2015-04-21Packaging ideas--nanopublications-in-the-humanities--Europeana--2015-04-21
Packaging ideas--nanopublications-in-the-humanities--Europeana--2015-04-21jodischneider
 
How communities curate knowledge & how ontologists can help -Eurecom--2015-01-19
How communities curate knowledge & how ontologists can help -Eurecom--2015-01-19How communities curate knowledge & how ontologists can help -Eurecom--2015-01-19
How communities curate knowledge & how ontologists can help -Eurecom--2015-01-19jodischneider
 

Mehr von jodischneider (20)

Towards knowledge maintenance in scientific digital libraries with the keysto...
Towards knowledge maintenance in scientific digital libraries with the keysto...Towards knowledge maintenance in scientific digital libraries with the keysto...
Towards knowledge maintenance in scientific digital libraries with the keysto...
 
Methods Pyramids as an Organizing Structure for Evidence-Based Medicine--SIGC...
Methods Pyramids as an Organizing Structure for Evidence-Based Medicine--SIGC...Methods Pyramids as an Organizing Structure for Evidence-Based Medicine--SIGC...
Methods Pyramids as an Organizing Structure for Evidence-Based Medicine--SIGC...
 
Annotation examples--Fribourg--2019-09-03
Annotation examples--Fribourg--2019-09-03Annotation examples--Fribourg--2019-09-03
Annotation examples--Fribourg--2019-09-03
 
Argumentation mining--an introduction for linguists--Fribourg--2019-09-02
Argumentation mining--an introduction for linguists--Fribourg--2019-09-02Argumentation mining--an introduction for linguists--Fribourg--2019-09-02
Argumentation mining--an introduction for linguists--Fribourg--2019-09-02
 
Beyond Randomized Clinical Trials: emerging innovations in reasoning about he...
Beyond Randomized Clinical Trials: emerging innovations in reasoning about he...Beyond Randomized Clinical Trials: emerging innovations in reasoning about he...
Beyond Randomized Clinical Trials: emerging innovations in reasoning about he...
 
Problem-citations--CrossrefLive18--2018-11-13
Problem-citations--CrossrefLive18--2018-11-13Problem-citations--CrossrefLive18--2018-11-13
Problem-citations--CrossrefLive18--2018-11-13
 
Problematic citations--Workshop-on-Open-Citations--2018-09-03
Problematic citations--Workshop-on-Open-Citations--2018-09-03Problematic citations--Workshop-on-Open-Citations--2018-09-03
Problematic citations--Workshop-on-Open-Citations--2018-09-03
 
Modeling Alzheimer’s Disease research claims, evidence, and arguments from a ...
Modeling Alzheimer’s Disease research claims, evidence, and arguments from a ...Modeling Alzheimer’s Disease research claims, evidence, and arguments from a ...
Modeling Alzheimer’s Disease research claims, evidence, and arguments from a ...
 
Innovations in reasoning about health: the case of the Randomized Clinical Tr...
Innovations in reasoning about health: the case of the Randomized Clinical Tr...Innovations in reasoning about health: the case of the Randomized Clinical Tr...
Innovations in reasoning about health: the case of the Randomized Clinical Tr...
 
Viewing universities as landscapes of scholarship, VIVO keynote, 2017-08-04
Viewing universities as landscapes of scholarship, VIVO keynote, 2017-08-04Viewing universities as landscapes of scholarship, VIVO keynote, 2017-08-04
Viewing universities as landscapes of scholarship, VIVO keynote, 2017-08-04
 
Rhetorical moves and audience considerations in the discussion sections of ra...
Rhetorical moves and audience considerations in the discussion sections of ra...Rhetorical moves and audience considerations in the discussion sections of ra...
Rhetorical moves and audience considerations in the discussion sections of ra...
 
Citation practices and the construction of scientific fact--ECA-facts-preconf...
Citation practices and the construction of scientific fact--ECA-facts-preconf...Citation practices and the construction of scientific fact--ECA-facts-preconf...
Citation practices and the construction of scientific fact--ECA-facts-preconf...
 
What WikiCite can learn from biomedical citation networks--Wikicite2017--2017...
What WikiCite can learn from biomedical citation networks--Wikicite2017--2017...What WikiCite can learn from biomedical citation networks--Wikicite2017--2017...
What WikiCite can learn from biomedical citation networks--Wikicite2017--2017...
 
Acquiring and representing drug-drug interaction knowledge and evidence, Litm...
Acquiring and representing drug-drug interaction knowledge and evidence, Litm...Acquiring and representing drug-drug interaction knowledge and evidence, Litm...
Acquiring and representing drug-drug interaction knowledge and evidence, Litm...
 
Acquiring and representing drug-drug interaction knowledge and evidence, TRIA...
Acquiring and representing drug-drug interaction knowledge and evidence, TRIA...Acquiring and representing drug-drug interaction knowledge and evidence, TRIA...
Acquiring and representing drug-drug interaction knowledge and evidence, TRIA...
 
Persons, documents, models: organising and structuring information for the We...
Persons, documents, models: organising and structuring information for the We...Persons, documents, models: organising and structuring information for the We...
Persons, documents, models: organising and structuring information for the We...
 
Synthesizing knowledge from disagreement -- Manchester -- 2015-05-06
Synthesizing knowledge from disagreement -- Manchester -- 2015-05-06Synthesizing knowledge from disagreement -- Manchester -- 2015-05-06
Synthesizing knowledge from disagreement -- Manchester -- 2015-05-06
 
Synthesizing knowledge from disagreement -cwi-2015-04-23
Synthesizing knowledge from disagreement -cwi-2015-04-23Synthesizing knowledge from disagreement -cwi-2015-04-23
Synthesizing knowledge from disagreement -cwi-2015-04-23
 
Packaging ideas--nanopublications-in-the-humanities--Europeana--2015-04-21
Packaging ideas--nanopublications-in-the-humanities--Europeana--2015-04-21Packaging ideas--nanopublications-in-the-humanities--Europeana--2015-04-21
Packaging ideas--nanopublications-in-the-humanities--Europeana--2015-04-21
 
How communities curate knowledge & how ontologists can help -Eurecom--2015-01-19
How communities curate knowledge & how ontologists can help -Eurecom--2015-01-19How communities curate knowledge & how ontologists can help -Eurecom--2015-01-19
How communities curate knowledge & how ontologists can help -Eurecom--2015-01-19
 

Kürzlich hochgeladen

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 

Kürzlich hochgeladen (20)

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 

Supporting collaborative online arguing -- talk for BICI Frontiers and Connections between Argumentation Theory and Natural Language Processing 2014-07-24

  • 1. Jodi Schneider Frontiers and Connections between Argumentation Theory and Natural Language Processing BiCi seminar series, Bertinoro (Forlì-Cesena), Italy 24 July 2014
  • 2. Topics • Examples of argumentation support • Supporting Collaborative Online Arguing • Structuring scientific argument: Micropublications model
  • 3. Create new spaces for civic debate http://Consider.It "Supporting reflective public thought with ConsiderIt." CSCW 2012 Travis Kriplean, Jonathan Morgan, Deen Freelon, Alan Borning, and Lance Bennett.
  • 4. Create new spaces for civic debate http://Consider.It "Supporting reflective public thought with ConsiderIt." CSCW 2012 Travis Kriplean, Jonathan Morgan, Deen Freelon, Alan Borning, and Lance Bennett.
  • 5. Choose task- appropriate formalisms: SEAS "Template-based structured argumentation." In Knowledge Cartography, Springer London, 2008. John Lowrance, Ian Harrison, Andres Rodriguez, Eric Yeh, Tom Boyce, Janet Murdock, Jerome Thomere, and Ken Murray.
  • 9. Topics • Examples of argumentation support • Supporting Collaborative Online Arguing • Structuring scientific argument: Micropublications model
  • 10. General Approach (from Informatics) 1. Analyze requirements 2. Consider which argumentation models to use 3. Build a prototype support tool 4. Evaluate and iterate
  • 11. 500 Wikipedia debates each week: Should we delete this article?
  • 12. Requirements: Support argumentation tasks • Convince others of your position, using community norms • Determine the overall consensus decision
  • 13. Compare two argumentation theories • Walton’s Argumentation Schemes (Walton, Reed, and Macagno 2008) – Informal argumentation (philosophical & computational argumentation) – Identify & prevent errors in reasoning (fallacies) – 60 patterns • Factors/Dimensions Analysis (Ashley 1991; Bench-Capon and Rissland, 2001) – Case-based reasoning – E.g. factors for deciding cases in trade secret law, favoring either party (the plaintiff or the defendant).
  • 14. Walton’s Argumentation Schemes Example Argumentation Scheme: Argument from Rules – “we apply rule X” Critical Questions 1. Does the rule require carrying out this type of action? 2. Are there other established rules that might conflict with or override this one? 3. Are there extenuating circumstances or an excuse for noncompliance? Walton, Reed, and Macagno 2008
  • 15. “Rule” Argumentation Scheme “Arguments about Deletion: How Experience Improves the Acceptability of Arguments in Ad-hoc Online Task Groups” CSCW 2013
  • 16. “Evidence” Argumentation Scheme “Arguments about Deletion: How Experience Improves the Acceptability of Arguments in Ad-hoc Online Task Groups” CSCW 2013
  • 17. Evidence + Rule -> Conclusion “Arguments about Deletion: How Experience Improves the Acceptability of Arguments in Ad-hoc Online Task Groups” CSCW 2013
  • 18. Supporting Tasks with Walton • Convince others of your position, using community norms – To win an argument, use popular schemes: • Argument from Evidence to Hypothesis (19%) • Argument from Rules (17%) • Determine the overall consensus decision – Ask critical questions to check others' arguments
  • 19. Factors/Dimensions Analysis • Factors (case-based reasoning) – All or nothing • Either present ("applicable") or absent • When present, a factor always favors the same side • Dimensions – More complex/subtle • Can be applicable to a varying degree ("sliding scale") • Favor plantiff on one extreme; defendant on the other Ashley 1991; Bench-Capon and Rissland, 2001
  • 20. Example factors analysis (Aleven 1997) Aleven 1997
  • 21. Wikipedia Factors Analysis Factors determined by iterative annotation 4 Factors cover – 91% of comments – 70% of discussions “Other” as 5th catchall Factor Example (used to justify `keep') Notability Anyone covered by another encyclopedic reference is considered notable enough for inclusion in Wikipedia. Sources Basic information about this album at a minimum is certainly verifiable, it's a major label release, and a highly notable band. Maintenance …this article is savable but at its current state, needs a lot of improvement. Bias It is by no means spam (it does not promote the products). **Other I'm advocating a blanket "hangon" for all articles on newly-drafted players
  • 22. Wikipedia Factors Analysis Factors determined by iterative annotation 4 Factors cover – 91% of comments – 70% of discussions “Other” as 5th catchall Factor Example (used to justify `keep') Notability Anyone covered by another encyclopedic reference is considered notable enough for inclusion in Wikipedia. Sources Basic information about this album at a minimum is certainly verifiable, it's a major label release, and a highly notable band. Maintenance …this article is savable but at its current state, needs a lot of improvement. Bias It is by no means spam (it does not promote the products). **Other I'm advocating a blanket "hangon" for all articles on newly-drafted players
  • 23. Wikipedia Factors Analysis Factor Example (used to justify 'keep') Example (used to justify 'delete' Notability Anyone covered by another encyclopedic reference is considered notable enough for inclusion in Wikipedia. There is simply no coverage in reliable sources to establish notability. Sources Basic information about this album at a minimum is certainly verifiable, it's a major label release, and a highly notable band. There are no independent secondary sources (books, magazine articles, documentaries, etc.) about her. Maintenance …this article is savable but at its current state, needs a lot of improvement. Too soon for a page likely to be littered with rumour and speculation. Bias It is by no means spam (it does not promote the products). The article seems to have been created by her or her agent as a promotional device. **Other I'm advocating a blanket "hangon" for all articles on newly-drafted players it appears to be original research by synthesis Deletion Discussions in Wikipedia: Decision Factors and Outcomes. WikiSym 2012.
  • 24. Supporting Tasks with Factors • Convince others of your position, using community norms – To win an argument, talk about the right topics • Notability, Sources, Maintenance, Bias • Determine the overall consensus decision – Group messages by factor – Summarize prevalence
  • 26. Argument Schemes vs. Factors? • Argument Schemes (kappa=.48) Details of how to put together an argument – Could support WRITING detailed arguments – Critical Questioning • Factors (kappa=.64-.82, based on factor) Topics of discussion – Basic support for writing arguments – Summarization supports decision-making
  • 27. Argument prevalence depends on the corpus • Wikipedia – Argument from Evidence to Hypothesis (19%) – Argument from Rules (17%) • Arucaria – Argument from example (38%) – Argument from cause to effect (27%) – Practical reasoning (14%) – Argument from consequences (11%) – Argument from verbal classification (10%)
  • 28. Topics • Examples of argumentation support • Supporting Collaborative Online Arguing • Micropublications model: Structuring scientific argument
  • 30. Model Data, Methods, Materials, References Micropublications: a Semantic Model for Claims, Evidence, Arguments and Annotations in Biomedical Communications Tim Clark, Paolo N. Ciccarese, Carole A. Goble http://arxiv.org/abs/1305.3506
  • 31. Direct Annotation with Domeo http://swan.mindinformatics.org/ Paolo N Ciccarese
  • 32. Micropublication: Claim + Support (e.g. Attribution) Micropublications: a Semantic Model for Claims, Evidence, Arguments and Annotations in Biomedical Communications Tim Clark, Paolo N. Ciccarese, Carole A. Goble http://arxiv.org/abs/1305.3506
  • 33. Constructs claim-argument network across scientific papers Micropublications: a Semantic Model for Claims, Evidence, Arguments and Annotations in Biomedical Communications Tim Clark, Paolo N. Ciccarese, Carole A. Goble http://arxiv.org/abs/1305.3506
  • 34. Argumentation Mining papers Arguing on Wikipedia • “Arguments about Deletion: How Experience Improves the Acceptability of Arguments in Ad-hoc Online Task Groups” CSCW 2013. • “Deletion Discussions in Wikipedia: Decision Factors and Outcomes” WikiSym2012. Arguing in Social Media • “Dimensions of Argumentation in Social Media" EKAW 2012 • “Why did they post that argument? Communicative intentions of Web 2.0 arguments.” Arguing on the Web 2.0 at ISSA 2014 Arguing in Reviews • “Identifying Consumers' Arguments in Text” SWAIE 2012 • “Semi-Automated Argumentative Analysis of Online Product Reviews" COMMA 2012 • “Arguing from a Point of View” Agreement Technologies 2012 Structuring Arguments on the Social Semantic Web • “A Review of Argumentation for the Social Semantic Web” Semantic Web – Interoperability, Usability, Applicability, 2013. • “Identifying, Annotating, and Filtering Arguments and Opinions in Open Collaboration Systems" 2013 Thesis: purl.org/jsphd • “Modeling Arguments in Scientific Papers” at ArgDiaP 2014 http://jodischneider.com/jodi.html
  • 35. Argumentation mining today • No unified vision of the field. Multiple: – Interrelated problems – Application domains – Tools handling one aspect of annotation • Few corpora • Need for – Common definition(s) of argumentation – "Challenge problems" – Shared corpora – Applications
  • 36.
  • 37. Example: "Stop at a red light" 1. Does the rule require carrying out this type of action? Were you driving a vehicle? 2. Are there other established rules that might conflict with or override this one? Did a police officer direct you to continue without stopping? 3. Are there extenuating circumstances or an excuse for noncompliance? Were you driving an ambulance with its siren on? Critical Questions from Argument from Rules based on Walton, Reed, and Macagno 2008
  • 38. None of Wikipedia's top-used schemes are prevalent in Arucaria. Classifying Arguments by Scheme. Vanessa Wei Feng. Master's thesis, Toronto, 2010.
  • 39. Goal: large-scale arguing • Search for issues, claims, and opinion clusters • Link to evidence when writing your opinion • Publish and navigate claims networks
  • 40. Online argumentation support interfaces can: • Promote "listening" in online conversations • Support incremental formalization • Slice and dice the views • Collect crisp examples • Support distributed sensemaking
  • 41. Argumentation mining could be the basis for support tools • Help participants write persuasive arguments – How: provide personalized feedback on drafts – Requires: knowing which arguments are accepted; identifying argumentation in a drafts • Find weaknesses in others’ arguments – How: suggest & instantiate relevant critical questions – Requires: identifying argumentation schemes • Summarize the overall conclusions of the debate – How: identify the winning and losing rationales – Requires: identifying rationales and contradictions

Hinweis der Redaktion

  1. 20 min http://www-sop.inria.fr/members/Serena.Villata/BiCi2014/frontiersARG-NLP.html BiCi Frontiers and Connections between Argumentation Theory and Natural Language Processing
  2. ConsiderIt https://livingvotersguide.org/wash__1240/results Videolyzer
  3. ConsiderIt https://livingvotersguide.org/wash__1240/results Videolyzer
  4. ArguNet Climate CoLab (formerly Deliberatorium)
  5. When the argumentation scheme used in a draft message is not generally accepted, the author could be warned that their message might not be persuasive, and given personalized suggestions Listing these questions in concrete and contextualized form (drawing on the premises, inference rules, and conclusions to instantiate and contextualize them) would encourage participants to consider the pos- sible flaws in reasoning and might prompt partici- pants to request answers within the debate. Macro- argumentation, such as the factors analysis de- scribed above, would be a natural choice for sum- marization, as it has already proven useful for fil- tering discussions. A more reasoning-intensive approach would be to calculate consistent out- comes (Wyner and van Engers, 2010), if debates can be easily formalized.