How do we make sense out of disagreement on the social web?
A talk about my dissertation work, given to the University of Limerick Interaction Design Centre on 2012-04-18.
How to Troubleshoot Apps for the Modern Connected Worker
Making sense out of disagreement, University of Limerick Interaction Design Centre, 2012-04-18
1. Digital Enterprise Research Institute www.deri.ie
Making sense out of disagreement
Jodi Schneider
Interaction Design Centre, U. Limerick Wednesday18th April 2012
Limerick, Ireland
Copyright 2011 Digital Enterprise Research Institute. All rights reserved.
Enabling Networked Knowledge
1
4. How can we make sense of
disagreement?
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
5. Example problems
Digital Enterprise Research Institute www.deri.ie
Issue a press release responding to Tweet complaints
Book a hotel room based on reviews
Decide whether to delete a Wikipedia article
Enabling Networked Knowledge
5
6. What’s the key complaint?
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
6
7. Decision-making patterns
Digital Enterprise Research Institute www.deri.ie
Individual/small group based on many inputs
Issue a press release response to Tweet complaints
Book a hotel room based on reviews
Collective, distributed
Decide whether to delete a Wikipedia article
Enabling Networked Knowledge
7
8. Three typical approaches
Digital Enterprise Research Institute www.deri.ie
Collective intelligence
Spatial hypertext
Argument mapping
Enabling Networked Knowledge
8
12. Issues
Digital Enterprise Research Institute www.deri.ie
Dedicated platforms
Individual & small group decision-making
Amplify & aggregate agreement
Enabling Networked Knowledge
12
13. New issues at Webscale
Digital Enterprise Research Institute www.deri.ie
Large-scale, across websites
Trade-off between automation & depth of analysis
Issues of trust, reputation &provenance
Open decision-making
Enabling Networked Knowledge
13
14. Large-scale, across websites
Digital Enterprise Research Institute www.deri.ie
J. G. Breslin, A. Harth, U. Bojars, & S.
Decker, “Towards Semantically-
Interlinked Online Communities,
(2005), ESWC 2005.
Enabling Networked Knowledge
14
15. Automate & go deep
Digital Enterprise Research Institute www.deri.ie
Cartwright, D. & Atkinson, K. (2009).
Using Computational Argumentation to
Support E-participation. IEEE Intelligent
Systems 5(24):42-52.
Enabling Networked Knowledge
15
16. Trust & credibility
Digital Enterprise Research Institute www.deri.ie
Ennals, R., Trushkowsky, B., &Agosta, J. M. (2010). Highlighting Disputed
Claims on the Web. In WICOW at WWW 2010.
Enabling Networked Knowledge
16
17. Open decision-making
Digital Enterprise Research Institute www.deri.ie
Deletion in Wikipedia
Collaborative & distributed
Case study on work-in-progress
Enabling Networked Knowledge
17
19. Should we delete this article?
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
19
20. Deletion argument
Digital Enterprise Research Institute www.deri.ie
[Delete the article]...hasn't played
since 2008. His 66-73 record is
far from stellar and, in my
opinion, does not merit an
article.
>>He pitched last month and
plays for the Venezuelan
League. This meets our article
criteria.
Enabling Networked Knowledge
20
21. Decision-making support
Digital Enterprise Research Institute www.deri.ie
What viewpoints are expressed?
What values motivate the assembled decision-makers?
What are the decision criteria?
What argumentation schemes are used?
Enabling Networked Knowledge
21
22. Viewpoint
Digital Enterprise Research Institute www.deri.ie
[Delete the article]...hasn't played
since 2008. His 66-73 record is
far from stellar and, in my
opinion, does not merit an
article.
Proposition: does not merit an
article
Justification: hasn’t played since
2008, bad record
Enabling Networked Knowledge
22
23. Opposing viewpoint
Digital Enterprise Research Institute www.deri.ie
>>He pitched last month and
plays for the Venezuelan
League. This meets our article
criteria.
Proposition: keep the article
Justification: meets our article
criteria
Enabling Networked Knowledge
23
24. Decision criteria
Digital Enterprise Research Institute www.deri.ie
>>He pitched last month and
plays for the Venezuelan
League. This meets our
article criteria.
Criteria: Our article criteria
Enabling Networked Knowledge
24
25. Values
Digital Enterprise Research Institute www.deri.ie
[Delete the article]...hasn't played
since 2008. His 66-73 record
is far from stellar and, in my
opinion, does not merit an
article.
Values: Good record/win rate
Enabling Networked Knowledge
25
26. Our approach
Digital Enterprise Research Institute www.deri.ie
Collect viewpoint arguments & counterarguments
Make knowledge representations
Enabling Networked Knowledge
26
28. Using our Viewpoints Web
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
28
29. How do we make one?
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
29
30. Technologies needed
Digital Enterprise Research Institute www.deri.ie
Ontologies
Text analysis
Argumentation
HCI
Enabling Networked Knowledge
30
31. Acknowledgments
Digital Enterprise Research Institute www.deri.ie
Thanks to our collaborators!
Katie Atkinson, Trevor Bench-Capon, Adam Wyner (Liverpool)
DERI Social Software Unit
Rhetorical Structure Taskforce, W3C Health Care/Life Sciences
Funding
Science Foundation Ireland Grant No. SFI/08/CE/I1380 (Líon-2)
Short-term scientific mission (STSM 1868) from the COST Action
ICO801 on Agreement Technologies
Upcoming: SFI Travel Supplement
Enabling Networked Knowledge
31
32. Thanks!
Digital Enterprise Research Institute www.deri.ie
jodi.schneider@deri.org
http://jodischneider.com/jodi.html
@jschneider
Enabling Networked Knowledge
32
33. Twitter: Standpoint
Digital Enterprise Research Institute www.deri.ie
Difference between cakes and biscuits? When stale, cakes
go hard, biscuits go soft. Hence Jaffa Cakes are cakes.
(Was official EU ruling).
View: Jaffa Cakes are cakes
Justification: official EU ruling; go hard when stale
Enabling Networked Knowledge
33
Hinweis der Redaktion
From http://www.sendareview.com/The Web is full of opinions & commentary.A lot of it disagrees.How do we learn from other people, when they disagree?
Collaborative, distributed decision-makingIndividual sense-making informed by many opinionsIndividual decision-making informed by many opinions
Collaborative, distributed decision-makingIndividual sense-making informed by many opinionsIndividual decision-making informed by many opinions
Value-basedPractical ReasoningPremises: Before doing action A, the current circumstances are R;After doing action A, the new circumstances are S;G is a goal of the agent Ag, where S implies G; Doing action A in R and achieving G promotes value V;Conclusion: We should perform action A.
Screenshot of the article Heath Totten
Anyone can participateLarge number of discussions, ~500/weekLong discussion threadsCan be hard to reach consensusDiscussions can be reopened & repeated