komachi lab

1. CITATION NEEDED: A TAXONOMY
AND ALGORITHMIC ASSESSMENT OF
WIKIPEDIA’S VERIFIABILITY
MIRIAM REDI, BESNIK FETAHU, JONATHAN MORGAN,
DARIO TARABORELLI
D2 ANDO
WWW 2019
1

2. • Wikipedia ” “
• ” “(Verifiability)
≒
• Wikipedia
•
2

3. • Citation {citation needed} 350,000
• Citation Citation
• Citation
1. Citation
2.
3

4. • Wikipedia Cita*on
verifica*on, fact-checking
•
•
•
• Cita*on
Cita*on
4

5. WIKIPEDIA
• Stub
•
• featured articles
•
• Stub Citation Best practice
Gold label Stub
5

6. CITATION NEEDED
• Featured
• featured ar*cles 10,000 posi*ve ({cita*on needed}
) nega*ve ({cita*on needed} )
• Low Quality
• 1 {cita*on needed} posi
nega 26,140
• Cita*on
• Random
• 200,000 posi nega
6

7. CITATION
• Wikipedia Citation ([1])
Citation
⇨
7

8. CITATION REASON GOLD LABEL
• 35 335 (posi=255, nega=80)
13
• ⇨
8

9. CITATION REASON CROWD WORK
• 3 , 498
•
• 0.63
•
•
• Statics,
Scientific,
Historical,
Quotation
opinion,
•
• Statement 9
0.6(0.6~good)

10. CITATION REASON
• Featured articles 4,000 {citation needed}
Amazon Mechanical Turk
•
10
Expert

11. • Vanilla RNN
• Bi-RNN
• RNN with
Global Attention
• Glove
11
Context vector Context?
Attension Reason
context Attension

12. FEATURE
• Feature-based Baseline
• Factive Verbs.
• Assertive Verbs.
• Entailment Verbs.
• Stylistic Features.
• POS
• Word Vector-Based Baseline
•
• Random Forest
12

13. • Section Featured articles Over view
• Featured articles Section + Attention
FA Train
• Data set
13
Grey out?RNN

14. •
•
• Citation
⇨Annotation
• Annotation
•
14

15. CITATION REASON MODEL
•
• Citation Needed Dense
Fine-tuning
• train
• Pre-trained
• 4000 50% Train 50%
Test
•
15

16. •
end to end
•
•
•
17

17. • Citation Hunt Citation
Citation
18