Slides about LiquidPub project, presented at the 2nd Snow Workshop http://wiki.liquidpub.org/mediawiki/index.php/Second_Workshop_on_Scientific_Knowledge_Creation%2C_Dissemination%2C_and_Evaluation

1. OpinioNet: The LiquidPub Reputation Module
Nardine Osman, Jordi Sabater, Carles Sierra
IIIA-CSIC
2nd Workshop on Scientific Knowledge Creation, Dissemination, and Evaluation
February 2010
N. Osman, J. Sabater,C. Sierra (IIIA) OpinioNet: LP Reputation Module February 2010 1 / 11

2. Use Case: Credit Attribution in Liquid Journals
Liquid Journals and the SKO model:
KEY
Liquid Journal
Liquid Journal (solid) Issue
Liquid Journal Article
part of relation (solid)
bookmarks relation (liquid/dynamic)
...
... ... ...
Note: All nodes (journals, issues, and articles) are viewed as SKOs.
N. Osman, J. Sabater,C. Sierra (IIIA) OpinioNet: LP Reputation Module February 2010 2 / 11

3. Use Case: Credit Attribution in Liquid Journals
Information sources for computing reputation:
+ activity counters
(e.g. number of subscriptions)
KEY
Liquid Journal
Liquid Journal (solid) Issue
Liquid Journal Article
part of relation (solid)
bookmarks relation (liquid/dynamic)
...
... ... ...
+ authors’ h-indexes (default)
+ activity counters
+ citations & their author’s h-indexes
Note: These are not fixed, we can add more sources as we see fit.
N. Osman, J. Sabater,C. Sierra (IIIA) OpinioNet: LP Reputation Module February 2010 3 / 11

4. Use Case: Credit Attribution in Liquid Journals
Transforming obtained information into opinions:
KEY
Liquid Journal
Liquid Journal (solid) Issue
Liquid Journal Article
part of relation (solid)
bookmarks relation (liquid/dynamic)
... opinions
... ... ...
Note: Each piece of information may be viewed as an opinion.
N. Osman, J. Sabater,C. Sierra (IIIA) OpinioNet: LP Reputation Module February 2010 4 / 11

5. Use Case: Credit Attribution in Liquid Journals
Opinions may propagate following the OpinioNet algorithm:
KEY
Liquid Journal
propagation Liquid Journal (solid) Issue
of opinions Liquid Journal Article
part of relation (solid)
bookmarks relation (liquid/dynamic)
... opinions
... ... ...
Note: Propagation direction is different along different relations.
N. Osman, J. Sabater,C. Sierra (IIIA) OpinioNet: LP Reputation Module February 2010 5 / 11

6. OpinioNet: calculating the reputation of research
Reliability measure

1

 direct(Pt ) ∧ t ≤ t
n



0 ¬direct(Pt )∀t ≤ t


 n
t
πn = ∧ ∃ c · (c, n) ∈ E (1)


t


 πc
otherwise


|{c | (c, n) ∈ E}|



∀c·(c,n)∈E
N. Osman, J. Sabater,C. Sierra (IIIA) OpinioNet: LP Reputation Module February 2010 6 / 11

7. OpinioNet: calculating the reputation of research
Intrinsic opinions:
Opinion calculation - Aggregation of children’s opinions
1
Pt =
n · π c · Pt
t
c (2)
t
πc ∀ c · (c,n)∈E
∀ c · (c,n)∈E
Opinion decay
Pt = (Ptn − Dtn )ν ∆t + Dtn
n n n n (3)
N. Osman, J. Sabater,C. Sierra (IIIA) OpinioNet: LP Reputation Module February 2010 7 / 11

8. OpinioNet: calculating the reputation of research
Extrinsic opinions:
Opinion calculation - Aggregation of parents’ opinions
1
Dt =
n · πp · Pt
t
p (4)
t
πp ∀p·(n,p)∈E
∀p·(n,p)∈E
Opinion decay
Dt = (Dtn − F)ν ∆t + F
n n (5)
N. Osman, J. Sabater,C. Sierra (IIIA) OpinioNet: LP Reputation Module February 2010 8 / 11

9. OpinioNet: calculating the reputation of research
Aggregating opinions:
Aggregating opinions for all attributes
X
ρ(a) · P(ei |r , n, a, t)
∀ a∈A · P(ei |r ,n,a,t)=F
P(ei |r , n, , t) = X (6)
ρ(a)
∀ a∈A · P(ei |r ,n,a,t)=F
Aggregating opinions for all reviewers
X
Ω(r , n) · P(ei |r , n, a, t)
∀ r ∈G · P(ei |r ,n,a,t)=F
P(ei | , n, a, t) = X (7)
Ω(r , n)
∀ r ∈G · P(ei |r ,n,a,t)=F
t
Calculating a final reputation measure Rn ∈ [0, 1]
t 1 X
Rn = (2 · υ(ei ) − 1) · P(ei | , n, , t) (8)
2 · |E | e ∈E
i
N. Osman, J. Sabater,C. Sierra (IIIA) OpinioNet: LP Reputation Module February 2010 9 / 11

10. A Final Note
What we still need to do for the 2nd year review:
Implement the author’s reputation mechanism
Design & generate Liquid Journal example that OpinioNet will run on
Design & implement the presentation of results through a widget
Apply OpinioNet to the Liquid Conference use case (?)
N. Osman, J. Sabater,C. Sierra (IIIA) OpinioNet: LP Reputation Module February 2010 10 / 11

11. Questions?
For more information, please visit:
http://project.liquidpub.org/reputation/
N. Osman, J. Sabater,C. Sierra (IIIA) OpinioNet: LP Reputation Module February 2010 11 / 11