12. TalkExplorer Studies I & II
• Study I
• Controlled Experiment: Users were asked to discover
relevant talks by exploring the three types of entities:
tags, recommender agents and users.
• Conducted at Hypertext and UMAP 2012 (21 users)
• Subjects familiar with Visualizations and Recsys
• Study II
• Field Study: Users were left free to explore the
interface.
• Conducted at LAK 2012 and ECTEL 2013 (18 users)
• Subjects familiar with visualizations, but not much with
RecSys
7/17/16 D. Parra, IFUP keynote, UMAP 2016 12
18. SetFusion - II
Sliders
Allow the user to control the importance of
each data source or recommendation method
Interactive Venn Diagram
Allows the user to inspect and to filter papers
recommended. Actionsavailable:
- Filter item list by clicking on an area
- Highlight a paper by mouse-over on a circle
- Scroll to paper by clicking on a circle
- Indicate bookmarkedpapers
7/17/16 D. Parra, IFUP keynote, UMAP 2016 18
22. SetFusion – UMAP 2013
• Field Study: let users freely explore the interface
- ~50% (50 users) tried the
SetFusion recommender
- 28% (14 users) bookmarked at
least one paper
- Users explored in average 14.9
talks and bookmarked 7.36
talks in average.
7/17/16 D. Parra, IFUP keynote, UMAP 2016 22
25. TalkExplorer vs. SetFusion
• Comparing distributions of explorations
Comparing the field studies:
- In TalkExplorer, 84% of
the explorationsover
intersectionswere
performed over clusters of
1 item
- In SetFusion, was only
52%, compared to 48%
(18% + 30%) of multiple
intersections, diff. not
statistically significant
7/17/16 D. Parra, IFUP keynote, UMAP 2016 25
34. Regression Analysis
• Including Recentness increases R2 in more than 10% [ 1 -> 2]
• Including GP increases R2, not much compared to RE + IF [ 1 -> 3]
• Not Including GP, but including interaction between IF and RE
improves the variance of the DV explained by the regression model. [
2 -> 4 ]
M1: implicit feedback
M2:
implicit
feedback &
recentness
M4:
Interaction of
implicit
feedback &
recentness
M3: implicit
feedback,
recentness,
global
popularity
7/17/16 D. Parra, IFUP keynote, UMAP 2016 34
37. Recalling the 1st study (5/5)
• Prediction of rating by multiple Linear Regression
evaluated with RMSE.
• Results showed that Implicit feedback (play count
of the album by a specific user) and recentness
(how recently an album was listened to) were
important factors, global popularity had a weaker
effect.
• Results also showed that listening style (if user
preferred to listen to single tracks, CDs, or either)
was also an important factor, and not the other
ones.
7/17/16 D. Parra, IFUP keynote, UMAP 2016 37
68. Summary
• Best results: Post-filtering combined with power
decay gives the best
• Pre- and Post-filtering produce a strong effect, but
UB-CF is more susceptible than IB-CF to the effect
of filtering specially pre-filtering.
• The hybridization of UB and IB improves makes the
recommendation more robust.
• Future work: fit parameters on a user basis rather
than dataset basis.
7/17/16 D. Parra, IFUP keynote, UMAP 2016 68