Participation to the Linked Data Mining Challenge at KNOW@LOD, ESWC2016 by Petar Petrovski and myself. Paper available at http://ceur-ws.org/Vol-1586/ldmc4.pdf

1. KNOW@LOD challenge – P. Petrovski, A. L. Gentile
Can you judge a music
album by its cover?
Petar Petrovski and Anna Lisa Gentile
ESWC2016 – 30th May 2016

2. KNOW@LOD challenge – P. Petrovski, A. L. Gentile
Music album classification
TASK
• predicting the rating of music albums
• exploiting any available data from the LOD cloud
DATASET
• a sample of musical albums from Metacritic labeled
as “good” (critics’ score > 79) and “bad” ( <63)

3. KNOW@LOD challenge – P. Petrovski, A. L. Gentile
The idea
Only exploit album covers to make the prediction

4. KNOW@LOD challenge – P. Petrovski, A. L. Gentile
Music album classification: pipeline

5. KNOW@LOD challenge – P. Petrovski, A. L. Gentile
Similar work
L ̄ıbeks and Turnbull (2011)
• image of an artist can play a role in how we judge a
music album
• predict music genre tags based on image analysis
• assess similarity amongst artists to inform the
music discovery process

6. KNOW@LOD challenge – P. Petrovski, A. L. Gentile
ImageNet - A ConvNet Model
Jia et al. Caffe: Convolutional architecture for fast feature embedding. ACM (2014)
Conv1 Conv2 Conv3 Conv4 Conv5 FC1 FC2

7. KNOW@LOD challenge – P. Petrovski, A. L. Gentile
ConvNet Image Features
Apply image filter to get visual features (example)

8. KNOW@LOD challenge – P. Petrovski, A. L. Gentile
ConvNet Image Features
• Visual features - lower layers
• edges
• orientation
• blotch of color
• Visual features - higher layers
• honeycomb pattern
• wheel-like pattern

9. KNOW@LOD challenge – P. Petrovski, A. L. Gentile
Results
Accuracy on the challenge system - 60.3125%
true good true bad class
precision
pred. good 385 282 57.72%
pred. bad 254 356 58.36%
class recall 60.25% 55.80%

10. KNOW@LOD challenge – P. Petrovski, A. L. Gentile
Possible future work
Use image features as supplement to traditional
features (artist, genre, # of tracks)
Build additional Neural Network model specifically
built on music album covers

11. KNOW@LOD challenge – P. Petrovski, A. L. Gentile

12. KNOW@LOD challenge – P. Petrovski, A. L. Gentile
Can you judge a music
album by its cover?
Petar Petrovski
petar@informatik.uni-mannheim.de
@ppetrovsk