Presented at Web Directions South 09 The ABC launched three new socially networked digital radio websites: ABC Dig Music, ABC Jazz and ABC Country in July 2009. They are the first of several ABC projects involving content aggregation. As well as having slick, highly usable designs the music platform integrates with various sources including MusicBrainz, YouTube, Last.fm and Wikipedia. This aggregation functionality graphically illustrates the possibilities of Semantic Web technology for an editorial organisation such as the ABC.

1. THE MASHED UP PLAYLIST part II David Peterson @davidseth #w3c http://www.flickr.com/photos/soyignatius/

2. David Peterson@davidseth

3. Challenge Create a snapshot of an artist

4. Problem <xml> <track> <title>Purple Rain</title> <artistName>Prince</artistName> </track></xml>

5. Into

6. It’s all about story telling

7. Shared Understanding Can’t tell a story if the other person doesn’t get what we mean Or even speak the same language Imagine explain what a kiwi was or what a sheep was

8. The story matters ... but ... You never really have all the information you need, whether big or small

9. You Just don’t Always Know Someone else knows more than you How to find it?

10. One Exception

11. Semantic Web Core idea you never really know the entire picture This is a good thing Freedom

12. Open World Closed World http://www.flickr.com/photos/almasryalyoum_e/

13. Finding a Solution Which APIs to use Which APIs can we use How can we combine data from multiple sources How can we automate it

14. The Curse of too much There are over 50 APIs listed on programmableweb.com Too many to look into Each has its own API methods and return data formats JSON, XML, RSS, RDF !!!

15. Take your Pick APIs everywhere BBC Music Discogs Last.fm MusicBrainz Yahoo Music Flickr Youtube The Hype Machine

16. Finding the key One common feature was the usage of a MusicBrainz ID Last.fm Discogs Freebase Wikipedia/Dbpedia BBC

17. Eureka! Great, now all I had to do was use the MusicBrainz API to look up the ID and I was done. Easy... :( The search API sucked. It returned too many fuzzy results crap

18. Back to the future This is where the Semantic Web enters the picture All that stuff about story telling Shared understanding URIs (web links)

19. SPARQL Think of it as Google with a WHERE clause

20. SELECT ?artist WHERE { ?artist foaf:name"Prince"@en . ?artist a <http://dbpedia.org/ontology/MusicalArtist>. }

21. SELECT ?artist ?bio ?url?album WHERE { ?artist foaf:name"Prince"@en . ?artist a <http://dbpedia.org/ontology/MusicalArtist> . ?artist dbpedia2:abstract ?bio . ?artist foaf:page?url. OPTIONAL { ?album <http://dbpedia.org/ontology/artist> ?artist . ?album rdfs:label"Purple Rain"@en . } } LIMIT 1

22. Pinpoint results This returns ONE result “exactly” what we are looking for (or nothing!)

23. {170d193a-845c-479f-980e-bef15710653e} http://www.flickr.com/photos/riseofphoenix/

24. {070d193a-845c-479f-980e-bef15710653e} http://www.flickr.com/photos/angeldew/

25. Raw Data Not too pretty to look at But computers LOVE this stuff

26. So, what do we get Disambiguation MusicBrainz ID Discography Related Artists Official homepage Bio Credit card details (in Semantic Web 2.0)

27. The Rosetta Stone MusicBrainz ID is our key to the wild web of APIs Wikipedia URL is the key to Semantic Web One happy family http://www.flickr.com/photos/vportals/

28. [insert LOD graph]

29. Take a look [browser]

30. Hindsight is 20/20 ... or lessons learned

31. Drupal Sucks Drupal performance, what performance? Out of the box it’s been beaten with an ugly stick

32. Don’t use Drupal To get the best performance out of Drupal, don’t use Drupal

33. Pressflow Key patches and enhancements Releases mirror official Drupal releases Big players are using it Drupal.org ABC Music labels Newspapers

34. Start your Engines MySQL base install is ... lacking MyISAM == slow Use PerconaXtraDB ... or ... InnoDB

35. Reduce your footprint APC PHP app is compiled & cached in memory

36. Search Drupal’s built in search can be a dawg Solr Much faster search Offers faceting Can become a platform in its own right.

37. A Fresh Coat of Paint Varnish Last but certainly not least Up to 10 million hits per hour

38. What’s Next? Project Mercury Drupal 7 RDFa Views 3 FOAF+SSL open social networking everything under your control