Joost de Wit sprak op de tweede sessie van de vierdelige serie Master Minds on Data Science over multimedia datamining

1. Media Distillery Live monitoring van radio en TV

2. Founded by Geert Vos and Joost de Wit

3. Media Distillery is part of tech incubator YES!Delft

5. MKB Innovation Top 100, 2015
Placed 14th
LiveWIRE Award 2015
Top 8
Sprout Startup of the Year 2014
Top 5
Accenture Innovation Awards 2014
Top 10
New Venture
Top 10 in round 1 and 2

6. There’s more and more video content

7. Source: http://www.youtube.com/yt/press/statistics.html
100 hours of video are uploaded to
YouTube every minute

9. 300.000.000views / year
Source: http://www-assets.npo.nl/uploads/media_item/media_item/99/13/Jaarverslag_2014-1435691079.pdf

10. Video already ‘consumes’ 2/3 of the Internet traffic
VideoOther
Source: http://www.cisco.com/c/en/us/solutions/service-provider/visual-networking-index-vni/index.html#~complete-forecast

11. 200
min /
day
Source: https://kijkonderzoek.nl/images/SKO_Jaarrapport/SKO_jaarrapport_2014.pdf

12. But we still can’t search in video content!

13. Adding metadata used to be manual labour

14. Until now…

15. We use advanced data mining to analyse video

16. Both broadcast & on-line sources
Teletext
Speech
Subtitles
Logos
Faces
Being developed

17. Analyze
Live
metadata
Search in live
TV & radio
Create archive
Search Keep

18. Media Monitoring Content Owners
Brand Monitoring
!
Competitor Monitoring
!
Crisis Monitoring
!
Campaign Monitoring
Enhanced metadata
!
Advanced content
search
!
Quality content
recommendations

19. 26 Dutch radio and TV channels
Both national and regional
150 news and newsreel programs / day

20. “Voedselverpakkingen van gerecycled karton zijn gevaarlijk,
er kunnen resten van olie in zitten.”
27-10-2015 14:00
RTL Z Nieuws

21. Dieselschandaal Volkswagen
Ook in de 3-liter motor
blijkt sjoemelsoftware te zitten
Ook in Europa blijkt Volkswagen te sjoemelen
met de uitstoot van hun dieselmotoren
Volkswagen geeft toe dat ze testresultaten
hebben beïnvloed in de VS
Alle dieselauto’s met sjoemelsoftware moeten
verplicht worden teruggehaald

22. 75% of the content watched by users was
recommended to them
Source: http://www.mckinsey.com/insights/consumer_and_retail/how_retailers_can_keep_up_with_consumers

23. Suggested content accounts for about 60% of
all video clicks
Source:http://stuyresearch.googlecode.com/hg-history/.../blake/resources/p293-davidson.pdf

25. Watskeburt?! — Koppensnellen voor video

26. Blueprint plaatje
Blueprint of a large scale video search platform

27. Rich metadata
NOS JournaalEPG
Speech
Logo
Topic
Het Nederlands elftal is voor een
Het Nederlands elftal is voor een
ING
Voetbal

28. 1 + 1 = 3

29. Content
Service
Notification
Service
Search
Service
Metadata
Service
Media Distillery
Dashboard
BNR
Trends &
Tagcloud
Service
Large Scale
Video Storage
Video Search
Engine
Teletext
Extractor
Speech
Recognizer
Subtitle
Extractor
Logo
Recognizer
Face
Recognizer
Uitzending
Gezocht

30. ingest
search index
video cluster
backup server
image processing
speech recognition
VM’s

31. ROI selection
Text extraction
OCR
Utterance detection
Garbage detection

33. Sasha
Obama

34. Challenges

35. Realtime constraint
Quality Cost

36. de NS > Dennis Artis > Wacht’s

37. Dialect Generieke merken

38. Future developments

39. Case: Logo Recognition using ‘conventional’ SIFT
MatchSelectDescribe

40. Case: Logo Recognition using ‘conventional’ SIFT
Time
0
25
50
75
100
#logo’s
0 25 50 75 100

41. Deep Learning Logo Recognition
• KPN
• Jumbo
• ING
• Philips
• Shell
• Volkswagen
• AEGON
• …

42. New
Face Recognition
Text in the wild
Ad Detection
!
Improve
Speech Recognition
Subtitle Extraction
Logo Recognition

43. Any questions?

44. Joost de Wit
06-50983893
joost@mediadistillery.tv
Geert Vos
06-41554428
geert@mediadistillery.tv