Discussion on future technology for television production on the EBU Production Technology Seminar by Maarten Verwaest. (Geneva - 2009, January 27th)

1. Future Television Production – Proof of Concept PISA - Production, Indexing and Search of AudiovisualMaterial

2. 2 PISA - Positioning VRT-Medialab (medialab.vrt.be) - technical R&D IBBT (www.ibbt.be) – InterdisciplinaryResearch Institute PISA – Research Project on Production and Indexing of Audiovisual Media 30 Man-year VideoSearchTechnology UnsupervisedFeature Extraction Computer AssistedManufacturing

3. 3 Digital Media Production Client (local file system + I/O stack) IP network (SUPERNET II) GPFS File system Cluster node FC network (SAN) Storage controller (DS4500) FC-AL loops (disk connection network) Hard disk Suprastructure – Metadata Mgnt Production and distribution Editing Mastering Media Asset Mgnt Ingest Playout Infrastructure - Networks and Storage Production Platform

4. 4 Digital Media Production Suprastructure – Metadata Mgnt Production and distribution Production and distribution Editing Mastering Media Asset Mgnt Ingest Playout Infrastructure - Networks and Storage Production Platform

5. 5 Product Engineering Suprastructure – Metadata Mgnt Production and distribution Infrastructure - Networks and Storage Production Platform

6. 6 Meta Data Meta Data Data Video Audio Digital Media Distribution Communication (Information) Suprastructure – Metadata Mgnt Production and distribution Broadcast via DVB, DSL or Cable Infrastructure - Networks and Storage Production Platform Distribution Platform

7. Digital Asset Management, Content Management… The NEXT MAM SYSTEM

8. 8

10. Scalable content served by multiple distribution channels

11. Hybrid formats complementaryusing multiple distribution channels

12. Value added applications (EPG, Favorites, MyChannel,…) relie on variousmetadata sources

15. Concurrent Engineering (Collaborative production) increases productivity

16. Modular production apparatus enables a configurable product

17. A Digital Supply Chain Manager should ensure overall consistency and performance

18. Individual Media Asset Management systems don’t match this requirement

19. Ad hoc plumbing (“best of breed”) compromises stability and quality of the productSupply Chain Engine More, better and structuredmetadatawillenable an evolutionfrombare application integration to information integration and supplychain optimisation. 11

21. It is not true that an “ESB should replace all application specific interfaces by an general purpose abstract interface”. It should implement some major interfaces without further custom development (NewsML-G2, TVAnytime, Mpeg7,…);

22. It is assumed that “the SOA and the ESB simplify your service portfolio” (e.g. a single video transcoder), but this may lead to massive overconsumption of IT infrastructure(!);

23. A Service Oriented Architecture is only part of the solution:

24. Stability and performance

25. Intellectual Property Management

26. Routing and resource scheduling

27. …Supply Chain Engine More, better and structuredmetadatawillenable an evolutionfrombare application integration to information integration and supplychain optimisation. 12

28. 13 Use Cases - Logging, Disclosure, Annotation,… archiefnummer : ALG 20010813 1 fragmentnummer : 1 reeks : 1000 ZONNEN EN GARNALEN bandnummer : E03024404 formaat : DBCM fragmenttitel : 1000 ZONNEN & GARNALEN beeld : KL/PALPLUS fragmentduur : 18 20 tekst : 0'00" TOERISTISCH REPORTAGEMAGAZINE OVERZICHT ONDERWERPEN GENERIEK TOERISTISCH REPORTAGEMAGAZINE, OVERZICHT ONDERWERPEN 0'50" VANDAAG : KUNSTENAAR LUC HOFKENS ONTWIERP EEN OASE OP ZIJN DAKTERRAS IN BORGERHOUT DIE DOET DENKEN AAN DE GRAND CANYON INTERVIEW MET LUC EN ZIJN VROUW MARILOU BUITENBEELD DAK MET OMGEVING BUITENKANT ARBEIDERSWONING, PANO OVER ROTSWANDEN, KRATEN MET WATER, BEPANTING, FOTOALBUM MET VERLOOP WERKEN 4'00" JUNIOR : KLAARTJE ALAERTS, 13 JAAR WIL ASTRONAUTEN WORDEN ZE BEZOEKT HETEUROSPACE CENTER METRUIMTEVEREN, RAKETTEN SIMULATIE IN RUIMTEVEER, INTERVIEW, HEEFT EEN UFO GEZIEN MAAKT ZELF KLEIN RAKETJE, SCHIET HET AF 7'50" DE SCHEURKALENDER : ARCHIEF RECLAMEFILM IBM INTERVIEW MAURICE DE WILDE, EERSTE PERSOONLIJKECOMPUTER trefwoorden : BELGIE; BORGERHOUT; ARTIEST; OASE; KUNST; GRAND CANYON (NATUURGEBIED); DAK; TERRAS; INTERVIEW; EURO SPACE CENTER; RUIMTEVAART; PC; BOOTTOCHT; RIJKDOM; PASSAGIER; GASTRONOMIE; RESTAURANT; PERSONEEL; VAKANTIE; BINNENBEELD; SCHIP; BECKERS LEEN; VRT; LOTTO; RADIOOMROEPSTER; KLANKSTUDIO; UITVINDING; BARBECUE; BETONMOLEN; IBM; RECLAMESPOT rechthebbende : VRT Opzoekscherm FILM Set: 16 Aantal: 1 blz 1 van 3 trefwoorden: ibm and vrt archiefnummer: - uitzendjaar: maand: dag: fragmentnummer: fragmentduur: reeks: formaat: bandnummer: aflevering: afleveringsnummer: programma: uitzenddatum: fragmenttitel: tekst: kategorie: opnamedatum: opnamenummer: journalist: rechthebbende: SETS The strings required for the operation are not defined F11 F12 F13 F14 F17 F18 F19 F20 Ent Eindigen Sets Refset Toon Vorige Volg/Leeg Thesaurus Commando Opzoeken

30. Integrated application of keywords and properties

31. Intuitive and structuredpresentation of results

32. Time-codedproperties and indexing

33. Integration of variousfeature extraction algorithmsLegacy Video Library NewsML-G2 Raw Material (Reuters and EBU) Media Asset Management System (Ardome) Search Engine (Lucene/SOLR) Production Systems (Studio, craft editing,…)

34. 15 Shot Segmentation and Scene Recognition

35. 16 Computer Assisted Analysis

36. 17 Proof of Concept - Computer AssistedAnnotation

37. 18 Proof of Concept - The SearchEngine

38. 19 Future - From« Metadata » to CAD/CAM ?

39. Challenge – Human-Computer Interface

40. 21 Proof of Concept – Model Driven Development Demo http://www.youtube.com/watch?v=lx39IHUZyA4

42. The notion of a configurable productenableshybrid formats and personalisation

43. Theserequire concurrent engineering and(!) collaborative production

44. Value added services for the consumer relie on more and bettermetadata as well

45. State-of-the-Art

46. The lack of metadataunderstandinginhibits collaborative production

47. MAM Systems as such are not scalable in terms of implementing new services

48. « Best-of-breed » approach has lead to plumber’s architecture

49. Conclusions

50. Collaborative production willbe a processimplemented by a distributedenvironment of equal and collaborative components;

51. NextgenerationMedia Asset Management willbebased on information integration as opposed to application integration and the result of consistent and sound system engineering;