This document summarizes the key components of a digital media production infrastructure, including the network, hard disks, and file systems. The network must support high throughput without packet loss or delays to support real-time media workflows. Point-to-point switched Ethernet and layer 3 routing address limitations of shared Ethernet. Hard disks are most efficient with large sequential access rather than small random access. Disk striping and intelligent file systems can reduce random access. File systems must support non-blocking access across many clients and disks without oversubscription to ensure resources are available for media production needs.

1. Digital Media Production

2. Research and Development +/- 22 experts Member of international associations EBU (P/SCAIE, P/MAG, P/NP, P/HDTV,…) AMWA, SMPTE, IPTC, W3C Deliverables Expertise Proof of Concept Technology transfer VRT-medialab http://medialab.vrt.be

4. File Based Media Production

5. Media Asset Management

7. Future Media - Assumptions 5 Non-linear Distribution IP(<> FM, DAB, DVB) enables seamless integration of live and on-demand Software-based Receivers API’s and application frameworks enable independant software development 3rd party integration increasses application intelligence Versatile Content From mobile, standard-def and high-definition to scalable content http://labs.vrt.be/myradio

9. 2001: Excuse me, I’m from IT … (checkpoint)

10. 2002: IP will be the ‘future’ network technology for TV production

11. 2003: TV production will be ICT-architecture based !!!

12. 2003: BBC states ‘TV production to be “tapeless” in 2010 (->2008) !!!’

14. 2004...

15. 9 Digital Media Production Suprastructure – Metadata management Production and distribution Production and distribution Editing Mastering Media AssetMgnt System Ingest Playout Infrastructure - Networks and Storage Production Platform

16. 10 Challenge 1 - Infrastructure Suprastructure – Metadata management Production and distribution Editing Mastering Media Asset Mgnt Ingest Playout Infrastructure - Networks and Storage Production Platform

17. 11 Challenge 2 – Digital Asset Management Meta Data Meta Data Communication (Information) Suprastructure – Metadata management Production and distribution Infrastructure - Networks and Storage Production Platform

18. 12 Challenge 2 - Digital AssetManagement Suprastructure – MetadataMgnt Production and distribution Infrastructure - Networks and Storage Production Platform

19. 13 Challenge 2 – Digital Asset Management ?

21. File-based Media Production

22. Media Asset Management

23. Future Internet

24. Design requirements – Facts and Figures

25. The network

26. The Hard Disc

29. By using generic technology, the central media infrastructure and the local media specific work-centres should be integrated agnostically from each others technical implementations.

31. Uncompressed video (SDI): 270 Mbps

32. Compressed video (Contribution Q.) (HQ): 50 Mbps

33. Compressed video (Contribution Q.) (news): 8 Mbps

34. Compressed video (Distribution Q.): 5-6 Mbps

37. 19 ~ 200 // H-Res video clients simultaneous access at 500 Mbit/s / client (H-Res video: 50 Mbit/s) (= 10 x 50 Mbit/s / client) ~ 3000 // L-Res video clients Simultaneous access + // Throughput ~ 10 GB/s Ingest: >= 10 feeds simultaneous 10 x faster than real time transcoding -> browse key-frame Playout # hrs H-Res video: ~150.000 hrs On disk Total storage: 4 PetaB (net) on-line = on disk Hiërarchical storage mgmt. (on-line/near-line/off-line) near-line = on data-tape off-line = on data-tape (shelf) Design Requirements Media Asset Management File-based / (video)tape-less media environment High Availability

38. 20 Target architectural model: ~ 200 // H-Res video clients simultaneous access at 500 Mbit/s / client (H-Res video: 50 Mbit/s) (= 10 x 50 Mbit/s / client) Media Application Behaviour ~ 3000 // L-Res video clients Simultaneous access + // Throughput ~ 10 GB/s Ingest: >= 10 feeds simultaneous 10 x faster than real time transcoding -> browse key-frame Playout # hrs H-Res video: ~150.000 hrs On disk Total storage: 4 PetaB (net) on-line = on disk 0% 100% Load Hiërarchical storage mgmt. (on-line/near-line/off-line) near-line = on data-tape off-line = on data-tape (shelf) Media Asset Management File-based / (video)tape-less media environment High Availability Design Requirements

39. High Definition Media Production Infrastructure Media File System ( GPFS, AVID-ISIS, Isilon, Omneon Media Grid, XSAN, … ) Network ( Disk network, SAN ) Hard Disk Storage Architecture: 3 Key Components: 100 % Efficiency Geisha results IBC 2009

41. File-based Media Production

42. Media Asset Management

43. Future Internet

44. Design requirements – Facts and Figures

45. The network

46. The Hard Disc

48. Slow

49. Packet loss

50. No Quality of Service

51. Interruptions are generally accepted

53. Always available !

54. No loss of data !

55. Perfect quality guaranteed!IP is “Best Effort” Internet  a most poor implementation of IP

56. 24 Ethernet - Carrier Sense/Collision Detect

58. Half Duplex (exclusively directional)

59. CSMA/CD (collision mechanism)Ethernet - Carrier Sense/Collision Detect

62. 27 100 % load > 60 % load 95 % load 60 % load 50 % load 30 % load 5 % load 5 % load Conventional IT network Ideal network Network Behavior

63. 28 or is this behavior typicalto the way it is implemented? > 60 % load Is this behavior inherent to IP 60 % load 30 % load 5 % load Conventional IT network Network Behavior

68. Unvisible

69. No pakket loss

71. Visible

72. Pakket loss

73. Max 30% efficiencyError resilience – Spanning Tree

75. Invisible

76. No packet loss

78. Visible

79. Pakket loss

80. Max 30% efficiencyError resilience - OSPF

82. Invisible

83. No packet loss

84. 100 % efficiency

86. Invisible

87. No packet loss

88. 100 % efficiency

90. Visible

91. Pakket loss

92. Max 30% efficiencyMedia network – L2 switching and L3 routing

93. 34 Classical IT (IP) Network -> Media IP Network 100 % load > 60 % load ≈ 60 % load 50 % load 30 % load 5 % load 5 % load Media IP network Classical IT (IP) network #p t #p t collision #p t #p t

95. No Oversubscription

97. Non-Blocking

98. No Oversubscription

99. No Oversubscription

100. L2

102. File-based Media Production

103. Media Asset Management

104. Future Internet

105. Design requirements – Facts and Figures

106. The network

107. The Hard Disc

109. 39 Hard Disk model Disk Throughput 15 Krpm calculated results 10 Krpm calculated results 128 KB segments 8 KB segments Testresults 78.2 MB/s 72.9 MB/s 71.5 MB/s 70 MB/s 66.7 MB/s 50 MB/s 50.9 MB/s 47.6 MB/s 39.4 MB/s 35.4 MB/s 30 MB/s 16.8 MB/s 14.8 MB/s 12.8 MB/s 12.2 MB/s 10 MB/s 9.1 MB/s 8.9 MB/s 0.91 MB/s 0.65 MB/s 0.92 MB/s 0.62 MB/s 15Krpm – 10 K rpm 15Krpm – 10 K rpm 15Krpm – 10 K rpm 15Krpm – 10 K rpm Read load types (1) Sequential Read Outer tracks (2) Sequential Read Inner tracks (3) Random Read Tot. Fragmented disk 128 KB / 8KB segments (4) Worst case Read Tot. Fragmented disk 128 KB / 8KB segments

111. 41 Hard Disk model Disk Throughput 15 Krpm calculated results 10 Krpm calculated results 128 KB segments 8 KB segments Testresults 78.2 MB/s 72.9 MB/s 71.5 MB/s 70 MB/s 66.7 MB/s 50 MB/s 50.9 MB/s 47.6 MB/s 39.4 MB/s 35.4 MB/s 30 MB/s 16.8 MB/s 14.8 MB/s 12.8 MB/s 12.2 MB/s 10 MB/s 9.1 MB/s 8.9 MB/s 0.91 MB/s 0.65 MB/s 0.92 MB/s 0.62 MB/s 15Krpm – 10 K rpm 15Krpm – 10 K rpm 15Krpm – 10 K rpm 15Krpm – 10 K rpm Read load types (1) Sequential Read Outer tracks (2) Sequential Read Inner tracks (3) Random Read Tot. Fragmented disk 128 KB / 8KB segments (4) Worst case Read Tot. Fragmented disk 128 KB / 8KB segments

114. File-based Media Production

115. Media Asset Management

116. Future Internet

117. Design requirements – Facts and Figures

118. The network

119. The Hard Disc

121. 45 Essence Media essence Media Applications Media Clients Media Essence Files OSI 7 layer model File File System Protocol (FTP,NFS,SMB) Data network File I/O Requests Application Layer Application Layer File System File Presentation Layer Presentation Layer Session Layer Session Layer LUN I/O blocks Storage Network Transport Layer Transport Layer SCSI Protocol Block I/O Requests Network Layer Network Layer Data Link Layer Data Link Layer Storage Controller LUN Physical Layer Physical Layer Physisal Disk Logical segments Virtual connection Disk Network SCSI Protocol Segment I/O Requests Hard Disk Physical Disk Physical sectors Bytes Layered Model for Storage Infrastructure

122. 46 FC-client Based File servers Clients FC Network Avid-Unity / Quantel / SGI-CXFS / Thomson GV / … Video Proprietaire oplossingen Schaalbaarheid??? Media Infrastructure File System

123. 47 FC-client Based IP-client based Clients Clients Clients File servers Clients Media IP Network IBM-GPFS / SGI-CXFS / HP-Lustre / ADIC-Stornext / Nexsan / … FC Network File servers cluster Parallel access file system Avid-Unity / Quantel / SGI-CXFS / Thomson GV / … Video SAN Proprietaire oplossingen Schaalbaarheid??? MXF-AAF video/audio file Media Infrastructure File System

125. ReliabilityMXF-AAF video/audio file Media Infrastructure File System

126. 49 3 x Pinnacle chrome connected to GPFS 1 x AVID connected to local storage NLE NLE NLE NLE ARDCAP Playout server XP 2004 - Proof Of Concept - (VRT/IBM) VTR Admin Clients (XP) PC clients (XP) Dart/Easycut/Ardlog/… SDI -> VTR -> VTR File -> Application server + Web server +DB2 ARDCAP Ingest system XP 1 Gbit/s per client SuSE SuSE -> SDI SUPERNET II Media Gb Back End 2x OS8800 10 Gbit/s 4x 1 Gbit/s per server IP ARDENC Transcoding system 4 x GPFS i-node x365 (Intel/Linux) EDL Conform SuSE SuSE 4 CPU 2 CPU 2 CPU 2 CPU Tivoli TSM+Client x365 (Intel/Linux) FC network 2x MDS9216 2x 200 MB/s per server FC FC 4x 200 MB/s per storage array media-file LTO-2 taperobot 72 slots (14 TB) FAStT 900 84 x 146 GB RAID 5 FAStT 900 84 x 146 GB RAID 5 GPFS Soft mirror 10 TB net (400 hrs)

127. 50 Media Applications Essence Media essence Files Protocol Efficiency Over IP network File System Capability I/O blocks FC Oversubscription Flow Control I/O block size vs. segment size + CPU limit Controllers Logical segments Segment size vs. Efficiency of FC-AL Physical sectors Disk Segment size vs. Disk efficiency Media Essence Media Clients File IP network (SUPERNET II) File I/O Requests File GPFS File System LUN FC Storage Network Block I/O Requests LUN DS4500 Physical Disk FC-AL Loops DiskNetwork Segment I/O Requests Physical Disk FC Hard Disk Bytes Original Proof of Concept – Standard IT Systems

128. 51 Media Applications Essence Media essence MPx3 PoC Media Clients Files Media IP Network IP network GPFS File System GPFS I/O blocks FC SAN DS4500 Standard IT Storage System Standard IT Storage System Logical segments FC-AL Hard Disk Model 10 MB/s FC- Hard Disk Physical sectors Original Proof of Concept – Standard IT Systems Media Essence Media Clients File File System Protocol (FTP,NFS,SMB) Data network Optimised File I/O Requests File File System Optimised LUN SCSI Protocol Storage Network Optimised Block I/O Requests LUN Storage Controller Physical Disk SCSI Protocol Disk Network Optimised Segment I/O Requests Physical Disk Hard Disk Bytes

129. 17 juni 2007 – Go Live

131. File-based Media Production

132. Media Asset Management

134. File-based Media Production

135. Media Asset Management

136. Future Internet

137. Problem Analysis

138. Metadata standards overview

140. 56 Problem 1 - Digital AssetManagement Suprastructure – Metadata Mgnt Production and distribution Infrastructure - Networks and Storage Production Platform

141. 57 The Solution - Media Asset Management System archiefnummer : ALG 20010813 1 fragmentnummer : 1 reeks : 1000 ZONNEN EN GARNALEN bandnummer : E03024404 formaat : DBCM fragmenttitel : 1000 ZONNEN & GARNALEN beeld : KL/PALPLUS fragmentduur : 18 20 tekst : 0'00" TOERISTISCH REPORTAGEMAGAZINE OVERZICHT ONDERWERPEN GENERIEK TOERISTISCH REPORTAGEMAGAZINE, OVERZICHT ONDERWERPEN 0'50" VANDAAG : KUNSTENAAR LUC HOFKENS ONTWIERP EEN OASE OP ZIJN DAKTERRAS IN BORGERHOUT DIE DOET DENKEN AAN DE GRAND CANYON INTERVIEW MET LUC EN ZIJN VROUW MARILOU BUITENBEELD DAK MET OMGEVING BUITENKANT ARBEIDERSWONING, PANO OVER ROTSWANDEN, KRATEN MET WATER, BEPANTING, FOTOALBUM MET VERLOOP WERKEN 4'00" JUNIOR : KLAARTJE ALAERTS, 13 JAAR WIL ASTRONAUTEN WORDEN ZE BEZOEKT HETEUROSPACE CENTER METRUIMTEVEREN, RAKETTEN SIMULATIE IN RUIMTEVEER, INTERVIEW, HEEFT EEN UFO GEZIEN MAAKT ZELF KLEIN RAKETJE, SCHIET HET AF 7'50" DE SCHEURKALENDER : ARCHIEF RECLAMEFILM IBM INTERVIEW MAURICE DE WILDE, EERSTE PERSOONLIJKECOMPUTER trefwoorden : BELGIE; BORGERHOUT; ARTIEST; OASE; KUNST; GRAND CANYON (NATUURGEBIED); DAK; TERRAS; INTERVIEW; EURO SPACE CENTER; RUIMTEVAART; PC; BOOTTOCHT; RIJKDOM; PASSAGIER; GASTRONOMIE; RESTAURANT; PERSONEEL; VAKANTIE; BINNENBEELD; SCHIP; BECKERS LEEN; VRT; LOTTO; RADIOOMROEPSTER; KLANKSTUDIO; UITVINDING; BARBECUE; BETONMOLEN; IBM; RECLAMESPOT rechthebbende : VRT Opzoekscherm FILM Set: 16 Aantal: 1 blz 1 van 3 trefwoorden: ibm and vrt archiefnummer: - uitzendjaar: maand: dag: fragmentnummer: fragmentduur: reeks: formaat: bandnummer: aflevering: afleveringsnummer: programma: uitzenddatum: fragmenttitel: tekst: kategorie: opnamedatum: opnamenummer: journalist: rechthebbende: SETS The strings required for the operation are not defined F11 F12 F13 F14 F17 F18 F19 F20 Ent Eindigen Sets Refset Toon Vorige Volg/Leeg Thesaurus Commando Opzoeken

142. Solution 2 - The SearchEngine! 58

144. Re-use of material assumes a central Media Asset Mgntsystem

145. The system is aware of the production processes

146. APIs supporting metadata standards enable smooth integration

147. A workflow engine manages overall consistency

148. Commercial Media Asset Management systems don’t match these requirements

149. Ad hoc plumbing (“best of breed”) compromises stability and quality of the product

150. The worst-case scenario is ad hoc plumbing by using an Enterprise Service BusMedia Asset Mgnt

152. “The ESB should replace all application specific interfaces by an general purpose abstract interface”(IBM). At the contrary, it should implement some major interfaces without further custom development (NewsML-G2, TVAnytime, Mpeg7,…);

153. It is assumed that “the SOA and the ESB simplify your service portfolio” (e.g. a single video transcoder), but leads to massive overconsumption of IT infrastructure(!);Supply Chain Engine More, better and structuredmetadataenable the evolutionfrombare system integration to information integration and supplychain optimisation.

155. Redundant information – Overflow

156. Lack of awareness of potentially relevant itemsNews Production System

158. Parallel sources cause dupplicates;

161. One Set of Numbers - A Media Asset Management System enables(!) information integrity

162. Metadata Standards enable(!) interoperability

163. Information integration has priority on application integration(!!!). Semantic technology will enable(!) normalisation of semi-structured information.An architecture based on an extensible data-model and a consistent application framework (≠ Digitizing analogue and disintegrated information flows)

164. Lessons Learned – Principles of System Integration Everything should be made as simple as possible, but not one bit simpler.

166. File-based Media Production

167. Media Asset Management

168. Future Internet

169. The Problem

170. Metadata standards overview

172. APICS (www.apics.org) is een industrieassociatie die het logistiek vocabularium standaardiseert.

173. Implementatie - Logistieke informatie vormt de basis van een ERP systeemen wordt meestel gecommuniceerd als inhoud van een document.Sales and Operations Planning

175. Per industrie en per type product zijn er vaak verschillende methodes met bijhorende documentatiestandaarden:

176. Nieuws maakt gebruik van NewsML(www.iptc.org/newsml)

177. Movie Script Markup Language (MSML) is in ontwikkeling

179. Wanneer feature extraction algoritmes worden gebruikt om diverse visuele, aurale of conceptuele entiteiten te herkennen, maken we bij voorkeur gebruik van ISO/IEC Mpeg7 (http://en.wikipedia.org/wiki/mpeg7).

182. De EPG informatie wordt meestal gecentraliseerd in een distribution scheduling systeem, en dit publiceert op haar beurt het zendschema naar diverse platformen. We kunnen bijvoorbeeld P/META (www.ebu.ch) recupereren om deze interface te implementeren.

184. File-based Media Production

185. Media Asset Management

186. Future Internet

187. The Problem

188. Metadata standards overview

190. Facetted search

191. Integrated application of keywords

192. Intuitive and structured presentation of results

193. Timestamped metadata enables direct random access to audiovisual materialSearch Client (Custom Development) Legacy Video Library (Basisplus) Raw Material (EBU Superpop) Media Asset Management System (Ardome) Search Engine (Lucene/SOLR) Actual news items (Ardome)

194. 74 Proof of Concept - The Search Engine

195. 75 Shot Segmentation and Scene Recognition

196. 76 Computer Assisted Analysis

198. File-based Media Production

199. Media Asset Management

203. Product Catalogue - Electronic Programme Guide

205. Seamless integration of live and on demand

206. Metadata and APIs – 3rd party content enhancement

207. …Non-linear Distribution

208. In Italy for 30 years under the Borgias they had warfare, terror, murder and bloodshed but they enabled Michelangelo, Leonardo da Vinci and eventually the Renaissance. In Switzerland they ‘ve had brotherly love and piece for 500 years and they’ve been able to produce…

210. Porting the radioplayer...

211. Porting the radioplayer...

213. Currently over 80.000 installations

214. 3500 users per day

216. 86 From « metadata » to CAD/CAM ?

217. 87 Drama Production

218. 88 Proof of Concept – Model Driven Development Demo

219. 89 http://medialab.vrt.be http://www.limecraft.com http://twitter.com/limecraft Maarten.verwaest@limecraft.com

220. 90 Gartner