This document discusses the transition from tape-based to file-based workflows in audiovisual production. It covers the history from linear tape-based workflows to emerging digital file-based workflows. Key benefits of file-based workflows include the ability to store rich metadata with media files throughout the production process, faster editing and sharing of content, and more flexible archiving and retrieval of content and associated metadata. Standards organizations are helping facilitate file-based workflows by establishing standards for file formats and metadata. Specific Sony products like XDCAM are highlighted as examples of technologies supporting file-based acquisition, editing and distribution.

1. Workflow Innovation
A continuing revolution in the production process
Starts: 11:00
Penny Paganuzzi

2. This Session
General tutorial
Not a product briefing
Demonstration to follow using an example workflow
Questions after the demo please

3. Past, Present and Future of
Using IT infrastructure and technology to handle
Audio/Video material

4. AV/IT History
Late 20th Video tape used throughout
Century Linear synchronous connections
No metadata
2005 There are still gaps in the emerging AV/IT infrastructure
Non-linear editing islands are common
Tape to disk transfers incur time penalties
2008 Media acquisition possible in file format
Many cameras support file-based transfers & proxies
Full digital workflow with metadata now possible

5. Basic concepts : Streams
Video tapes record streams
Streams are uncontained and undefined
Streams contain no metadata
• except timecode
Streams are transferred using point-to-point connections
• Composite, component, SDI, AES/EBU, etc.
Streams are transferred at play speed

6. Basic concepts : Files
Files can contain metadata & A/V data
• Names, dates, video format, identifiers, etc.
Files can be transferred using IT connections at high speed
• Ethernet, SCSI, Fibre Channel, etc
Files can be stored on standard IT Hardware
Breaks the link between format and media
• Agreed file format used in any file-based media

7. Basic concepts : Metadata
Data about data
• Information about content
Why is it important?
• Allows easy searching, fast editing and postproduction
• Allows re-purposing
• Supports tighter rights management

8. Basic concepts : Metadata
When and where is it captured?
Does it flow through the entire production process?

9. Basic concepts : Manual & automatic metadata
Acquisition metadata (auto)
• Timecode, GPS position
• UMID (Unique Material Identifier) each clip has unique ID
Acquisition metadata (manual)
• Essence mark : timecode, strings (32 characters)
• Shotmark 1 & 2 (manual)
• Scene change 1 (auto : luminescence)
• Scene change 2 (auto : audio level)
Additional Text (manual):
• Names, notes, comments, etc.

10. Basic concepts : UMID
Unique Material Identifier
Number attached to a clip
Uniquely identifies the clip from any other
Extracted from many parameters
• Date, time, machine serial number
• GPS data, country code, company code, user code
Specified in SMPTE 330M standard

11. Basic concepts : Proxies
Low-res copies of video and audio material
Highly compressed files
Fast transfer over a computer network
Fast searching, browsing, and editing
Playable on standard computers with standard software
• Windows Media Player, Real player, Quicktime
May be used for emergency playout
• Standard decoder back to baseband signal

12. • Scenes can be played back via thumbnail
• Clip-lists enable simple in-camera edits

13. Sophisticated Thumbnail Operation
• Quick Random Access
• Arbitrary File Name
• Expand and Chapter Search
• Selected Clip Delete
• Overwrite Protection
Clip Operation
Scene Selection
(Cut-only Edit)

14. Introduction of non-linear editors
Digitising required to ingest into NLE
Editing is file based
Editing includes metadata
Final edit recorded back to video tape

15. From in the field

16. To High end Post-Production

17. And every level in between…
Vegas Pro 8
Final Cut Pro
And many others

18. Introduction of video servers
Edits can remain as files
• Servers can hold metadata
• Servers can hold edit decisions and versioning
Introduction of digital archives
• Material & edits can be archived as files
• Metadata can be retained in archive
• More metadata can be added for better archive search/retrieval

19. Hybrid workflow: Introduction of non-linear editors
Acquisition Production Delivery
Streams Files Streams
Camcorder Video Video Transmission
Non-
Tape Tape
Linear
Recorders Recorders
Editor
Camera Archive
Video tape Digitising Linear Video tape
or linear recording or linear
connection to tape connection

20. Introduction of video servers
Acquisition Production Delivery
Streams Files Streams
Camcorder Video Non- Transmission
Video
Tape Linear servers
Recorders Editor
Camera Archive
Digitising Network
Video tape
File Transfer via Network
transfer
or linear
Transfer to data tape
connection

21. IT Connectivity
NAS – Network Attached Storage
SAN – Storage Area Network

22. PLAYOUT
NEWSROOM Transmission Server
ACQUISITION
PROXY
INGEST MOS
EDITING. CH A
Gateway CH B
CH C POOL
I/P
Encoding
Devices
Line Feeds
Material Management
DB
Material Server
Archive,
Compile
Distribution
KEY
MXF G/W
PROXY
Xpri NS
METADATA
Craft
HI-RES
FILE TRANSFER ARCHIVE
SDI VIDEO
CONTROL
HIGH RES EDITING

23. Target workflow
Files used throughout
• File based camcorders & recorders
• File-based editing, storage & distribution
• File-based archive and retrieval
Automatic metadata added right from the start
• All clips uniquely marked
Consistent files and metadata throughout workflow
• Agreed metadata standards
Any new metadata adds to existing metadata
• Nested metadata
• Customised metadata

24. Target workflow
Acquisition Production Delivery
Files
Transmission
File
File based Non- Video
based
camcorder Linear servers Digital
recorder
or camera Editor
archive
Network Network Network Network
transfer transfer transfer Transfer/
Data tape

25. Using metadata in target workflow
Acquisition Production Delivery
Files
Transmission
File
File based Non- Video
based
camcorder Linear servers Digital
recorder
or camera Editor
archive
…and here …and here
Metadata added …and here
…and here
here…

26. Problems if metadata is not used properly
Metadata is Inconsistent
• Poor search performance
Metadata not properly understood
• Data models not compatible
Islands of non-standard metadata
• Re-keying required and lost information
Metadata transfer not always easy
• Re-keying required and lost information

27. Standardisation is important
XML
UMID
Dublin Core

28. Flexible File Formats
Material eXchange Format
• Wrapper format, allows video encapsulation
• Includes metadata
• Used by a wide range of products from many vendors
SMPTE 377M - 393M + EG 41 -EG42
See WWW.SMPTE.ORG

29. Partners in Standards
BBC r&d

30. Supporting Products
Workflow transformation requires:
• Acquisition - Camcorders/Ingest Machines
• Editing - NLE software for both SD and HD
• Distribution - Networked production systems
• Archive - Hard Disk, Optical Disc, data tape-based libraries
• Media Asset Management Systems – Metadata/search for reuse

31. Sony Product Support for File-based workflows
XDCAM HD : Optical file based (XDCAM disks)
• Programme acquisition, high speed editing
• XDCAM HD 422
• High Quality programme acquisition, high speed editing
XDCAM-EX: Flash RAM based
• Low cost, high speed, high quality

32. Sony XDCAM family
Files recorded to disc or Flash card (SxS)
Automatic metadata recorded right from the start
Immediately in the IT domain
XDCAM Discs can be ‘pre-loaded’ with planning data

33. Sonaps Example Metadata flow
Planning Acquisition Field Edit Ingest Newsroom Craft Edit Playout
Hi res, Proxy Program
Custom Edit suite/ Editor
Clip titles & Editor name &
comments &
descriptions ID
Record start mark Channel
Clip & Sub clip
descriptions
detail
Key frames Clip detail
Good shot mark Playlist
Added Key
Essence marks
Duration
Duration
frames &
Disc ID/title Duration
Date, Time
Storyboard, Sub Essence marks
Location, UMID Program
Program
Description clips, EDL SOM, EOM
Content & Last edit date
Last edit date
Creator Date, Time
Program
EDL: executor
definition
Rights
Place
Date/Time
Photographer
Reporter
Sonaps material server

34. An example using HDXchange
“A complete end to end solution for Collaborative Networked
Production”

35. HDXchange Applications
Browsing/Storyboard/
Archiving &
Media Management
XDCAM GW
Export
Ingest/Logging
NAS Server Web
Administration
Editing
Sony Vegas
Apple FCP

36. HDXchange XDCAM Workflow
Review material and Search Metadata
Select disk Sony Vegas or Apple FCP
select import Drag selection to Review proxy material
Bin
Modify Metadata
Drag to Editor
Create Storyboard
HDXchange Browse
Export to Web
Import via Export to Editor
Export back to XDCAM Browse Proxy/Metadata
Import/Export XDCAM/XDCAM-HD
XDCAM Gateway
High Resolution & Metadata
EditEdit High from server
direct Resolution
Export back to HDXchange
Or export to XDCAM
Export to Transmission
Archive
Archive High
XDCAM Gateway
Resolution
Material
Add/Modify Metadata
Select Clip
High resolution
Proxy
Metadata

37. Transmission Improvements
A/V files can be played out directly from server
Transmission files and rushes can be stored on data tape
• Sony SAIT/LTO4 and PetaSite
XDCAM CART option for direct disk playout

38. Archiving
Data shelf-life and reliability improved (backups, RAID etc.)
Proxy files can be incorporated into browse library (e.g. Blue Order
Media Archive)
High resolution e.g. MXF files can be stored in a hierarchical
environment
Additional Search metadata can be added for easy retrieval

39. Sonaps to Archive Example Metadata flow
Planning Acquisition Field Edit Ingest Newsroom Craft Edit Playout
Hi res, Proxy Clip titles, Clip descriptions Custom comments Program
XpriNS Edit suite
Record start mark Key frames, Essence marks Custom descriptions Channel
Editor Editor
Good shot mark Essence mark notes Added Key frames Playlist
Clip detail Clip detail
Date, Time, Location Storyboard, Sub clips, EDL Added Essence marks Duration
Duration Sub clip detail
UMID Detailed Essence mark SOM, EOM
Program Duration
Disc ID
Content descriptions Date, Time
Last edit date Program
Disc title
Program definition EDL: executor Last edit date
Description
Creator
Rights
Place
Date
Time
Photographer
Reporter
Sonaps material server
Country
People
Location
Event
Archive
Genre

40. Recent Challenges with Workflow Improvements
Choice of digital Media
• Optical disc or memory card
• Capacity, cost, robustness
Ease of use of editing software
• Scary to new users?
• Facilities bloat

41. Summary
Capture to AV/IT Workflow can now be bridged
• avoids playspeed ingest and re-keying
File-based media allows storage of multiple A/V formats
Metadata maintained throughout production flow allowing
improved:
• tracking
• rights & asset management
Programme production is quicker

42. And Finally…
Let’s see a file-based workflow in action, over to Paul…
Presentation will be available from www.sonybiz.net/training

43. And Finally…
To see real file-based workflows:
Visit the main stand and watch Sonaps or HDXchange in action
Presentation will be available from www.sonybiz.net/training

44. Thank you for Listening
Come back for: Today at 17.00
High Definition: The technology behind the Picture