1. Metadata to create and collect
“Metadata bij de omroep”
December, 3rd 2008
Dieter Van Rijsselbergen
Universiteit Gent – IBBT
Multimedia Lab

2. Metadata?
 Metadata can be much more than just
‘data about media objects’
 Instead of organizing metadata around material…
 Organize material around a (meta)data model
Metadata
Metadata
Metadata
Metadata
Metadata
Metadata
Metadata
Metadata
Metadata 2

3. Metadata in Drama Production
 Drama productions
 Soap opera’s, quality prime time, motion pictures, …
3

4. Metadata in Drama Production
 Lots of metadata
 from start of
production
 unstructured
metadata
on paper
 synopsis
 scenario
4

5. Metadata in Drama Production
Episode 1004
 Use the screenplay!
Scene: INT – TER SMISSE - DAG
 turn into electronic and Character: Jenny
structured/processable formats
Character: Waldek
 episode/scene/characters
 describes the WALDEK:
semantics of the product “Hello Jenny!”
 use as base for further production
WALDEK WAVES
JENNY:
“How are you?!”
5

6. Even more metadata…
Metadata…
 A lot of implicit
‘shooting script’
metadata also
floats around!
Metadata…
Metadata…
6

7. Expressing the shooting script: storyboard
 How do we express the way in which scenes are ‘shot’?
 Legacy technology: storyboard
 unfortunately interpretation only by human ‘actors’
 what about machines?
7

8. Expressing the shooting script: animatics
 Emerging: animatics or previsualization
 for visually complex scenes
 Built using off-the-shelf 3-D authoring software
 limited computer perception of the scene
 but in terms of geometry, translations, …
 too much math! too little cinematography!
8

9. Expressing the shooting script: Scoop
 Step further: Scoop 3-D Previsualization
 Provide directors, producers, camera operators with tools
to express cinematographic vision
 add camera’s, microphones
 use proper terminology
 pan, tilt, dolly, …
 prepare dialogue
and animations
on a timeline
 describe specific
shooting instructions
9

10. Model-driven Product Development
 Construct a virtual model of the scene
 create a blueprint of manufacturing specifications
 populate with engineering information
 completed with metadata obtained in further
production process
 centralized repository of metadata
10

11. Creating and collecting Metadata
 What can we do with all this metadata?
 Acquisition
 controlling and cataloging takes
 annotating takes
 Editing
 rough cutting
 automating
 Computer Aided Repurposing
11

12. Acquisition
 Acquisition Episode 1004
 controlling and
Scene 4: INT – TER SMISSE - DAG
cataloging takes
 annotating takes
“Close-up Jenny”
Take #2
“Excellent Take!”
12

13. Editing
 Rough cutting: building evolving products
 mixture of previsualized and shot footage
 evolve from all-previsualized to all-shot composition
 Automate editing decisions
 Use previz. EDLs and re-apply to real footage
13

14. Computer Aided Repurposing (CAR)
 Automated Repurposing of Drama
 Different output channels
 HDTV
 SDTV
 iPod/Cellular
 We wish to create optimal products for each platform
 requires semantically sensible scaling/cropping
14

15. Repurposing: Output Channels
 HDTV
 Originally acquired
high definition material
 SDTV  Mobile (iPod)
 Legacy applications  Semantically
repurposed
 Common pan/scan
 Editing
(AVID)
15

16. Repurposing: How?
 1) Determine where the semantic elements are
 Semantic
Objects of Interest
were defined in the
scene model in previz.
Jenny Waldek
16

17. Repurposing: How?
 2) Provide reframing instructions, e.g.:
 Object Orientation and Range
 “The Bad must be shown on the right…”
0.75
 Object Size
 “… and I want it to be a full shot of The Bad.”
Frame Size
Object of Interest
Size: (30%, 90%)
17

18. Computer Aided Manufacturing: Workflow
18

19. Workflow (1): Synopsis
19

20. Workflow (2): Management
20

21. Workflow (3): 3-D Previz. – Scenario
21

22. Workflow (4): 3-D Previz. – Shooting Script
22

23. Workflow (5): 3-D Previz. Editing
23

24. Workflow (6): Acquisition & Logging
24

25. Workflow (7): Editing
25

26. Workflow (8): Quality Assurance & Analysis
Plane
26

27. Workflow (9): Repurposing
27

28. Workflow (10): Conform & Publish
28

29. Conclusions
 Metadata is much more than just
‘data about media objects’
 Extensive metadata modeling provides significant
advantages
 pursue model-driven product development
 better communication: between staff and machines
 in acquisition
associate audiovisual material easily
 in editing, repurposing
 ease and automate production tasks
 centralize production metadata
29

30. Questions?
30