The amount of media in the Web poses many scalability issues and among them copyright management. This problem becomes even bigger when not just the copyright of pieces of content has to be considered, but also media fragments. Fragments and the management of their rights, beyond simple access control, are the centrepiece for media reuse. This can become an enormous market where copyright has to be managed through the whole value chain. To attain the required level of scalability, it is necessary to provide highly expressive rights representations that can be connected to media fragments. Ontologies provide enough expressive power and facilitate the implementation of copyright management solutions that can scale in such a scenario. The proposed Copyright Ontology is based on Semantic Web technologies, which facilitate implementations at the Web scale, can reuse existing recommendations for media fragments identifiers and interoperate with existing standards. To illustrate these benefits, the papers presents a use case where the ontology is used to enable copyright reasoning on top of DDEX data, the industry standard for information exchange along media value chains.

1. Semantic Copyright Management
of Media Fragments
Roberto García, David Castellà, Rosa Gil
Universitat de Lleida, Spain
DATA 2013
2nd International
Conference on Data
Management
Technologies and
Applications
29-31 July 2013
Reykjavik, Iceland

2. 30.07.2013 Slide 2 of 28
MediaMixer
Community set-up and networking for the
reMIXing of online MEDIA fragments
• FP7 Coordination Action
– Started November 2012
– Create an European market for media
fragments re-purposing and re-selling
A history of G8 violence (© Reuters) http://slideshare.net/troncy/a-semantic-multimedia-web-create-annotate-present-and-share-your-media

3. 30.07.2013 Slide 3 of 28
Introduction
• The MediaMixer project and community
promote the use of semantic technologies
for media mixing
• Real use cases and demos that showcase
these technologies
– Fragmenting media assets
– Annotating them using semantic descriptions
– Exposing these descriptions for fragment level search and
selection
– Representing rights information using a
copyright ontology that integrates licenses,
policies and rights expressions languages

4. 30.07.2013 Slide 4 of 28
Producer checks reused media
licenses vs. internal policies
and agreements (with
providers and rights holders)
Policy example: “…avoid media
fragments showing violence when
producing content for children”.
Problems:
1.) Semantic annotation
a) For instance, automatically tag
violent content
2.) Rights Integration
a) Policies and agreements
(unstructured documents)
b) Media fragments licenses
(rights expression languages)
3.) Intelligently detect conflicts
Example Use Case

5. 30.07.2013 Slide 5 of 28
Current Situation
Issues:
• scalability
(mostly a manual process)
• conflicts detected too late
(added costs)
• missed opportunities
(media already available)
• …

6. 30.07.2013 Slide 6 of 28
Proposals:
Assisted Policy and Agreement
Modelling
• Model policies and
agreements
• Formal model that
allows automatic
integration and
intelligence support
• Semantic model based on
Copyright Ontology
• Editor with assistance
guided by the ontology

7. 30.07.2013 Slide 7 of 28
Policy and Agreement
Modelling Assistant

8. 30.07.2013 Slide 8 of 28
Media Fragments Ingestion
Provider offers media
fragment:
• Content:
automatic annotation
• Detect topics: Violence?
Outdoors? Cars?...
• Rights:
automatic translation
of rights language to
Copyright Ontology
• DDEX, ODRL, MPEG-21,
Creative Commons…

9. 30.07.2013 Slide 9 of 28
Semantic Annotation
9
• Transform whole videos to sets of meaningful,
indexable and re-usable video fragments
Person, Snow, Trees,
Building, Ski, …
Baseball, Throwing, Sports,
Plant, Running, …
Kitchen, Indoor, Cake, …
…

10. 30.07.2013 Slide 10 of 28
Semantic Annotation
Metadata
• Metadata for semantic annotation:
– Descriptive metadata for media
characteristics
– Provenance metadata to credit source and
specify rights
– Conceptual metadata to reflect what media is
perceived to represent

11. 30.07.2013 Slide 11 of 28
Conceptual Metadata
• Globally unambiguous
identifiers for any
concept needed
– Ideally more information
about the concept itself
is available via the
identifier
– Use of Web URIs →
Linked Data concept
space
– Would allow for
inference of concept
type and relationship to
other concepts

12. 30.07.2013 Slide 12 of 28
Producer Proposed Workflow

13. 30.07.2013 Slide 13 of 28
Semantic Data Exploration

14. 30.07.2013 Slide 14 of 28
Implementation
• Rights, License and Policies
implemented as Classes
– Reproduction Right, Copy,
Copy Pattern for fragment #1,...
• Uses implemented as Instances
– u: Peter copies media fragment #1
in the US on 2013-06-03 using…
• if u ∈ Copy Pattern then
pattern authorises u
Reproduction
Right
Copy
Copyright
Copy
Pattern
u
?

15. 30.07.2013 Slide 15 of 28
Pattern Building
Actions (“verbs”)
Creator
Actor
Producer
Broadcaster
User
Motion Picture
Script
Adaptation
Performance
manifest
perform
record
Communication
broadcast
transform
Literary Work
tune
Copyright
EconomicRights
RelatedRights
MoralRights
DistributionRight
ReproductionRight
PublicPerformanceRight
FixationRight
CommunicationRight
AttributionRight
TransformationRight
IntegrityRight
DisclosureRight
WithdrawalRight
PermorfersRights
ProducersRights
BroadcastersRights
RentalRight
ImportationRight
SoundRecordRight
MotionPictureRight
BroadcastingRight
MakingAvailableRight
AdaptationRight
TranslationRight

16. 30.07.2013 Slide 16 of 28
Pattern Building
Case Roles (from linguistics)
• Connect verbs to the action participants
– Example: “The dog ate food”
initiator resource goal essence
Action agent, instrument result, patient,
effector recipient theme
Process agent, matter result, patient,
origin recipient theme
Transfer agent, instrument, experiencer, theme
origin medium recipient
Spatial origin path destination location
Temporal start duration completion pointInTime
Ambient reason manner aim, condition
consequence
Subject, role “agent” Object, role “theme”

17. 30.07.2013 Slide 17 of 28
DDEX Sample-08.04.xml
<Deal>
<DealTerms>
<ValidityPeriod>
<StartDate>2013-01-
01</StartDate>
</ValidityPeriod>
<Usage>
<UseType>
OnDemandStream
</UseType>
<DistributionChannelType>
Internet
</DistributionChannelType>
</Usage>
<TerritoryCode>ES</TerritoryCode>
<TerritoryCode>US</TerritoryCode>
</DealTerms>
</Deal>
Copyright Ontology Model
<http://media.com/agreement#1> owl:Class;
co:start "2013-01-01" ;
owl:intersectionOf (
ddex:OnDemandStream
[ a owl:Restriction ;
owl:onProperty co:medium ;
owl:someValuesFrom ddex:Internet ]
[ a owl:Restriction ;
owl:onProperty co:location ;
owl:someValuesFrom
[ a owl:Class ;
owl:oneOf (territory:ES territory:US) ]
[ a owl:Restriction ;
owl:onProperty co:theme ;
owl:hasValue
<http://my.tv/video.ogv#t=60,100>
]
]
) .
DDEX to RDF

18. 30.07.2013 Slide 18 of 28
Logical interpretation of a license model
Reasoning with DDEX

19. 30.07.2013 Slide 19 of 28
Reasoning with DDEX
Policy #1
Agreement #1

20. 30.07.2013 Slide 20 of 28
reasoner = new Sesame(new OWLIM-SE_5.3())
reasoner.loadOntologies()
> Loaded: iso3166a2.owl (territories), ddex.owl, copyrightonto.owl
reasoner.loadPolicy("NoStreamingInUS.owl")
reasoner.loadLicense("DDEX_Sample-08.04.owl")
use1 = new Use(use1URI, "user01", "OnDemandStream", "Internet",
"http://my.tv/video.ogv#t=60,100", "ES", "2013-04-19")
reasoner.load(use1)
response = reasoner.isUsePermitted(use1URI)
print response
> Authorised: http://mediamixer.eu/copyright/examples/agreement#1
use2 = new Use(use2URI, "user01", "OnDemandStream", "Internet",
"http://my.tv/video.ogv#t=60,100", "US", "2013-04-19")
reasoner.load(use2)
response = reasoner.isUsePermitted(use2URI)
print response
> Prohibited: http://mediamixer.eu/copyright/examples/policy#1
License Checking Implementation

21. 30.07.2013 Slide 21 of 28
@prefix co: <http://rhizomik.net/ontologies/2013/05/copyrightonto.owl#> .
@prefix odrlv: <http://w3.org/ns/odrl/vocab#> .
@prefix owl: <http://www.w3.org/2002/07/owl#> .
<http://example.com/policy> a co:Agree ;
co:agent <http://example.com/billie>, <http://example.com/sony> ;
co:theme [ a owl:Class ;
co:end "2012-12-31" ;
co:start "0001-01-01" ;
owl:intersectionOf (
[ owl:intersectionOf (
odrlv:play [ owl:complementOf odrlv:mobile_ringtone ] ) ]
[ a owl:Restriction ;
owl:hasValue <http://example.com/billie> ;
owl:onProperty co:agent ]
[ a owl:Restriction ;
owl:hasValue <http://example.com/music> ;
owl:onProperty co:theme ] ) ] .
<http://example.com/sony:10> a co:Person .
<http://example.com/music> a co:Creation .
<http://example.com/billie> a co:Person .
ODRL Example from LCC
Rights Reference Model Spec
Copyright Ontology license to text:
“sony and billie Agree that
billie play and not mobile ringtone
music”.

22. 30.07.2013 Slide 22 of 28
Creative Commons
BY-SA Model

23. 30.07.2013 Slide 23 of 28
• Following Linked Data principles,
starting from just content ID (URI)…
Long term vision…
23
Content
URI
URI a ebucore:Image
dct:title “EBU HQ”
dct:copyright URI
…
HTTP GET
image/jpeg

24. 30.07.2013 Slide 24 of 28
Linked Data for Worldwide
Copyright Management?
24
Content
URI
URI a ebucore:Image
dct:title “EBU HQ”
dct:copyright URI
…
Agreement
URI
URI a co:Agreement
co:agent URI
co:theme …
…
Person
URI
URI a foaf:Person
foaf:name “…”
vcard:address …
vcard:country URI

25. 30.07.2013 Slide 25 of 28
Get involved
• Join MediaMixer community to know more
(http://community.mediamixer.eu):
– discussions, use cases, demonstrators, tutorials,
presentations, software,…

26. More details:
http://community.mediamixer.eu
http://rhizomik.net/copyrightonto/
Roberto García
Universitat de Lleida, Spain
http://rhizomik.net/~roberto
Thank you for your attention
DATA 2013
2nd International
Conference on Data
Management
Technologies and
Applications
29-31 July 2013
Reykjavik, Iceland