1. Semantic Technologies for
Copyright Management
Roberto GarcĂa
Universitat de Lleida, Spain
1st Winter School on Multimedia Processing and Applications (WMPAâ14)
January 6th, 2014, Dublin, Ireland
3. Motivation
⢠Why copyright management
on the Web is more important than
ever?
⢠And why Digital Rights
Management isnât enough?
⢠Why semantic technologies
seem a good choice for Web-scale
copyright management?
Slide 3 of 58
4. Motivation - Use
Case
⢠Web media business models go beyond
digital version of âcopy/distributeâ vinyls,
cassettes, CDs, DVDs,âŚ
⢠Growing Streaming (Spotify, Pandora, Netflix,
HuluâŚ)
⢠Promising big scale remixing (make money if
others reuse your content): User Generated
Content (UGC)
Slide 4 of 58
8. Motivation - Use
Case
⢠What if more than one ownership
claim?
Š
match
match
Š
⢠If disputed, no one can monetize
Slide 8 of 58
9. Motivation - Use
Case
Are we sure we can claim?
Do we own that particular copy?
In that territory?
Also streaming on YouTube?
Does the artist authorise
YouTube?
⢠âŚ
DRM ď Copyright
Management
â˘
â˘
â˘
â˘
â˘
Slide 9 of 58
10. Motivation - Use
Case
âŚ1000s of pieces of registered contentâŚ
âŚ1000s of videos on YouTubeâŚ
â˘Decision Support System (DSS):
â Disputes with Media.com on A and B, can we
claim?
t
A
an im
C a
l
C
B
o
nn im
Ca la
C
â Trade A for B with Media.com (both win, start to
get revenue)
Slide 10 of 58
11. Motivation - Use
Case
⢠Rights DSS requirements:
â Fine grained
â Scalable (largely automatized)
â Takes into account:
⢠Contracts
ââŚall rights on the live version but studio version just in
the US.â
⢠Policies
ââŚartist does not want his music together with violent
imagesâ.
⢠Rights Expression Languages
DDEX metadata:
<UseType>OnDemandStream</UseType>
<TerritoryCode>Worldwide</TerritoryCode>
Slide 11 of 58
12. Media Fragment
Monetize âBullet in a
Bibleâ in YouTube.com?
Green Dayâs Contract:
Green Dayâs Contract:
âAvoid
âAvoid
making available
making available
our work
our work
together with
together with
war imagesâ
war imagesâ
âBullet In A Bibleâ
â Green Day
Digital Operations
says YES but we
should check Green
Dayâs contractâŚ
Digital Operations
(DDEX)
<isrc>USREV0500293</isrc>
<DealTerms>
<ValidityPeriod>
<StartDate>2005-11-15</StartDate>
</ValidityPeriod>
<Usage>
<UseType>OnDemandStream
</UseType>
<DistributionChannelType>
Internet</DistributionChannelType>
</Usage>
<TerritoryCode>US</TerritoryCode>...
Slide 12 of 58
13. Seeing Syria's War Through the Lens
topic
dbpedia:Category:Syrian_civil_war
by SOPHIA JONES - October 09, 2012
http://www.npr.org
Semantic
Semantic
Media
Media
Annotation
Annotation
broader
dbpedia:Category:War
dbpedia:Green_Day
part of
topic
schema:CreativeWork
author
part of
author
âBullet In A Bibleâ â Green Day
schema:CreativeWork
Green Dayâs Contract:
Green Dayâs Contract:
âAvoid
âAvoid
making available
making available
our work
our work
together with
together with
war contentâ
war contentâ
Rights Builder
Rights Builder
User Interface
User Interface
Isrc:USREV0500293
theme
theme
subClassOf
cro:MakeAvailable
ee
gr
sa
Di
sameAs
ddex:AdSupported
Streaming
RDF Store &
RDF Store &
Reasoner
Reasoner
A
g
e
re
medium
ddex:Internet
is a
Isrc:USREV0500293
theme
ddex:AdSupporte
dStreaming
medium
http://youtube.com
?
Rights Language
Rights Language
Mapping
Mapping
Digital Operations
(DDEX)
<isrc>USREV0500293</isrc>
<DealTerms>
<ValidityPeriod>
<StartDate>2005-11-15
</StartDate>
</ValidityPeriod>
<Usage>
<UseType>AdSupportedStreaming
</UseType>
<DistributionChannelType>
Internet
<DistributionChannelType>
</Usage>
<TerritoryCode>US
</TerritoryCode>...
Slide 13 of 58
15. Introduction
⢠Digital media: easy production and copy
⢠Digital Rights Management (DRM)
DRM
copy
play
âŚ
⢠Windows Media DRM, iTunes FairPlay,
RealNetworks Helix, Sony MagicGateâŚ
Slide 15 of 58
17. Introduction
⢠Need for a standard REL
(Rights Expression Language)
⢠Some efforts:
â XML-based RELs
⢠Formal syntax
XML Schema for standard grammar
⢠Informal semantics
Rights Data Dictionaries
â Creative Commons
simple predefined licenses âŚbut copyright management
Slide 17 of 58
18. Introduction
⢠XML-based RELs:
â Limited expressivity
â No interoperability mechanisms
â Informal semantics, re-implement for each tool
⢠Creative Commons:
â Predefined set of licenses
⢠Extension mechanism CC+ but unstructured
â Non-commercial purposes
âŚbut semantic metadata
Slide 18 of 58
19. Introduction
⢠DRM Watch:
â2005 Year in Review: DRM Standardsâ1
â ââŚconsumer complaints have moved beyond overly
restrictive DRMs to lack of interoperability among themâŚâ
â ââŚwe see no production implementations âŚâ
⢠Electronic Frontier Foundation2
â ââŚfail to accommodate⌠copyright regimes.â
⢠Some years afterâŚ
1
http://www.drmwatch.com
2
http://www.eff.org
Slide 19 of 58
20. Introduction
⢠DRM Officially Dead: Last Major
Label Sony BMG Plans to Finally
Drop DRM
Gizmodo.com, January 2008
http://gizmodo.com/340598/drm-officially-dead-last-major-label-sony-bmg-plans-to-finally-dropdrm
⢠DRM Was a Bad Move: Sales Found
to Increase 10% After Dropping the
Chains (Study)
Billboard.com, December 2013
http://www.billboard.com/biz/articles/news/digital-and-mobile/5812288/drm-was-a-bad-move-sales-found-toincrease-10-after
⢠And industry moving to copyright
management initiatives:
Slide 20 of
âPLUS Coalition, Linked Content Coalition, CopyrightHub,âŚ58
21. Introduction
⢠Post-DRM standardisation difficulties
â
â
â
â
Web open and heterogeneous
Business models beyond copy and distribute
Copyright a complex domain
High level of abstraction (not bits or pixels)
⢠Concentrate on the roots,
formalise SEMANTICS
Copyright
MPEG-21 âAdaptâ
Reproduction Right
ODRL âDuplicateâ
Copy
CC âReproductionâ
Slide 21 of 58
24. Approach
⢠Semantic Web approach to DRM:
â Knowledge Representation tools
â Web Wide applicability
â Build Copyright Ontology
⢠Potential benefits:
â
â
â
â
Formalise semantics
Facilitate interoperability and implementation
Include copyright
Support full value chain and
remix-based business models
Slide 24 of 58
26. Conceptualisation
â˘
â˘
Copyright domain analysis
Generic Ontology
â Based on WIPO1 worldwide harmonisation
â˘
â˘
Literary, artistic and scientific works (not ideas)
Maybe derived, but always original
Intellectual Property Rights
Author Rights or
WIPO Copyright
Economic Rights or
Exploitation Rights or
Copyright
1
Industrial Property
Moral Rights
World Intellectual Property Organisation Copyright Treaty, 1996
Slide 26 of 58
28. Conceptualisation
⢠How rights apply to to the
âPeer-to-Peer asset sharing scenarioâ
Sc
rio
na
e
Reproduction Right
Peer B
asset
Peer A
asset
asset
asset
asset
Make Available Right
Slide 28 of 58
33. Conceptualisation
Rights Model
⢠End-users do not hold rights
â Get licenses to use (play, viewâŚ)
â Special permissions:
â˘
â˘
â˘
â˘
â˘
â˘
â˘
Quotation
Education
Information
Official Act
Private Copy
Parody
Temporary Reproduction
Slide 33 of 58
34. Conceptualisation
Action Model
⢠Actions, the building blocks
Abstractions
derive
Victor Hugoâs
Work
manifest
distribute
Les MisĂŠrables
improvise
Objects
Processes
retransmit
Manifestation
perform
copy
Fixation
copy
Performance
record
communicate
Communication
Instance
Slide 34 of 58
35. Conceptualisation
Action Model
⢠Actions governed by Economic Rights:
â Reproduction Right :
copy
â Distribution Right :
distribute; sell, rent, lend
â Public Performance Right :
perform
â Fixation Right:
record
â Communication Right :
communicate; retransmit, broadcast, make available
â Transformation Right :
derive; adapt, translate
Slide 35 of 58
36. Conceptualisation
Action Model
⢠End-user actions,
to use aâŚ
â
â
â
â
manifestation: buy
instance: buy
performance: attend
communication: access
⢠broadcast: tune
⢠something made available: access
picture, sculpture
book, CD, DVD
projection, recital, exhibition
TV channel, radio station
web page, stream
Slide 36 of 58
38. Conceptualisation
Action Model
â˘
Case roles (linguistics): relate actions to involved entities
Facet
Main role
Other roles
Who?
agent
participant (indirect co-agent), recipient
When?
pointInTime
start, completion, duration
Where?
location
origin, destination, path
What?
object
patient (changed), theme (unchanged)
With?
instrument
medium
Why?
aim
reason
How?
manner
If?
condition
Then?
consequence
Slide 38 of 58
39. Conceptualisation
Action Model
⢠License building primitives:
â Action Patterns:
to state what is obliged, permitted or prohibited
⢠Built from actions and case roles
Sc
rio
a
en
destination
All copy events performed by agent âgrantedâ who copies âcontent01â from âPeerAâ to
two peers from the set âPeerB, PeerC, PeerDâ at any time point six months after â200706-01â
Slide 39 of 58
40. Conceptualisation
Action Model
⢠License building primitives:
â Agree: model permissions
⢠theme points to the permitted event pattern
Sc
rio
a
en
destination
Slide 40 of 58
41. Conceptualisation
Action Model
⢠License building primitives:
â consequence: model obligations
⢠Points to the obliged event pattern
Sc
rio
a
en
destination
Slide 41 of 58
42. Conceptualisation
Action Model
⢠License building primitives:
â condition: model a priori conditions
⢠Points to the condition event pattern
â Disagree: model prohibitions
⢠theme points to the prohibited event pattern
â Other concepts:
â˘
â˘
â˘
â˘
Additional actions: Transfer, Attribute,âŚ
Time, Location
Logical operators (UNION, INTERSECTION, NOT)
âŚ
Slide 42 of 58
47. Implementation
⢠One conceptual model, many implementations
⢠Semantic Web implementation with
Copyright
Web Ontology Language (OWL)
⢠Rights and License Patterns
implemented as Classes
Reproduction
Right
â Copyright, Reproduction Right, Copy, CopyPattern,...
⢠Uses
implemented as Instances
â U
⢠if u is a Copy Pattern then
license pattern authorises/prohibits u
Enabling interoperable and rightsaware DRM using the Semantic
Copy
Copy
Pattern
?
u
Slide 47 of 58
47
48. Implementation
⢠License Pattern (Class)
built from constraints on kind of actions, agents, time
points, locations, etc.
⢠OWL Building Blocks
â Classes for actions (e.g. Copy)
â Logical operators (AND, OR, NOT)
â OWL Restrictions , constraints on case roles
(e.g. agent all values from PublisherSubscribers)
Enabling interoperable and rightsaware DRM using the Semantic
Slide 48 of 58
49. Implementation
â˘
Copy pattern restricted to:
â digital object (theme )
â group of users (agent )
â˘
or
Sc
rio
a
en
â non-commercial (aim )
â˘
depending on
â time range (pointInTime )
Enabling interoperable and rightsaware DRM using the Semantic
Slide 49 of 58
50. Implementation
â˘
Patterns allowed by Agrees and prohibited by Disagrees:
â If not agreed ď not allowed
â If agreed and not disagreed ď allowed
â If disagreed ď not allowed
Agree
Copy
Agree
Disagree
all copy actions
Pattern 2
Pattern 1
Pattern 2â
u
Enabling interoperable and rightsaware DRM using the Semantic
Allowed
Slide 50 of
58
53. Aligned with other Schemas
schema.org
Action
subclass of
Use
Place
TVEpisode
MakeAvailable
location
range
subclass of
Copyright Ontology
CreationObject
subclass of
subclass of
is a
OnDemandStream
SA
ISO 3166
Country Codes
VideoScreenCapture
DDEX Ontology
Slide 53 of 58
54. Applied to Facilitate Implementation
using Reasoning
⢠Ontology provides building blocks to model and
reason about contracts, policies, rights expression
languagesâŚ
No, because it is matched
to pattern
Can we stream asset X
A
e
gr
e
ag
is
D
e
re
which prohibits it:
âArtists does not want her
music with violent imagesâ
Slide 54 of 58
57. MediaMixer Demo
Policy 1:
The licensor
disagrees the
licensee
adaptsmedia
fragments
containingâŚ
<xml>
<right>
<play/>
</right>
<content
id=âfrg1â/>
</xml>
Rights Language
Rights Language
Mapping
Mapping
Semantic
Semantic
Media
Media
Annotation
Annotation
Rights Builder
Rights Builder
User Interface
User Interface
MediaMixer
MediaMixer
Semantic Techs
Semantic Techs
RDF Store &
RDF Store &
Reasoner
Reasoner
media fragments,
semantic data,
annotation, ontologies,
reasoning,âŚ
Slide 57 of 58
58. Thank you for your attention
More details:
http://community.mediamixer.eu
http://rhizomik.net/mediamixer
http://rhizomik.net/ontologies/copyright
onto
Contact:
Roberto GarcĂa (@rogargon)
http://rhizomik.net/~roberto
1st Winter School on Multimedia Processing and Applications (WMPAâ14)
January 6th, 2014, Dublin, Ireland