Uncertainty Handling in Mobile Community Information Systems

Oberseminar

Yiwei Cao Informatik 5, RWTH Aachen
5

Uncertainty Handling in Mobile
Community Information Systems

Yiwei Cao

March 22, 2012

Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-Cao-0312-1

Oberseminar

Yiwei Cao Agenda
Introduction
- Background and problem
- Scenario
- Uncertainty 2.0
Concept of the uncertainty handling models
Technical realization of Virtual Campfire
Model lid ti through Vi t l C
M d l validation th h Virtual Campfire
fi
Conclusions and outlook

Prof. Dr. M. Jarke
I5-Cao-0312-2

Oberseminar
Background: Uncertainty in
Yiwei Cao Database Research
Representation of data uncertainty
- Uncertainty is a term used in many research fields: philosophy, economics, finance,
statistics, psychology, sociology, physics, engineering, artificial intelligence,
information science, and computer science Web and mobile lead to uncertainty
p y
- Uncertainty is defined as a measure of the incompleteness of one’s knowledge or
information about an unknown quantity whose true value could be established if a
Introduction perfect measuring device were available [CuFr99]
Concepts - 4I representation of data uncertainty: incorrect, incomplete, imprecise, and
Realization inconsistent information [KKMK09]
Validation
Advanced uncertainty databases
Conclusions
- Based on probabilistic theory, statistics, and fuzzy logic [AAB*03, KKMK09]
- Examples: Orion [SMM*08], Trio [BSHW06]
- Text and number-based objects multimedia has higher requirements
- Data centered the user factor and context are not considered
Prof. Dr. M. Jarke
I5-Cao-0312-3

Oberseminar

Yiwei Cao Background of Concepts
Web 2.0
- Social network sites for information sharing
- User-generated content and tagging [Smit07, MNBD06, SLWa11]
- Folksonomy instead of taxonomy [Orei05]
Introduction
Concepts
Community of Practice
Realization
Validation - Groups of people who share a concern or a passion for something
Conclusions they do and who interact regularly to learn how to do it better
[
[Weng98]
g ]
- Mutual engagement
p
- Joint enterprise
(Information Systems) - Shared repertoire
Prof. Dr. M. Jarke
I5-Cao-0312-4

Oberseminar
Uncertainty Scenario:
Yiwei Cao Formula 1 Motor Race in Monaco
reporter Photo experts?
Lack of clarity, not lack of data [
y, [DaLe86]
]
monte carlo
monaco Fan community? chicane ?
ferrari
bmw curve-7
technician @twitter port
Introduction fairmont

Concepts ? ?
Realization 43°40′15″N
start 7°17′52″E
Validation like@facebook
43°44′23″N swimming-pool
Conclusions 7°25′38″E delete

Source: http://en.wikipedia.org/wiki/File:Monte_Carlo_Formula_1_track_map.svg

big-curve Semantics-related Context-related Community-related
y
(Information Systems) Search for all photos shared by Ferrari fan community taken at my current location of
Prof. Dr. M. Jarke
I5-Cao-0312-5 Grand Prix 2004?

Oberseminar

Yiwei Cao Aspects of Uncertainty 2 0
2.0
Context uncertainty
- Uncertainty refers to poor quality of contextual data acquired directly from the environment
- Geospatial, temporal, social/community, and technical
e.g. measure or perception errors of mobile devices [HeIn04] 43°40′15″N 43°44′23″N
7 17 52 E
7°17′52″E 7 25 38 E
7°25′38″E
Semantics uncertainty
- Uncertainty refers to a large number of different meanings embedded in the same
Introduction multimedia content
Concepts - Domain, richness, precision, and machine-readability
Realization e.g. variety of metadata standards: general vs. domain specific metadata standards [Kosc03]
e.g.
e g GPS information (context) is mapped to another way of location name (semantics) fairmont
Validation
Conclusions Community uncertainty
- Uncertainty refers to various influences of user communities
- Creation, management, search & retrieval, sharing, and recommendation
e.g. users, esp. some amateurs annotate multimedia with false information (intentionally) curve-7
e.g. different communities have different interest and semantic
ferrari reporter
misunderstandings
(Information Systems) e.g. users use false operations on multimedia like@facebook
Prof. Dr. M. Jarke
I5-Cao-0312-6

Oberseminar

Yiwei Cao Research Questions
How to define, identify, and handle uncertainty 2.0 in mobile community
, y, y y
information systems?
Which information processes may operate on multimedia semantics and
context for uncertainty handling?
Can we optimize usage of tags to reduce uncertainty in mobile
Introduction
Concepts
community information systems?
Realization Which user roles are present in communities of practice and with which
Validation “practices” d th play?
“ ti ” do they l ?
Conclusions
How do experts and amateurs interact on uncertainty handling in mobile

Prof. Dr. M. Jarke
I5-Cao-0312-7

Oberseminar

Yiwei Cao Concept: Mind Map
Introduction
Concepts
VC Storytelling
Realization maps Data
Workflow Service
management
Validation model
model

con
VC Tagging

nsists of
Conclusions

employs
consists of
results in

Web ACIS
2.0
2 0 Uncertainty
s

Uncertainty models realizes demos
handling Application CCPLE
2.0 aspects
models
Mobile
YouTell G.A.
based on
n

supports
Web

needs
DS CoP ATLAS Afghan cultural
2.0 heritage researchers

G.Averof Battleship
Community
museum managers

Classic Chinese Poem
learners
Prof. Dr. M. Jarke
I5-Cao-0312-8

Oberseminar

Yiwei Cao Starting Point: ATLAS Media Theory

Media
M di processing
i
operations [Jaeg02,
SKJa02, Span07, Klam10]
Introduction
- Transcription (semantics)
Concepts
- Localization (context)
Realization
- Addressing (community)
Validation
Conclusions Conceptual information flow
between media and
communities
iti
Source: [Span07]
Mobile and Web 2.0
aspects are not considered
p
Prof. Dr. M. Jarke
I5-Cao-0312-9

Oberseminar
Uncertainty 2.0 Handling Model:
Yiwei Cao Workflow for System Engineering
1. A common data set for user
Database communities to manage
Meta‐
data
Semantization Meta‐ Tags
Tags
multimedia with context and
semantic information
WWW data Tags
1. Data storage
g
metadata management 2. Collaborative tagging
2. Semantics is enhanced via user
generated tags in communities

Conte
of practices
pr

Introduction
roduction

extualization
Concepts 3. Multimedia artifacts with
Realization reduced uncertainty are further
Validation
4. Mobile adaptation 3. Community–based
addressed to communities for
Conclusions storytelling storytelling
Contextualization Stories 4.
4 Mobile devices enrich media
capture ways and share
adaptive multimedia
A loop f mobile multimedia
l for bil lti di
Prof. Dr. M. Jarke
management
I5-Cao-0312-10

Oberseminar
Uncertainty 2.0 Handling Model:
Yiwei Cao Data Management Model

Community
Contextualization based
CoP
Amount o multimedia decreases

Uncertain decrease

Storytelling

Introduction
nty
of

Semantics
Concepts Management Collaborative
Semantization
Tagging
Realization
Context Management
g
es

Validation Mobile
Contextualization
Conclusions Adaptation
Metadata Management
Semantization

Contextualization
Mobile Multimedia Data Management

Prof. Dr. M. Jarke
I5-Cao-0312-11

Oberseminar
Uncertainty 2.0 Handling:
Yiwei Cao Mobile Adaptation

CoP

Introduction Semantics
Semantics
Concepts Management
Management

Realization
Context Management
g
Validation Mobile
Contextualization
Conclusions Adaptation
Metadata Management


Prof. Dr. M. Jarke
I5-Cao-0312-12

Oberseminar
The Mobile Multimedia
Yiwei Cao Adaptation Process
1. Interoperability is enhanced by multimedia metadata standards
2.
2 Metadata is converted into RDF via ontology based context modeling according to use context
ontology-based
3. Context queries in SPARQL are executed based on context reasoning
4. Queried multimedia results are adapted onto mobile devices

Multimedia SPARQL
metadata standards
Introduction
Concepts MPEG‐7
Realization
Ontology A Ontology B
gy gy
Validation Dublin Core
D bli C
OWL
Conclusions Mobile
Context RDFS Domain multimedia
TV‐Anytime
y Information
RDF query results
lt

EXIF

(Information Systems) ...
Prof. Dr. M. Jarke
I5-Cao-0312-13

Oberseminar
An Example of the Mapping
Yiwei Cao between MPEG 7 and RDF
MPEG-7
<rdf:RDF xmlns:rdf="... " xmlns:mpeg7="...">
<rdf:Description>
p
<urn:Description xsi:type="urn:SemanticDescriptionType"
D i ti it " S ti D i ti T " <mpeg7:Description> <mpeg7:SemanticDescriptionType>
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <mpeg7:Semantics rdf:parseType="Resource">
<urn:Semantics> <mpeg7:SemanticBase>
<urn:Label /> <mpeg7:SemanticPlaceType
p g yp
<urn:SemanticBase xsi:type="urn:SemanticPlaceType"
S ti B it " S ti Pl T " xml/curve7.xml#SemanticPlaceType_user20091115">
id="SemanticPlaceType_user20091115"> <mpeg7:Place rdf:parseType="Resource">
<urn:Label> <mpeg7:GeographicPosition
<urn:Name>curve 7</urn:Name> rdf:parseType="Resource">
p yp
Introduction <urn:Definition> monaco grand prix route</urn:Definition>
D fi iti d i t / D fi iti <mpeg7:Point rdf:parseType="Resource">
Concepts </urn:Label> <mpeg7:longitude>7.269449</mpeg7:longitude>
<urn:Place> Automatic
Realization <mpeg7:latitude>43.83931</mpeg7:latitude>
<urn:GeographicPosition> mapping
<mpeg7:altitude>29.0</mpeg7:altitude>
p g p g
Validation <urn:Point altitude="29.0" latitude="43.83931" llongitude=
P i t ltit d "29 0" l tit d "43 83931" it d </mpeg7:Point>
"7.269449" /> </mpeg7:GeographicPosition>
Conclusions </urn:GeographicPosition> </mpeg7:Place>
</urn:Place> <mpeg7:Label rdf:parseType="Resource">
p g p yp
</urn:SemanticBase>
/ S ti B <mpeg7:Definition>monaco grand prix route
</urn:Semantics> </mpeg7:Definition>
</urn:Description> <mpeg7:Name>curve 7</mpeg7:Name>
</mpeg7:Label>
...
</mpeg7:Semantics> ...
Prof. Dr. M. Jarke </rdf:RDF>
I5-Cao-0312-14

Oberseminar

Yiwei Cao Context-aware
Context aware Queries
Querying multimedia context in SPARQL
- Example: search for all photos taken at a certain curve
Multimedia results are more precise
- Semantics of multimedia artifacts is enriched via mapping of context and semantics
- Ontology is applied for basic context reasoning

Introduction
PREFIX mpeg7: <http://manet.informatik.rwth-aachen.de/~khodaei/mpeg7-v2.owl#>
Concepts PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
Realization PREFIX xsd: <http://www.w3.org/2001/XMLSchema#>
Validation PREFIX fn: <http://www w3 org/2005/xpath functions#>
<http://www.w3.org/2005/xpath-functions#>
SELECT ?l ?alt ?file
Conclusions
WHERE { ?l mpeg7:Place ?r . ?r mpeg7:GeographicPosition ?r2 . ?r2 mpeg7:Point ?r3 .
?r3 mpeg7:altitude ?alt. ?l mpeg7:Label ?label . ?label mpeg7:Name "curve 7". ?l ?spt
g g g
mpeg7:SemanticPlaceType . ?mc mpeg7:SemanticBaseRef ?ll. ?des mpeg7:Semantic ?mc . ?des
mpeg7:MediaInformation ?mi . ?mi mpeg7:MediaIdentification ?mid . ?mid mpeg7:EntityIdentifier ?file.
FILTER (xsd:float(?alt) > 28.0). FILTER (STR(?l) = ?ll)}

Prof. Dr. M. Jarke
I5-Cao-0312-15

Oberseminar
Uncertainty Handling:
Yiwei Cao Collaborative Tagging

CoP

Semantics
Concepts Management
Management Collaborative
Semantization
Tagging
Realization
Context Management
g
Validation
Conclusions
Metadata Management


Prof. Dr. M. Jarke
I5-Cao-0312-16

Oberseminar

Yiwei Cao Commsonomy
Community as a new dimension for the tag space
Commsonomy is a community-based folksonomy defined and used
within and across communities of practice
Media processing operations
- Semantization: users tag resources
Introduction
- C t t li ti users share
Contextualization: h
Concepts
resources in communities

Contex

Seman
Realization

ntization
Validation

xtulization
Conclusions

Prof. Dr. M. Jarke
I5-Cao-0312-17

Oberseminar

Yiwei Cao Extended Commsonomy Model
Tagging as an effective “practice” conducted in communities of practice [CKKR10]
− Various Web 2.0 operations are different types of tagging activities
20
A role model to support
amateurs and experts
Focus on community
requirements
Introduction
Concepts
Realization
Validation
Conclusions

Prof. Dr. M. Jarke
I5-Cao-0312-18

Oberseminar

Yiwei Cao Web 2 0 Operations as Tagging
2.0
Goal: providing appropriate and “certain” media operations to user communities
Represented in a t l of (
R t d i tuple f (user, operation, media, tag, community)
ti di t it )
Operations are compound if the tags have restrictions, otherwise are simple
User generated
User-generated tags enrich multimedia semantics to handle uncertainty 2.0

Introduction
Concepts
Realization
Validation
Conclusions

Prof. Dr. M. Jarke
I5-Cao-0312-19

Oberseminar
Uncertainty Handling:
Yiwei Cao Community-based
Community based Storytelling

Community
Contextualization based
CoP Storytelling

Semantics
Concepts Management
Management

Realization
Context Management
g
Validation
Conclusions
Metadata Management


Prof. Dr. M. Jarke
I5-Cao-0312-20

Oberseminar
Community-Based Storytelling with a
Yiwei Cao Role Model and Story Templates
Storytelling is a compound media operation with multiple tag values
- Digital storytelling combines narratives with digital content and produces digital
stories in the form of a collection of multimedia [Robi07]
- Storytelling for error and inconsistency detection [BaMu08 Have07]
[BaMu08,
Community based storytelling [CKMa08, CKJa10]
Introduction - An effective practice in CoP
Concepts - Template-based nonlinear storytelling
Realization Movement Oriented Design (MOD)
Validation Hero’s journey
Conclusions
- A role model for storytelling
Domain experts
Multimedia experts
- New algorithms
User profile-based story search
Prof. Dr. M. Jarke Expert finding
I5-Cao-0312-21

Oberseminar
New Algorithm Based on Concepts:
Yiwei Cao Profile-Based
Profile Based Story Search

Tags
Introduction
Concepts
Realization
Validation
Conclusions

Uncertainty is reduced additionally
- Users’ story rating
Prof. Dr. M. Jarke
I5-Cao-0312-22
- Users’ media tagging and story tagging

Oberseminar
Validation: Virtual Campfire Mobile
Yiwei Cao Community Information Systems
SeViAnno

Database
D t b
Meta‐
Datadata
repository: cultural
Semantization
heritage, WebWWWuser
2.0 Meta‐
data
Tags
Tags
Tags
generated media etc.
1. Data storage
metadata management 2. Collaborative tagging
Introduction Collaborative tagging
Concepts

Contextualization
Contextualization
produ

Realization
uction

Validation
YouTell
Conclusions Mobile
Campfire
4. Mobile adaptation 3. Community –based
storytelling

Contextualization Stories

Prof. Dr. M. Jarke
Mobile adaptation and production Community-based storytelling
I5-Cao-0312-23

Oberseminar
Validating Virtual Campfire with
Yiwei Cao Various Cultural Communities
Afghan cultural heritage management community
- Context and semantics mapping to engineer GIS community information
systems
- Employment o multimedia, cu u a , a d G S metadata s a da ds
p oy e of u ed a, cultural, and GIS e ada a standards
- Community multimedia access based on a role model

Introduction
The G k B ttl hi G
Th Greek Battleship Georgios A
i Averof management community
f t it
Concepts
- Commsonomy for user communities to use semantics-rich tags
Realization
- User profile-based story search for media selection
p y
Validation
- Community-based role model, experts emerging from amateurs
Conclusions

Classical Chinese Poem learner community
- Geo-tagging support
- Various tagging approaches for learning content: multi-granular,
standard-based
Prof. Dr. M. Jarke - Community role model, game-based learning based on stories
I5-Cao-0312-24

Tagging Practice for Afghan Cultural
Heritage Management: SeViAnno
Oberseminar

Yiwei Cao

Context: tight time schedule for cultural heritage researchers
Semantics: diff
S ti different iinterpretations of multimedia f
t t t ti f lti di from diff different d
t domain experts
i t
Community:
Macro
collaboration
among worldwide
users
Introduction Tagging
Concepts - Multi-granular
Realization - Metadata
Validation - Context-aware
Conte t a are
Conclusions

Micro

Meso

Prof. Dr. M. Jarke
I5-Cao-0312-25

Oberseminar

Yiwei Cao SeViAnno Service Usage
Context uncertainty
- Map-based tagging (geo-tagging)
- MPEG-7 metadata standard-based tagging with multi-granularity
Community uncertainty: users’ usage of different tagging approaches
Introduction
- D
Domain experts use metadata standard-based t i
i t t d t t d d b d tagging
Concepts
- Amateurs use simple tagging
Realization
Validation
Conclusions

Prof. Dr. M. Jarke
I5-Cao-0312-26

Oberseminar
Storytelling Practice for Battleship
Yiwei Cao Georgios Averof: YouTell
Context: the events with some temporal and
spatial variants
Semantics: a large amount of multimedia of
the same event, even with description in
ancient Greek
Community: cooperation of interdisciplinary
Introduction domain experts
Concepts A story example using the Movement
Realization Oriented Design story template
Validation Mobile Campfire
M bil C fi
Conclusions

Community
Tagging Production Storytelling
management

Prof. Dr. M. Jarke
I5-Cao-0312-27

Oberseminar

Yiwei Cao YouTell Tag Usage
- Si l multimedia artifact t
Single lti di tif t tags and story tags used iin story search
d t t d t h
Context uncertainty
- Geo tagging and mapping to multimedia metadata
Geo-tagging
Community uncertainty
Introduction - Domain experts have access to edit stories created by amateurs
Concepts - Story templates help amateurs tell good stories
Realization - Communities of practice cultivate experts and expert knowledge
Validation
Conclusions

Prof. Dr. M. Jarke
Tags
I5-Cao-0312-28

Oberseminar

Yiwei Cao Conclusions
How to define, identify, and handle uncertainty in mobile community
, y, y y
information systems?
- Definition and identification of uncertainty 2.0 for mobile community information
systems in th aspects of multimedia semantics, context, and community
t i the t f lti di ti t t d it
- Uncertainty 2.0 handling through a layer data management model
Introduction - Engineering mobile community information systems with a workflow based on the
Concepts concept of community of practice
Realization - Validation in Virtual Campfire with algorithms, services, and applications
Validation
Which information processes may operate on multimedia semantics and
Conclusions
context for uncertainty handling?
- S
Semantization: media t
ti ti di transcription, collaborative t i
i ti ll b ti tagging
- Contextualization: mobile adaptation, media localization, community addressing,
community-based storytelling
y y g
Prof. Dr. M. Jarke
I5-Cao-0312-29

Oberseminar

Yiwei Cao Conclusions
Can we optimize usage of tags to reduce uncertainty in mobile
it i f ti t ?
- Yes, commsonomy combines Web 2.0 and mobile community information systems
- Experts’ tag usage reduces uncertainty
Experts
- Tagging optimizes Web 2.0 operations and is applied for system engineering
Introduction Which user roles are present in communities of practice and with which
Concepts “practices” do they play?
Realization - A comprehensive role model integrates amateurs and domain experts
Validation
- Users practice tagging and storytelling for mobile multimedia management
Conclusions
How do experts and amateurs interact on uncertainty handling in mobile
it i f ti t ?
- Amateurs collaborate with and learn from experts in CoP through various practices
- Expert knowledge is collected in mobile data management with a common data
repository for certain domains
Prof. Dr. M. Jarke
I5-Cao-0312-30

Oberseminar

Yiwei Cao Outlook
Storytelling for knowledge management in enterprises and organizations
Augmented reality tagging
Social network analysis for uncertainty 2.0 handling
Validation of VC media operations and practices on mobile and Web 2.0
social network sites
Introduction
Concepts Enhancement of community support in interdisciplinary user
Realization communities: entrepreneurship, journalists, etc.
Validation
Conclusions

Prof. Dr. M. Jarke
I5-Cao-0312-31

Oberseminar

Yiwei Cao Thank You

Questions

Prof. Dr. M. Jarke
I5-Cao-0312-32

Uncertainty Handling in Mobile Community Information Systems

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie Uncertainty Handling in Mobile Community Information Systems

Ähnlich wie Uncertainty Handling in Mobile Community Information Systems (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Uncertainty Handling in Mobile Community Information Systems