UUM, Universiti Utara Malaysia, http://uum.edu.my

1. TIV3033 Multimedia Databases
Group B
Name : Syamsul Bahrin Zaibon
Room : FTM 3124
Phone : 04-928 4679
Email :
URL : http://www.uum.edu.my
Consultation Hour :
Tuesday & Thursday 2.30 – 4.30 pm
1

2. TIV3033 Multimedia Database
Topic 1
INTRODUCTION TO MULTIMEDIA
DATABASES
Chapter 1 – MMDB [Lynne Dunckley]
2

3. So what is A Database?
http://www.uum.edu.my
3

4. • Database describes a collection of
data organized in a manner that
allows access, retrieval and use of
data.
• Database is an integration of different
kind of data which is deeply
concerned with the development of
computers to store fast increasing
data of the real world and utilize them
communally with ease.
http://www.uum.edu.my
4

5. Definition: Extracts from Dr. William I. Grosky
In any such system, the real-world objects
which comprise its domain are directly
represented through their properties and
indirectly represented through their
relationships to other real-world objects.
• Text-based systems
• Object-Oriented Systems
• Multimedia Information Systems
http://www.uum.edu.my
5

6. What is a Text-based systems
• All properties and relationships are
presented in a textual format to the
user
http://www.uum.edu.my
6

7. What is an Object-oriented systems
• Allow the representation of more
complex properties such as
• those which are set or sequence valued
• those whose values are other objects
• Presents information in a textual
format.
http://www.uum.edu.my
7

8. What is Multimedia information system ?
• There exist representations of objects
which are not textually based. These
representations consist of:
• portions of images (static visual
representations of objects)
• videos (dynamic visual representations of
objects)
• audios (aural representations of objects)
http://www.uum.edu.my
8

9. What is Multimedia information system (ctd.)
When these representations are
included in the domain of an
information system, they can be
used in two distinct fashion:
•real-world objects themselves
•user-recognizable surrogates for the
real-world objects
http://www.uum.edu.my
9

10. WHAT IS DIFFERENT ABOUT MM DATA?
There are 3 challenges that arise from
mm data that do not occur with
other data types:
•size
•time
•The semantic nature of multimedia
is more complex than for traditional
data types
http://www.uum.edu.my
10

11. Size
• To get an idea of media data object,
consider that the storage of single
good quality colored image could
required 6MB
• So, data size will affect the storage,
retrieval & transmission of mm
• Therefore, techniques that reduce the
size of mm data without impacting on
the information within the data are
extremely important
http://www.uum.edu.my
11

12. Time
• The frames of the video must run in the
correct sequence & at an acceptable
rate
• The same is true of audio media
• This relationship with time will have
significance for the way the media
object are
stored, retrieved, transmitted &
synchronized
• This effect of time is often referred to as
the real-time nature of MM
http://www.uum.edu.my
12

13. Semantic Nature
• It makes it difficult to identify
components within the media that
could be used for retrieval or
transaction processing
• An apparently simple solution would
be to add a description in words of the
content of the image
• However, when we want to find a way
to retrieve a specific image we find
that a picture often means different
things to different people
http://www.uum.edu.my
13

14. Semantic Nature (ctd)
• For example, we have an image of the
product as well as a description in text
• The context is important for interpreting
the meaning of an image so that in db
terms the application domain is even
more significant than for traditional db
• In order to manage the semantic
nature of the media, interpretations
may need to be made based on
certain features of the mm data and
stored as metadata
http://www.uum.edu.my
14

15. Key topics to be considered in MMDB
1. Data modeling issues for :
images, Video, Hypermedia
2. Content-based indexing for images
and video
3. Multimedia content indicators for
browsing
4. Content-based browsing
5. Various prototype databases: image
databases , video
databases, hypermedia systems.
http://www.uum.edu.my
15

16. Types of media (1)
Text
• Or documents, except keywords, a more
effective representation also includes:
structure, layout, link, etc. (e.g., hypertext)
Image
• Digital equivalents of
drawings, partings, photographs, or prints
Graphics
• Concepts that allow the generation of drawings
and other images based on formal
descriptions, programs or data structures
http://www.uum.edu.my
16

17. Types of media (2)
Audio
• Considers temporal characteristics
• A meaningful interpretation of audio data is based on its
relationship to a constantly progressing time
scale, e.g., signal
Video
• Integrates the properties of Audio and Image. In addition
to time dependency of audio data, Video has to reflect
the time dependency of video stream, ie., the time-
dependent sequencing of frames/images
• The time scale of a video is, like audio, an absolute one
which associates each video frame with its correct
interpretation at any point in time
http://www.uum.edu.my
17

18. Types of media (3)
Speech
• Speech shares the properties of audio, but it also has its
unique properties of spoken natural language. Speech data
could serve as an input for the retrieval of audio and speech
data, or generated as a result of queries
• Using speech recognition system to translate speech to text is
generated => large vocabulary, recognition error
• Recent progress on speech recognition allow the recognition
of characteristic keywords, and the identification of specific
speakers
Generated Media
• Computer-generated presentations like animation and
music. Both can be seen as a special kind of continuous
media if they’re generated in real time during presentation
• Animations are associated with a relative time scale (which
can be distorted by speeding up/slowing down without
affecting its meaning); with music it is similar, although the
freedom of changing the time scale may be restricted
http://www.uum.edu.my
18

19. A Generic Architecture of MMDBMS
Feature Query feature construction
Indexing
extraction query
MM results
Media objects Search Engine Users
DBMS
Compression feedback
Feedback Query construction
http://www.uum.edu.my
19

20. MMDBMS Development
Major steps in developing MMDBMS
1. Media acquisition:
 collect media data from various sources, such as
WWW, CD, TV, etc.
2. Media processing:
 extract media representations and their
features, including noise filtering, rending, etc.
3. Media storage:
 store the data and their features in the system based
on application requirement.
4. Media organization:
 organize the features for retrieval. i.e., indexing the
features with effective structures.
5. Media query processing:
 Accommodated with indexing structure, efficient
search algorithm with similarity function should be
designed.
http://www.uum.edu.my
20

21. Modeling Issues in MMDBs
• Differences between traditional data modeling
and time-based data modeling are:
• Data Flow , Timing , Temporal Composition and
Synchronization
• MMDB support for a BLOB (Binary Large Object)
data type has been added to most commercial
database systems.
• Although a BLOB does allow the user to
reference large data objects, a BLOB does not
provide enough support for complex data
types.
http://www.uum.edu.my
21

22. CONCLUSION
1. Multimedia Content Becomes More and
More Popular
2. A database is something that holds and
organizes data in a way that makes it easy
to retrieve and allow a user to search for a
particular record.
3. A multimedia database allows text, data,
video, still image, dynamic image and
audio to become integral parts of
database management- and this is a
consequence of information retrieval.
http://www.uum.edu.my
22