The document discusses how to maximize the value of big data using the open source SpagoBI suite. It presents a comprehensive approach for working with big data that includes collecting data from various sources using datasets, performing queries, visualizing data, building information, and creating dashboards and reports. The suite allows for agile development, self-service business intelligence, and extracting additional value from information through techniques like data mining, text mining, and predictive analysis.

1. How to maximize the value
of Big Data with the open source SpagoBI suite
through a comprehensive approach
Monica Franceschini - SpagoBI Architect
SpagoBI Competency Center - Engineering Group
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

2. COMPREHENSIVE APPROACH
vis u a liz a tio
n
for BIG DATA
in fo rm a tio n b u ild in g
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

3. DATASET
Independent object to collect data from
different sources, used by visualization
tools.
schedulation
d a ta s e
t
visualization
Follows SpagoBI
behavioural model
database
in-memory
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

4. DATA SOURCES
SpagoBI data sources are defined as
connections towards different
databases both from the Hadoop
ecosystem and NoSql db
visualization
d a ta s e
t
SQL-like queries :
HiveQL
● HBQL
● CQL
● Cypher...
●
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

5. IN-MOTION DATA
Continuously running data can be
processed by stream processors or
CEPs and collected by SpagoBI
dataset
visualization
d a ta s e
t
Dataset as an Event
Handler notified by
SpagoBI Adapter of newly
available data
+
Stream processors/CEPs
SpagoBI
Adapter
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

6. SEMANTIC DATA
Classify and categorize
unstructured and
heterogeneous data through
semantic annotations, using
domain ontologies.
visualization
d a ta s e
t
Semantic information can
be stored in NoSql Graph
databases and extracted
by SpagoBI dataset
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

7. INFORMATION BUILDING
Cooperation of visualization
tools and free enquiry engine to
produce information
visualization
d a ta s e
t
Ad hoc reporting
FILE
QbE
Self Service
DATA
SOURCES
DATASET
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

8. AGILE DEVELOPMENT
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

9. SELF SERVICE
QbE engine allows to
create new datasets and
refine analysis in a
graphical way
FILE
DATA
SOURCES
DATASET
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

10. AD HOC REPORTING
Worksheet engine
provides an instant
graphical meaning to
datasets
DATASET
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

11. DASHBOARDS
Cockpit engine allows aggregating
different documents, interacting one
with each other, to get information at a
glance
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

12. JUST A USE CASE
Open Data + Big Data = Value
VALUE
for BIG DATA
BIG DATA
Te le c o m m u n ic a tio n c o m p a n ie s :
need to extract value from mobile data traffic
information to improve services and advance
new solutions
OPEN
DATA
Pu b lic a d m in is tra tio n : need to extract
value from information gathered from different
sources (consumption, highway traffic, voice
traffic) in order to improve the supply of tourist,
environmental, social services
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

13. INFORMATION CYCLE
SpagoBI tools cooperating together
produce NEW VALUE from
information
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

14. WHAT NEXT?
Data mining
Text mining
Sentiment analysis
Predictive analysis
...
Ex tra c t
va lu e fro m
in fo rm a tio n
d a ta s e
t
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con

15. Find out all information
(demo, documentation, tutorials, services and much more)
and download all SpagoBI components at:
w w w.s p a g o b i.o rg
Contact us
s p a g o b i@e n g .it @tw ittm o n iq u e – m o n ic a .fra n c e s c h in i@e n g .it
Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center
www.ow2.org
Twitter #ow2con