SlideShare ist ein Scribd-Unternehmen logo
1 von 11
Big Data and Security

Michel Burger
0.05 ounces/ton




                  Gold mining is about dirt management
About 11850 Amps to generate
around 8.4 Tesla fields (about
   150000 times the earth
   magnetic field) but they
   operate at low Voltage


     A lot of what LHC is about is electricity flow management
How BIG?

BIG data is like the LHC combined with gold
extraction
- Huge amount of data -> 6.6 Zettabytes/year by 2016 (Cisco
  Cloud Index)

- Big flow of data -> 400TB/day (Facebook)
- LHC generates 10-15 Petabytes/year of data for each
  experiment
The essence of new service
providers                                                                 BI Based Revenue Models
                                                                                (eg Advertisement)

                                             User
                                                                               Core Semantic

                          Improves                            Consumes
                         experience
                                                                                Data Set
                                                                                Mindmap

                                                                                            Revenue from
Value enriched Data
                                                                                            existing services
          generates
            revenue         Data                                  Service                   will shrink
                                                                   Service
                                            Produces                Service
                                                                                               Additional
                                                                                               revenue from
                                                                                               new services

  The more context
the more efficient and
                             One data set                                               Many free services
   the more value            and common semantic
                                                            Example:
                                      Search/Information Management :
                                                 Rated auction/Selling:
Classic Approach
• Structured Data
• Data in the range of Gigabytes to Terabytes
• Centralized (Data is imported in analytics)
• Batch based
• Data silos

                ETL                ETL               ETL
  Transaction         Relational           Data            Analyse
                      Database           Warehouse




         Where is the data that answer my questions ?
Big Data Approach
  • Multi Structured Data
  • Data in the range of Terabytes to Petabytes
  • Distributed/Federated (Analytics grab the data)
  • Streaming based
  • Holistic Data Clusters
                   1

         Stream    2
                                 Organize             Analyse

                   3

                   n


Here are the questions and the data for the answers
A new pattern
             • Many different data structures
             • Many different ways to extract the data
                                                     Knowledge                                                                                                                   • Structured
             • Many different locations (even for the
                                                     References




                                                                                                                                                                                        API
                                          Services                              Content
Sources




                   Applications
                                                                                                                                Social Networks
                                                                                                                                                                                   Buffering
               same type of data)                                                                                                                                                  •   Proprietary
                                                                                                                                                                                   •
                                                                                                                                                                           RAN
                                                                                                                                                                                       Graph
             • Batch and Realtime based
                   Data card
                                                                                                                                                                                   •
                                                                                                                                                                                          Data as a
                                                                                                                                                                                           Service
                                                                                                                                                                                       Neural Network
             • Buffered or stream
                   Sim Card                                                               Premise                                   Network Core

                                                                                                                                                                                   •
                                                         Connected Things

                                  Connected
                                                       (Consumer, Enterprise)
                                                                                          Gateway
                                                                                                                                                                                       Relational
             • Correlation parameters                                                                                                                                            • Unstructured
                                   Devices                                                                                         IT Infrastructure




                                                                                                                                                                                                         Consumption
                                                                                                                                                                                   Buffering
                                                                                                                                                                                          Report
                                                                                                                                                                                         Statistics


                                                                                                                                                                                 • Streaming
                                                                                                                                                                                 • Taping at Source



                                                                                           Real-time



                                                                                                                                    Cheap Storage High Efficient Storage
                                                                                                           Low level Semantic
                   • Buffering, Routing, Filtering                                                                                                                               • Taping on Stream
                   • Structured/Unstructured                                                                                                                                     • Consumption to
          Stream




                                                                                                                                                                                               Graph
                                                                                                                                                                                              Network/

                     store                                                                                                                                                         Source     Analysis




                   • Event Collector
                   • Batch Process/Multi
                                                                                           Non Real-time

                                                                                                           Rich Semantic


                     Structure Stream
                   • Multi Stage Store/Process                                                                                                                                               Neura l
                                                                                                                                                                                            Network/
                                                                                                                                                                                            Analysis
With added security
                                                                Knowledge
                                                                References




                                                                                                                                           API
                                                     Services                              Content
Sources




                                                                                                               Social Networks
                      Applications


                                                                                                                                      • Strong access
                                                                                                                        RAN
                                                                                                                                        control based
                                                                                                                                             Data as a
                                                                                                                                              Service
                      Data card
                      Sim Card
                                                                    Connected Things
                                                                  (Consumer, Enterprise)
                                                                                                     Premise
                                                                                                     Gateway
                                                                                                                   Network Core
                                                                                                                                        on industry
                                             Connected
                                              Devices                                                             IT Infrastructure
                                                                                                                                        standard




                                                                                                                                                            Consumption
                                                                                                                                        (user, dev, app
                                                                                                                                        lication)
                                                                                                                                             Report
                                                                                                                                            Statistics



                   • Securing the infrastructure (public, private)                                                                    • Strong
                         •           Policy (internal/external)                                                                         authorization
                         •           On-going assessment (DDOS, Penetration …)                                                          control based
                         •           Data leakage
                         •
                                                                                                                                        on open
          Stream




                                     Migration                                                                                                    Graph

                                                                                                                                        standard
                                                                                                                                                 Network/


                   • Securing the identity
                                                                                                                                                 Analysis




                         •           Validating ID                                                                                    • Analytics
                         •           Anonymization                                                                                      applied to
                   • Securing the access                                                                                                Analytics
                         •           Distributed permission/preference
                         •           3rd party permission                                                                                       Neura l
                                                                                                                                               Network/
                                                                                                                                               Analysis
Final thoughts
1. We need to eliminate the silos
   – Sources or Usage
2. Still very much a collection of technologies
   – The assembly is still very complex
3. Is everything about events?
4. We need to handle the CAP theorem more appropriately
5. What is the user experience (not just the end user but also
   the admin)
Thank You

Weitere ähnliche Inhalte

Was ist angesagt?

2012.04.26 big insights streams im forum2
2012.04.26 big insights streams im forum22012.04.26 big insights streams im forum2
2012.04.26 big insights streams im forum2Wilfried Hoge
 
Document Imaging Tools and Strategies to Accelerate Your Accounts Payable Act...
Document Imaging Tools and Strategies to Accelerate Your Accounts Payable Act...Document Imaging Tools and Strategies to Accelerate Your Accounts Payable Act...
Document Imaging Tools and Strategies to Accelerate Your Accounts Payable Act...Verbella CMG
 
Rapleaf Overview
Rapleaf OverviewRapleaf Overview
Rapleaf Overviewcjaros73
 
Accelerating It Migration Success With A Rock Solid Hp And Red Hat Enterprise...
Accelerating It Migration Success With A Rock Solid Hp And Red Hat Enterprise...Accelerating It Migration Success With A Rock Solid Hp And Red Hat Enterprise...
Accelerating It Migration Success With A Rock Solid Hp And Red Hat Enterprise...Vedanta Barooah
 
HP Microsoft SQL Server Data Management Solutions
HP Microsoft SQL Server Data Management SolutionsHP Microsoft SQL Server Data Management Solutions
HP Microsoft SQL Server Data Management SolutionsEduardo Castro
 
Customer relationship management powerpoint templates
Customer relationship management powerpoint templatesCustomer relationship management powerpoint templates
Customer relationship management powerpoint templatesSlideTeam.net
 
Sap sap so h 2013
Sap sap so h 2013Sap sap so h 2013
Sap sap so h 2013deepersnet
 
Keynote Sap UA Conference March 23 a zeier final
Keynote Sap UA Conference March 23 a zeier  finalKeynote Sap UA Conference March 23 a zeier  final
Keynote Sap UA Conference March 23 a zeier finalProf. Dr. Alexander Zeier
 
Boston HUG - Cloudera presentation
Boston HUG - Cloudera presentationBoston HUG - Cloudera presentation
Boston HUG - Cloudera presentationreedshea
 

Was ist angesagt? (11)

Rapleaf
RapleafRapleaf
Rapleaf
 
2012.04.26 big insights streams im forum2
2012.04.26 big insights streams im forum22012.04.26 big insights streams im forum2
2012.04.26 big insights streams im forum2
 
Document Imaging Tools and Strategies to Accelerate Your Accounts Payable Act...
Document Imaging Tools and Strategies to Accelerate Your Accounts Payable Act...Document Imaging Tools and Strategies to Accelerate Your Accounts Payable Act...
Document Imaging Tools and Strategies to Accelerate Your Accounts Payable Act...
 
Rapleaf Overview
Rapleaf OverviewRapleaf Overview
Rapleaf Overview
 
Accelerating It Migration Success With A Rock Solid Hp And Red Hat Enterprise...
Accelerating It Migration Success With A Rock Solid Hp And Red Hat Enterprise...Accelerating It Migration Success With A Rock Solid Hp And Red Hat Enterprise...
Accelerating It Migration Success With A Rock Solid Hp And Red Hat Enterprise...
 
HP Microsoft SQL Server Data Management Solutions
HP Microsoft SQL Server Data Management SolutionsHP Microsoft SQL Server Data Management Solutions
HP Microsoft SQL Server Data Management Solutions
 
FAST Search for SharePoint
FAST Search for SharePointFAST Search for SharePoint
FAST Search for SharePoint
 
Customer relationship management powerpoint templates
Customer relationship management powerpoint templatesCustomer relationship management powerpoint templates
Customer relationship management powerpoint templates
 
Sap sap so h 2013
Sap sap so h 2013Sap sap so h 2013
Sap sap so h 2013
 
Keynote Sap UA Conference March 23 a zeier final
Keynote Sap UA Conference March 23 a zeier  finalKeynote Sap UA Conference March 23 a zeier  final
Keynote Sap UA Conference March 23 a zeier final
 
Boston HUG - Cloudera presentation
Boston HUG - Cloudera presentationBoston HUG - Cloudera presentation
Boston HUG - Cloudera presentation
 

Ähnlich wie Vodafone xone fev142013v3 ext

Informatica World 2006 - MDM Data Quality
Informatica World 2006 - MDM Data QualityInformatica World 2006 - MDM Data Quality
Informatica World 2006 - MDM Data QualityDatabase Architechs
 
Introduction to RAGLD
Introduction to RAGLDIntroduction to RAGLD
Introduction to RAGLDragld
 
Scaling MySQL: Catch 22 of Read Write Splitting
Scaling MySQL: Catch 22 of Read Write SplittingScaling MySQL: Catch 22 of Read Write Splitting
Scaling MySQL: Catch 22 of Read Write SplittingScaleBase
 
sones company presentation
sones company presentationsones company presentation
sones company presentationsones GmbH
 
Linked Data as a Service
Linked Data as a ServiceLinked Data as a Service
Linked Data as a ServicePeter Haase
 
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & TalendIntroducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & TalendCaserta
 
Transaction-based Capacity Planning for greater IT Reliability™ webinar
Transaction-based Capacity Planning for greater IT Reliability™ webinar Transaction-based Capacity Planning for greater IT Reliability™ webinar
Transaction-based Capacity Planning for greater IT Reliability™ webinar Metron
 
Getting Cloud Architecture Right the First Time Ver 2
Getting Cloud Architecture Right the First Time Ver 2Getting Cloud Architecture Right the First Time Ver 2
Getting Cloud Architecture Right the First Time Ver 2David Linthicum
 
ScaleBase Webinar: Methods and Challenges to Scale Out a MySQL Database
ScaleBase Webinar: Methods and Challenges to Scale Out a MySQL DatabaseScaleBase Webinar: Methods and Challenges to Scale Out a MySQL Database
ScaleBase Webinar: Methods and Challenges to Scale Out a MySQL DatabaseScaleBase
 
The Microsoft BigData Story
The Microsoft BigData StoryThe Microsoft BigData Story
The Microsoft BigData StoryLynn Langit
 
Session7part1
Session7part1Session7part1
Session7part1abiraaman
 
Software architecture & design patterns for MS CRM Developers
Software architecture & design patterns for MS CRM  Developers Software architecture & design patterns for MS CRM  Developers
Software architecture & design patterns for MS CRM Developers sebedatalabs
 
Kuali update v4 - mw
Kuali update   v4 - mwKuali update   v4 - mw
Kuali update v4 - mwsarnoa
 
Accel Partners New Data Workshop 7-14-10
Accel Partners New Data Workshop 7-14-10Accel Partners New Data Workshop 7-14-10
Accel Partners New Data Workshop 7-14-10keirdo1
 
Anexinet Big Data Solutions
Anexinet Big Data SolutionsAnexinet Big Data Solutions
Anexinet Big Data SolutionsMark Kromer
 
Big Data For Investment Research Management
Big Data For Investment Research ManagementBig Data For Investment Research Management
Big Data For Investment Research ManagementIDT Partners
 
Dedup with hadoop
Dedup with hadoopDedup with hadoop
Dedup with hadoopNeeta Pande
 
StreamCentral Technical Overview
StreamCentral Technical OverviewStreamCentral Technical Overview
StreamCentral Technical OverviewRaheel Retiwalla
 

Ähnlich wie Vodafone xone fev142013v3 ext (20)

Informatica World 2006 - MDM Data Quality
Informatica World 2006 - MDM Data QualityInformatica World 2006 - MDM Data Quality
Informatica World 2006 - MDM Data Quality
 
Kurukshetra - Big Data
Kurukshetra - Big DataKurukshetra - Big Data
Kurukshetra - Big Data
 
Introduction to RAGLD
Introduction to RAGLDIntroduction to RAGLD
Introduction to RAGLD
 
Oracle BI Server By AORTA
Oracle BI Server By AORTAOracle BI Server By AORTA
Oracle BI Server By AORTA
 
Scaling MySQL: Catch 22 of Read Write Splitting
Scaling MySQL: Catch 22 of Read Write SplittingScaling MySQL: Catch 22 of Read Write Splitting
Scaling MySQL: Catch 22 of Read Write Splitting
 
sones company presentation
sones company presentationsones company presentation
sones company presentation
 
Linked Data as a Service
Linked Data as a ServiceLinked Data as a Service
Linked Data as a Service
 
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & TalendIntroducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
 
Transaction-based Capacity Planning for greater IT Reliability™ webinar
Transaction-based Capacity Planning for greater IT Reliability™ webinar Transaction-based Capacity Planning for greater IT Reliability™ webinar
Transaction-based Capacity Planning for greater IT Reliability™ webinar
 
Getting Cloud Architecture Right the First Time Ver 2
Getting Cloud Architecture Right the First Time Ver 2Getting Cloud Architecture Right the First Time Ver 2
Getting Cloud Architecture Right the First Time Ver 2
 
ScaleBase Webinar: Methods and Challenges to Scale Out a MySQL Database
ScaleBase Webinar: Methods and Challenges to Scale Out a MySQL DatabaseScaleBase Webinar: Methods and Challenges to Scale Out a MySQL Database
ScaleBase Webinar: Methods and Challenges to Scale Out a MySQL Database
 
The Microsoft BigData Story
The Microsoft BigData StoryThe Microsoft BigData Story
The Microsoft BigData Story
 
Session7part1
Session7part1Session7part1
Session7part1
 
Software architecture & design patterns for MS CRM Developers
Software architecture & design patterns for MS CRM  Developers Software architecture & design patterns for MS CRM  Developers
Software architecture & design patterns for MS CRM Developers
 
Kuali update v4 - mw
Kuali update   v4 - mwKuali update   v4 - mw
Kuali update v4 - mw
 
Accel Partners New Data Workshop 7-14-10
Accel Partners New Data Workshop 7-14-10Accel Partners New Data Workshop 7-14-10
Accel Partners New Data Workshop 7-14-10
 
Anexinet Big Data Solutions
Anexinet Big Data SolutionsAnexinet Big Data Solutions
Anexinet Big Data Solutions
 
Big Data For Investment Research Management
Big Data For Investment Research ManagementBig Data For Investment Research Management
Big Data For Investment Research Management
 
Dedup with hadoop
Dedup with hadoopDedup with hadoop
Dedup with hadoop
 
StreamCentral Technical Overview
StreamCentral Technical OverviewStreamCentral Technical Overview
StreamCentral Technical Overview
 

Mehr von InfiniteGraph

Making Sense of Graph Databases
Making Sense of Graph DatabasesMaking Sense of Graph Databases
Making Sense of Graph DatabasesInfiniteGraph
 
Webinar 3/12/14: Using Social Media to Drive Value
Webinar 3/12/14: Using Social Media to Drive ValueWebinar 3/12/14: Using Social Media to Drive Value
Webinar 3/12/14: Using Social Media to Drive ValueInfiniteGraph
 
NoSQL Simplified: Schema vs. Schema-less
NoSQL Simplified: Schema vs. Schema-lessNoSQL Simplified: Schema vs. Schema-less
NoSQL Simplified: Schema vs. Schema-lessInfiniteGraph
 
The Value of Explicit Schema for Graph Use Cases
The Value of Explicit Schema for Graph Use CasesThe Value of Explicit Schema for Graph Use Cases
The Value of Explicit Schema for Graph Use CasesInfiniteGraph
 
Solution Use Case Demo: The Power of Relationships in Your Big Data
Solution Use Case Demo: The Power of Relationships in Your Big DataSolution Use Case Demo: The Power of Relationships in Your Big Data
Solution Use Case Demo: The Power of Relationships in Your Big DataInfiniteGraph
 
PowerOfRelationshipsInBigData_SVNoSQL
PowerOfRelationshipsInBigData_SVNoSQLPowerOfRelationshipsInBigData_SVNoSQL
PowerOfRelationshipsInBigData_SVNoSQLInfiniteGraph
 
Objectivity/DB: A Multipurpose NoSQL Database
Objectivity/DB: A Multipurpose NoSQL DatabaseObjectivity/DB: A Multipurpose NoSQL Database
Objectivity/DB: A Multipurpose NoSQL DatabaseInfiniteGraph
 
Making sense of the Graph Revolution
Making sense of the Graph RevolutionMaking sense of the Graph Revolution
Making sense of the Graph RevolutionInfiniteGraph
 
An Introduction to Graph Databases
An Introduction to Graph DatabasesAn Introduction to Graph Databases
An Introduction to Graph DatabasesInfiniteGraph
 
Using A Distributed Graph Database To Make Sense Of Disparate Data Stores
Using A Distributed Graph Database To Make Sense Of Disparate Data StoresUsing A Distributed Graph Database To Make Sense Of Disparate Data Stores
Using A Distributed Graph Database To Make Sense Of Disparate Data StoresInfiniteGraph
 
Turning Big Data into Smart Data with Graph Technologies
Turning Big Data into Smart Data with Graph TechnologiesTurning Big Data into Smart Data with Graph Technologies
Turning Big Data into Smart Data with Graph TechnologiesInfiniteGraph
 
NoSQL Technology and Real-time, Accurate Predictive Analytics
NoSQL Technology and Real-time, Accurate Predictive AnalyticsNoSQL Technology and Real-time, Accurate Predictive Analytics
NoSQL Technology and Real-time, Accurate Predictive AnalyticsInfiniteGraph
 
How we Learned to Stop Worrying and Solve the Distributed Graph Problem
How we Learned to Stop Worrying and Solve the Distributed Graph ProblemHow we Learned to Stop Worrying and Solve the Distributed Graph Problem
How we Learned to Stop Worrying and Solve the Distributed Graph ProblemInfiniteGraph
 
Everything Goes Better With Bacon: Revisiting the Six Degrees Problem with a ...
Everything Goes Better With Bacon: Revisiting the Six Degrees Problem with a ...Everything Goes Better With Bacon: Revisiting the Six Degrees Problem with a ...
Everything Goes Better With Bacon: Revisiting the Six Degrees Problem with a ...InfiniteGraph
 
Dbta Webinar Realize Value of Big Data with graph 011713
Dbta Webinar Realize Value of Big Data with graph  011713Dbta Webinar Realize Value of Big Data with graph  011713
Dbta Webinar Realize Value of Big Data with graph 011713InfiniteGraph
 
Oracle no sql overview brief
Oracle no sql overview briefOracle no sql overview brief
Oracle no sql overview briefInfiniteGraph
 
Infinite graph nosql meetup dec 2012
Infinite graph nosql meetup dec 2012Infinite graph nosql meetup dec 2012
Infinite graph nosql meetup dec 2012InfiniteGraph
 
Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology
Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph TechnologyOracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology
Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph TechnologyInfiniteGraph
 
Silicon valley nosql meetup april 2012
Silicon valley nosql meetup  april 2012Silicon valley nosql meetup  april 2012
Silicon valley nosql meetup april 2012InfiniteGraph
 
NOSQL Now! Presentation, August 24, 2011: Graph Databases: Connecting the Dot...
NOSQL Now! Presentation, August 24, 2011: Graph Databases: Connecting the Dot...NOSQL Now! Presentation, August 24, 2011: Graph Databases: Connecting the Dot...
NOSQL Now! Presentation, August 24, 2011: Graph Databases: Connecting the Dot...InfiniteGraph
 

Mehr von InfiniteGraph (20)

Making Sense of Graph Databases
Making Sense of Graph DatabasesMaking Sense of Graph Databases
Making Sense of Graph Databases
 
Webinar 3/12/14: Using Social Media to Drive Value
Webinar 3/12/14: Using Social Media to Drive ValueWebinar 3/12/14: Using Social Media to Drive Value
Webinar 3/12/14: Using Social Media to Drive Value
 
NoSQL Simplified: Schema vs. Schema-less
NoSQL Simplified: Schema vs. Schema-lessNoSQL Simplified: Schema vs. Schema-less
NoSQL Simplified: Schema vs. Schema-less
 
The Value of Explicit Schema for Graph Use Cases
The Value of Explicit Schema for Graph Use CasesThe Value of Explicit Schema for Graph Use Cases
The Value of Explicit Schema for Graph Use Cases
 
Solution Use Case Demo: The Power of Relationships in Your Big Data
Solution Use Case Demo: The Power of Relationships in Your Big DataSolution Use Case Demo: The Power of Relationships in Your Big Data
Solution Use Case Demo: The Power of Relationships in Your Big Data
 
PowerOfRelationshipsInBigData_SVNoSQL
PowerOfRelationshipsInBigData_SVNoSQLPowerOfRelationshipsInBigData_SVNoSQL
PowerOfRelationshipsInBigData_SVNoSQL
 
Objectivity/DB: A Multipurpose NoSQL Database
Objectivity/DB: A Multipurpose NoSQL DatabaseObjectivity/DB: A Multipurpose NoSQL Database
Objectivity/DB: A Multipurpose NoSQL Database
 
Making sense of the Graph Revolution
Making sense of the Graph RevolutionMaking sense of the Graph Revolution
Making sense of the Graph Revolution
 
An Introduction to Graph Databases
An Introduction to Graph DatabasesAn Introduction to Graph Databases
An Introduction to Graph Databases
 
Using A Distributed Graph Database To Make Sense Of Disparate Data Stores
Using A Distributed Graph Database To Make Sense Of Disparate Data StoresUsing A Distributed Graph Database To Make Sense Of Disparate Data Stores
Using A Distributed Graph Database To Make Sense Of Disparate Data Stores
 
Turning Big Data into Smart Data with Graph Technologies
Turning Big Data into Smart Data with Graph TechnologiesTurning Big Data into Smart Data with Graph Technologies
Turning Big Data into Smart Data with Graph Technologies
 
NoSQL Technology and Real-time, Accurate Predictive Analytics
NoSQL Technology and Real-time, Accurate Predictive AnalyticsNoSQL Technology and Real-time, Accurate Predictive Analytics
NoSQL Technology and Real-time, Accurate Predictive Analytics
 
How we Learned to Stop Worrying and Solve the Distributed Graph Problem
How we Learned to Stop Worrying and Solve the Distributed Graph ProblemHow we Learned to Stop Worrying and Solve the Distributed Graph Problem
How we Learned to Stop Worrying and Solve the Distributed Graph Problem
 
Everything Goes Better With Bacon: Revisiting the Six Degrees Problem with a ...
Everything Goes Better With Bacon: Revisiting the Six Degrees Problem with a ...Everything Goes Better With Bacon: Revisiting the Six Degrees Problem with a ...
Everything Goes Better With Bacon: Revisiting the Six Degrees Problem with a ...
 
Dbta Webinar Realize Value of Big Data with graph 011713
Dbta Webinar Realize Value of Big Data with graph  011713Dbta Webinar Realize Value of Big Data with graph  011713
Dbta Webinar Realize Value of Big Data with graph 011713
 
Oracle no sql overview brief
Oracle no sql overview briefOracle no sql overview brief
Oracle no sql overview brief
 
Infinite graph nosql meetup dec 2012
Infinite graph nosql meetup dec 2012Infinite graph nosql meetup dec 2012
Infinite graph nosql meetup dec 2012
 
Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology
Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph TechnologyOracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology
Oracle NoSQL DB & InfiniteGraph - Trends in Big Data and Graph Technology
 
Silicon valley nosql meetup april 2012
Silicon valley nosql meetup  april 2012Silicon valley nosql meetup  april 2012
Silicon valley nosql meetup april 2012
 
NOSQL Now! Presentation, August 24, 2011: Graph Databases: Connecting the Dot...
NOSQL Now! Presentation, August 24, 2011: Graph Databases: Connecting the Dot...NOSQL Now! Presentation, August 24, 2011: Graph Databases: Connecting the Dot...
NOSQL Now! Presentation, August 24, 2011: Graph Databases: Connecting the Dot...
 

Vodafone xone fev142013v3 ext

  • 1. Big Data and Security Michel Burger
  • 2. 0.05 ounces/ton Gold mining is about dirt management
  • 3. About 11850 Amps to generate around 8.4 Tesla fields (about 150000 times the earth magnetic field) but they operate at low Voltage A lot of what LHC is about is electricity flow management
  • 4. How BIG? BIG data is like the LHC combined with gold extraction - Huge amount of data -> 6.6 Zettabytes/year by 2016 (Cisco Cloud Index) - Big flow of data -> 400TB/day (Facebook) - LHC generates 10-15 Petabytes/year of data for each experiment
  • 5. The essence of new service providers BI Based Revenue Models (eg Advertisement) User Core Semantic Improves Consumes experience Data Set Mindmap Revenue from Value enriched Data existing services generates revenue Data Service will shrink Service Produces Service Additional revenue from new services The more context the more efficient and One data set Many free services the more value and common semantic Example: Search/Information Management : Rated auction/Selling:
  • 6. Classic Approach • Structured Data • Data in the range of Gigabytes to Terabytes • Centralized (Data is imported in analytics) • Batch based • Data silos ETL ETL ETL Transaction Relational Data Analyse Database Warehouse Where is the data that answer my questions ?
  • 7. Big Data Approach • Multi Structured Data • Data in the range of Terabytes to Petabytes • Distributed/Federated (Analytics grab the data) • Streaming based • Holistic Data Clusters 1 Stream 2 Organize Analyse 3 n Here are the questions and the data for the answers
  • 8. A new pattern • Many different data structures • Many different ways to extract the data Knowledge • Structured • Many different locations (even for the References API Services Content Sources Applications Social Networks Buffering same type of data) • Proprietary • RAN Graph • Batch and Realtime based Data card • Data as a Service Neural Network • Buffered or stream Sim Card Premise Network Core • Connected Things Connected (Consumer, Enterprise) Gateway Relational • Correlation parameters • Unstructured Devices IT Infrastructure Consumption Buffering Report Statistics • Streaming • Taping at Source Real-time Cheap Storage High Efficient Storage Low level Semantic • Buffering, Routing, Filtering • Taping on Stream • Structured/Unstructured • Consumption to Stream Graph Network/ store Source Analysis • Event Collector • Batch Process/Multi Non Real-time Rich Semantic Structure Stream • Multi Stage Store/Process Neura l Network/ Analysis
  • 9. With added security Knowledge References API Services Content Sources Social Networks Applications • Strong access RAN control based Data as a Service Data card Sim Card Connected Things (Consumer, Enterprise) Premise Gateway Network Core on industry Connected Devices IT Infrastructure standard Consumption (user, dev, app lication) Report Statistics • Securing the infrastructure (public, private) • Strong • Policy (internal/external) authorization • On-going assessment (DDOS, Penetration …) control based • Data leakage • on open Stream Migration Graph standard Network/ • Securing the identity Analysis • Validating ID • Analytics • Anonymization applied to • Securing the access Analytics • Distributed permission/preference • 3rd party permission Neura l Network/ Analysis
  • 10. Final thoughts 1. We need to eliminate the silos – Sources or Usage 2. Still very much a collection of technologies – The assembly is still very complex 3. Is everything about events? 4. We need to handle the CAP theorem more appropriately 5. What is the user experience (not just the end user but also the admin)