SlideShare ist ein Scribd-Unternehmen logo
1 von 44
Downloaden Sie, um offline zu lesen
Smarter Computing - Big Data
11 June 2012

Dipl.Ing.Wolfgang Nimführ
Information Agenda Executive Consultant
Big Data Tiger Team
IBM Software Group Europe
wolfgang.nimfuehr@at.ibm.com




                                          © 2012 IBM Corporation
Legal Disclaimer
    © IBM Corporation 2012. All Rights Reserved.

    The information contained in this publication is provided for informational purposes only. While efforts were made to verify
       the completeness and accuracy of the information contained in this publication, it is provided AS IS without warranty
       of any kind, express or implied. In addition, this information is based on IBM’s current product plans and strategy,
       which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising out of the
       use of, or otherwise related to, this publication or any other materials. Nothing contained in this publication is intended
       to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or
       altering the terms and conditions of the applicable license agreement governing the use of IBM software.

    References in this presentation to IBM products, programs, or services do not imply that they will be available in all
       countries in which IBM operates. Product release dates and/or capabilities referenced in this presentation may
       change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be
       a commitment to future product or feature availability in any way. Nothing contained in these materials is intended to,
       nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales,
       revenue growth or other results.

    Information regarding potential future products is intended to outline our general product direction and it should not b e
        relied on in making a purchasing decision. The information mentioned regarding potential future products is not a
        commitment, promise, or legal ob ligation to deliver any material, code or functionality. Information about potential
        future products may not b e incorporated into any contract. The development, release, and timing of any future
        features or functionality described for our products remains at our sole discretion.




2                                                                                                                   © 2012 IBM Corporation
Welcome to the Instrumented Interconnected World!




     INSTRUMENTED


     INTERCONNECTED


     INTELLIGENT




                   Build a Smarter Planet

 3                                                  © 2012 IBM Corporation
Why Big Data

Searches for "big data" on Gartner's website            “most enterprise data warehouse (EDW) and BI
have increased 981% between March 2011 -                teams currently lack a clear understanding of big
October 2011                                            data technologies… They are increasingly asking
                                                        the question, "How can we use big data to
                                                        deliver new insights?"
                                                        Gartner 2012

    “Big Data: The next frontier for
    innovation, competition and
    productivity”
    McKinsey Global Institute                                   2012 will be the year of 'big data' BBC
                                                                Nov 30 2011
                                                                Big Data will be the CIO Issue of 2012
                                                                IDC Prediction 2012 report




       Big Data - We are at a huge inflection point and this opportunity comes only once.
       We are declaring that IBM is the #1 leader in providing a Big Data platform.
       Alyse Passarelli, WW VP IM Sales                                    Jan 10th 2012

4                                                                                              © 2012 IBM Corporation
The Information Explosion in Data and Real World Events

     44x
     as much Data and Content
                                2020
                                35 zettabytes
                                                                    Business leaders frequently
     Over Coming Decade                                1 in3        make decisions based on
                                                                    information they don’t trust, or
                                                                    don’t ha ve

         2009
         800,000 petabytes

                                                       1 in2        Business leaders say they don’t
                                                                    have access to the information
                                                                    they need to do their jobs


                                      80%                           of CIOs cited “Business
                                     Of world’s data
                                     is unstructured
                                                        83%         intelligence and analytics” as
                                                                    part of their visionary plans
                                                                    to enhance competitiveness


                                                                   of CEOs need to do a better job

                                                        60%        capturing and understanding
                                                                   information rapidly in order to
                                                                   make swift business decisions


                                                       Organizations Need Deeper Insights

5
     5                                                                               © 2012 IBM Corporation
The resulting explosion of information creates a need for a
new kind of intelligence

     The percentage of available data an enterprise can analyze
     is decreasing proportionately to the available to it

     Quite simply, this means as enterprises, we are getting
                                                                  Missing Insights and
     “more naive” about our business over time                         Analytics

     We don’t know what we could already know….



                  Data AVAILABLE to an organization
                                                                                  The
                                                                                  Blind
                                                                                  Spot



                         Data an organization can PROCESS
 6                                                                            © 2012 IBM Corporation
Challenge
Study a Large Volume and Variety of Data to Find New Insights

                                                 Multi-channel customer
                                                 sentiment and experience a
                                                 analysis


                                                 Support medical diagnostics
                                                 Detect life-threatening
                                                 conditions


                                                 Predict weather patterns to plan
                                                 optimal wind turbine usage, and
                                                 optimize capital expenditure on
                                                 asset placement

                                                 Make risk decisions and frauds
                                                 detection based on real-time
                                                 transactional data


                                                 Identify criminals and threats
                                                 from disparate video, audio,
                                                 and data feeds
 7                                                                 © 2012 IBM Corporation
Leveraging Big Data Analytics
How do you address the challenges presented by empowered market
participants generating mountains of data?




        Can you capture data                                      Can you do it in real-                  Can you turn that data
        generated by these                                        time?                                   into insights to predict
        interactions?                                                                                     customer / competitive /
 Sourc e:                                                                                                 market behavior?
 1 – Barrera, Clod and Wojtowecz. “Cloud Leads Five Storage Trends for 2011.” CIO. J anuar y 27, 2011 .
 2 – http://www.i nternetworlds tats .com/stats.htm.
 3 – http://www.abires earch.com/pr ess/3584-More+than+Seven+Trillion+SMS+Messages+Will+Be+Sent+in+2011


  8                                                                                                                      © 2012 IBM Corporation
How does Big Data Analytics impact business?
Deploying these competencies extensively correlates to long-term
financial performance




                                                                                            Listen and Anticipate consistently deployed across the
                                                                                            enterprise correlate to higher compound annual growth
                                                                                            rates (5-year CAGR, 2005-2010)


     Source: Outperforming in a Data Rich, H yper Connected W orld, an IB M Center for Applied In sights r esear ch r eport. Copyright © IBM 2012

 9                                                                                                                                                  © 2012 IBM Corporation
Leveraging Big Data Analytics can improve Experience



                  …            Client Mgr   Data Scientist   Dashboards   Call Center        …




Information Management Capabilities                            Natural
                                                              Language

                    External Data                                                       Internal Data
      •   Web Logs                                                         • Relationship / risk   • Event triggers
      •   Twitter feeds                                                      data                  • Customer Profitability
      •   Facebook chats                                                   • Product                 analysis
      •   YouTube Video                                                      profitability data    • Complaint Data
      •   Blogs/Posting                                      Big Data      • Email                 • Voice to Te xt Data
      •   Appraisal data                                     Analytics       correspondents        • Transactional data
                                                                           • Company website       • Policy & Procedure
      •   Credit bureau data                                   Hub
                                                                             logs                    data




 10                                                                                                       © 2012 IBM Corporation
On 16 Feb 2011 the IBM Watson system won Jeopardy!




    Can we design a computing system that rivals a human’s ability to answer
   questions posed in natural language, interpreting meaning and context and
retrieving, analyzing and understanding vast amounts of information in real-time?
 11                                                                   © 2012 IBM Corporation
IBM Watson‘s project started 2007

• Project started in 2007, lead David Ferrucci

• Initial goal: create a system able to process
  natural language & extract knowledge faster
  than any other computer or human

• Jeopardy! was chosen because it’s a huge            “IBM is not in the entertainment
  challenge for a computer to find the questions      business. But we are in the business of
  to such “human” answers under time pressure         technology and pushing frontiers.”
                                                      David Shepler, IBM Research Program Manager
• Watson was NOT online!

• Watson weighs the probability of his answer
  being right – doesn’t ring the buzzer if he’s not
  confident enough

• Which questions Watson got wrong almost as
  interesting as which he got right!

 12                                                                                 © 2012 IBM Corporation
Different Types of Evidence: Keyword Evidence

              In May 1898 Portugal celebrated                         In May, Gary arrived in
              the 400th anniversary of this                           India after he celebrated his
              explorer’s arrival in India.                            anniversary in Portugal.

                                                                                arrived in

                              celebrated           Keyword Matching
                                                   Keyword Matching                             celebrated



                    In May                         Keyword Matching
                                                   Keyword Matching        In May
                     1898
Evidence
                         400th                     Keyword Matching                             anniversary
suggests “Gary”        anniversary
                                                   Keyword Matching

is the answer
BUT the system                          Portugal   Keyword Matching
                                                   Keyword Matching                              in Portugal
must learn that
keyword                  arrival in

matching may
be weak relative              India                Keyword Matching
                                                   Keyword Matching                          India
to other types of
evidence
                             explorer                                               Gary
 13                                                                                                  © 2012 IBM Corporation
Different Types of Evidence: Deeper Evidence
      In May 1898 Portugal celebrated                                         On 27th May 1498, Vasco da Gama
                                                                             On 27th May 1498, Vasco da Gama
                                                                           On 27th May 1498, Vasco da Gama
      the 400th anniversary of this                                       On landedin Kappad Beach Vasco da
                                                                             landed in of May Beach
                                                                               the in th Kappad 1498,
                                                                           landed 27Kappad Beach
      explorer’s arrival in India.                                        Gama landed in Kappad Beach

                                              Search Far and Wide

                                              Explore many hypotheses
                  celebrated
                                              Find Judge Evidence
                                                                                          landed in
                                   Portugal   Many inference algorithms

                                                  Temporal
       May 1898      400th anniversary                                                                27th May 1498
                                                  Reasoning
                                                                               Date
                                                                               Math

                         arrival                  Statistical
Stronger                 in                      Paraphrasing
                                                                              Para-
evidence can                                                                 phras es
                                                  GeoSpatial
be much                  India
                                                  Reasoning
                                                                                        Kappad Beach

harder to find                                                              Geo-KB

and score.              explorer                                                             Vasco da Gama



 14                                  The evidence is still not 100% certain.                             © 2012 IBM Corporation
DeepQA:
Massively Parallel Probabilistic Evidence-Based Architecture




Question                                                           1000’s of       100,000’s scores from many simultaneous
                                        100s Possible         Pieces of Evidence
                         100s sources                                                      Text Analysis Algorithms
                                          Answers
           Multiple
       Interpretations

Question &                                                                                                    Final Confidence
                    Question            Hypothesis               Hypothesis and
  Topic                                                                                     Synthesis            Merging &
                  Decomposition         Generation              Evidence Scoring
 Analysis                                                                                                         Ranking

                                  Hypothesis            Hypothesis and Evidence
                                  Generation                   Scoring
                                                                                                                 Answer &
                                                                                                                Confidence
                                                  ...




 15                                                                                                            © 2012 IBM Corporation
Maximum Benefit Requires Combining Deep and
Reactive Analytics
                                            Hypotheses             Predictions                                           Real time Optimization
                                                                                                                         100,000 updates/sec,
                                                                                                                         5 ms/decision
               Exa                                                                                                       Round-trip automation
   Deep                                             Deep                                                                 10 PB f or Deep Analytics

Analytics

               Peta                                                       History
                                                                                                                         Predictive Analytics
                                                                                                                         100,000 records/sec, 6B/day
                                                                                                                         10 ms/decision
                                                                                                                         6 PB f or Deep Analytics
                                                                                        Feedback
  Data Scale




               Tera
                                            nio




                                                                In
                                                                                                                          Smart Traffic
                                        ra t




                                                                   te
                                                                                                                          250K GPS probes/sec
                                                                      g
                                                                                          Reality      Actions
                                        g




                                                                    ra
                                    Inte




                                                                                                                          630K segments/sec
                                                                      tio
                                                                          n

               Giga                                                                                                       2 ms/decision, 4K vehicles



                                                                                                                         DeepQA
                                                                                                Fast
                           Traditional Data                                                                              100s GB for Deep Analytics
               Mega
                           Warehouse and                                                                                 3 sec/decision
                                                                                                                         1 PB training corpus
                           Business                          Integration
                           Intelligence                                                                   Observations
               Kilo                                                                                  Reactive
                      yr     mo    wk             day   hr      min           sec   …   ms      µs   Analytics
                           Occasional                   Frequent                    Real-time
    16                                            Decision Frequency                                                           © 2012 IBM Corporation
Traditional Approach vs Big Data Approach
               Traditional Approach             Big Data Approach
        Structured & Repeatable Analysis   Iterative & Exploratory Analysis

                                                          IT
       Business Users
                                                          Delivers a platform to
       Determine what                                     enable creative
       question to ask                                    discovery




       IT                                                Business
       Structures the                                    Explores what
       data to answer                                    questions could be
       that question                                     asked

      Monthly sales reports                               Brand sentiment
      Profitability analysis                              Product strategy
      Customer surveys                                    Ma ximum asset utilization



 17                                                                     © 2012 IBM Corporation
Big Data use cases across all industries

             Financial Services            Utilities
               Fraud detection              Weather impact analysis on
               Risk management              power generation
               360° View of the Customer    Transmission monitoring
                                            Smart grid management


 Transportation                                        IT
      Weather and traffic                                Transition log analysis
      impact on logistics and                            for multiple
      fuel consumption                                   transactional systems
                                                         Cybersecurity

 Health & Life Sciences
      Epidemic early warning                           Retail
      system                                            360° View of the Customer
      ICU monitoring                                    Click-stream analysis
      Remote healthcare monitoring                      Real-time promotions



                Telecommunications         Law Enforcement
                  CDR processing            Real-time multimodal surveillance
                  Churn prediction          Situational awareness
                  Geomapping / marketing    Cyber security detection
                  Network monitoring



 18                                                                 © 2012 IBM Corporation
Monetizing Relationships - not just Transactions

      Calling Network
                                                                   Merged Network




                                                      company
                                                        Telco
                                     Amy Bearn

                          32, Married, mother of 3,             How v aluable is Amy to my mobile
                                                                phone network? How likely is she to
                          Accountant                            switch carriers? How many other
                             Telco Score: 91                    customers will f ollow
                             CPG Score: 76
                             Fashion Score: 88




                                                       Retail
                                                       Telco
                                                                How v aluable is Amy to my retail
                                                                sales? Who does she influence?
      Social Network            Public                          What do they spend?
                               Database
 19                                                                              © 2012 IBM Corporation
°
Sample: Big Data 360°Lead Generation
Personal Attributes
  Personal Attributes
• Identifiers: name, address, age, gender,
  • Identifiers: name, address, age, gender,
occupation…
  occupation…
                                                                                             Timely Insights
                                                                                               Timely Insights
• Interests: sports, pets, cuisine…                                                          • Intent to buy various products
  • Interests: sports, pets, cuisine…                                                          • Intent to buy various products
• Life Cycle Status: marital, parental                                                       • Current Location
  • Life Cycle Status: marital, parental                                                       • Current Location
                                                            Social Media based               • Sentiment on products, services, campaigns
                                                                                               • Sentiment on products, services, campaigns
                                                               360-degree                    • Incidents damaging reputation
                                                                                               • Incidents damaging reputation
                                                            Consumer Profiles                • Customer satisfaction/attrition
                                                                                               • Customer satisfaction/attrition
Life Events
  Life Events
• Life-changing events: relocation, having a
 • Life-changing events: relocation, having a
baby, getting married, getting divorced, buying
 baby, getting married, getting divorced, buying
a house…
 a house…
                                                                                            Products Interests
                                                                                              Products Interests
                                                                                            • Personal preferences of products
                                                                                              • Personal preferences of products
                                                                                            • Product Purchase history
                                                                                              • Product Purchase history
Relationships
  Relationships                                                                             • Suggestions on products & services
                                                                                              • Suggestions on products & services
• Personal relationships: family, friends and
  • Personal relationships: family, friends and
roommates…
  roommates…
• Business relationships: co-workers and
  • Business relationships: co-workers and
work/interest network…
  work/interest network…


Monetizable intent to buy products                                     Life Events
 I need a new digital camera for my food pictures, any                  College: Off to Stanford for my MBA! Bbye chicago!
   I need a new digital camera for my food pictures, any                 College: Off to Stanford for my MBA! Bbye chicago!
 recommendations around 300?
   recommendations around 300?
                                                                        Looks like we'll be moving to New Orleans sooner than I thought.
 What should I buy?? A mini laptop with Windows 7 OR a Apple             Looks like we'll be moving to New Orleans sooner than I thought.
  What should I buy?? A mini laptop with Windows 7 OR a Apple
 MacBook!??!
  MacBook!??!
                                                                       Intent to buy a house
 Location announcements                                                 I'm thinking about buying a home in Buckingham Estates per a
                                                                          I'm thinking about buying a home in Buckingham Estates per a
 I'm at Starbucks Parque Tezontle http://4sq.com/fYReSj                 recommendation. Anyone have advice on that area? #atx #austinrealestate
   20 at Starbucks Parque Tezontle http://4sq.com/fYReSj
   I'm                                                                    recommendation. Anyone have advice on that area? #atx #austinrealestate
                                                                                                                              © 2012 IBM Corporation
                                                                        #austin
                                                                          #austin
°
Sample: Big Data 360°Lead Generation




                                                                            Real-time product
                                                                             Real-time product
                                                                         intents enriched with
                                                                           intents enriched with
                                                                          consumer attributes
                                                                            consumer attributes


                                                        Entries contain promotional messages,
                                                         Entries contain promotional messages,
                                                            wishful thinking, questions, etc
                                                             wishful thinking, questions, etc
                                        Integration across Social Media sites
                                         Integration across Social Media sites
Micro-segmentation of
 Micro-segmentation of
  product intents by
   product intents by                                                   Real-time tracking by
     occupation                                                          Real-time tracking by
      occupation                                                        micro-segmentation
                                                                         micro-segmentation


                            For many of the attributes we need to extract,
                             For many of the attributes we need to extract,
                                 cleanse, normalize and categorize
                                  cleanse, normalize and categorize

                                                                     Micro-segmentation of
                                                                      Micro-segmentation of
                                                                     consumers by hobbies
                                                                      consumers by hobbies



  21                                                                          © 2012 IBM Corporation
Sample: Institutional Risk Application
Comprehensive view of publicly traded companies and related
people based on regulatory filings




           Extract

          Integrate



22                                                        © 2012 IBM Corporation
Requirements for a Big Data Solution Platform

                                 Analyze a Variety of Information
                                 Novel analytics on a broad set of mixed information that
                                 could not be analyzed before
                                 Multiple relational & non-relational data types and schemas


                                  Analyze Information in Motion
                                  Streaming data analysis
                                  Large volume data bursts & ad-hoc analysis



                                  Analyze Extreme Volumes of Information
                                  Cost-efficiently process and analyze petabytes of information
                                  Manage & analyze high volumes of structured, relational data



                                   Discover & Experiment
                                   Ad-hoc analytics, data discovery &
                                   experimentation



                                   Manage & Plan
                                   Enforce data structure, integrity and control to
                                   ensure consistency for repeatable queries
 23                                                                            © 2012 IBM Corporation
IBM Big Data Platform for Ingest, Data and Analytics


                                                               Analytic Applications
                                                   BI /    Exploration / Functional Industry Predictive Content
                                                 Reporting Visualization   App        App    Analytics Analytics
  New analytic applications drive the
  requirements for a big data platform
                                                             IBM Big Data Platform
      •   Integrate and manage the full
          variety, velocity and volume of data      Visualization         Application         Systems
                                                    & Discovery          Development         Management
      •   Apply advanced analytics to
          information in its native form
      •   Visualize all available data for ad-                             Accelerators
          hoc analysis
      •   Development environment for                  Hadoop              Stream               Data
          building new analytic applications           System             Computing           Warehouse

      •   Workload optimization and
          scheduling
      •   Security and Governance
                                                            Information Integration & Governance



 24                                                                                           © 2012 IBM Corporation
Big Data Hadoop Capabilities




 Big Data Challenges                             IBM Big Data Solutions

              • Very high volumes (TBs to PBs)
 NoSQL Data




                unstructured data                         IBM BigInsights
                                                          Hadoop-based processing for
              • Exploration and discovery                 analytics on variety and
              • Text, Entity and Social Media             volumes of data
                Analytics
              • Real time processing
                                                           IBM Streams
 Streaming




              • Detect failure patterns
              • High volume, low latency                   Low latency analytics for
                processing                                 streaming data
              • Scoring and decision analytics




 25                                                                             © 2012 IBM Corporation
High Level Conceptual View                                                     *)
                                                                                                          Real Time Scoring and Response                                      Streaming
  Sens ors                   Streaming Structured or Unstructured                                                                                                             • Smart Grid Analytics
                                                                                                                                                              Analytics and   • Distribution Grid
                                                                                                                                                               Reporting        Monitoring
                                                          Unstructured                                                       IBM                                              • Root Cause Failure
                                                                                                                           Streams                                              Analysis
                                                                                                                                                                              • Demand Response
Regulations                                                                                                                                                                     Effectiveness
                                    Exploration/Discovery Queryable Archive




                                                                                                                           Improv ed Analytics
                                                                                                                                                                              Web/social
   Social




                                                                                                                                                 Structured
                Unstructured                                                                                                                                                  • Sentiment analysis
                                                                                                                                                                              • Call Centre analysis
                                                  IBM                                                                                                                         • Log analysis
                                              BigInsights                                                                                                     Analytics and   • Outage Information
                                                                                                                                                               Reporting      • Micro customer




                                                                                    Improv ed Analytics
                                                                                                                                                                                segmentation




                                                                                                              Structured
                                                                                                                                                                              • Offering Management
Data Asset Landscape
Generation    Transmission     Distribution       Smart Meters
                                                                                                                                                                              Foundational
                                                                                                                                                                                  •   Meter Data Management
                                                                                                                                                                                  •   Customer Portals
  Trading      Supplier          Orders          Customer                                                                                                                         •   Smart Meter Analytics
                                                                                                                                                                                  •   Demand Forecasting
                                                                                                                                                                                  •   Generation Scheduling
                                                                 Operational                                                                                     Legacy           •   Customer Segmentation
                                                                  Systems                                  IBM                                                                    •   Campaign Management
                                                                                                                                                               Applcations
 Marketing    Maintenance      Employee             GIS                                                    power i                                                                •   Outage Management
                                                                                                                                                                                  •   Estimate Load Shedding
                                                                                                                                                                                  •   Time of Use Tariffs
                                                                                                                                                                                  •   Maintenance Scheduling

   26           *) Example for Industry Energy & Utility                                                                                                                                    © 2012 IBM Corporation
IBM InfoSphere BigInsights
Analytical platform for Big Data at-rest

  Based on open source & IBM                                      Analytic Applications
  technologies                                         BI /    Exploration / Functional Industry Predictiv e Content
                                                     Reporting Visualization    App       App    Analytics Analytics
  Distinguishing characteristics
      • Built-in analytics enhances business                     IBM Big Data Platform
        knowledge
                                                        Visualization        Application         Systems
      • Enterprise software integration                 & Discovery         Development         Management
        complements and extends existing
        capabilities
                                                                               Accelerators
      • Production-ready platform with tooling for
        analysts, developers, and administrators           Hadoop             Stream               Data
        speeds time-to-value and simplifies                System            Computing           Warehouse
        development/maintenance

  IBM advantage
      • Combination of software, hardware,
        services and advanced research                        Information Integration & Governance



 27                                                                                                © 2012 IBM Corporation
IBM InfoSphere BigInsights
Embrace and Extend Hadoop

 Analytics                 BigSheets                               Text Analytics        ML Analytics *)        Interface

                                                                                                                 Management Console
 Application                                                                                                       (browser based)
                                                      Pig                Hive              Jaql




                                                                                                         Avro
                             IBM LZO Compression
               Zookeeper



                                                                      MapReduce

                                                   AdaptiveMR             FLEX            BigIndex                Developing Tooling
                                                                                                                   (Eclipse Plug-Ins)
                                                               Oozie                      Lucene


                                                                                                                        Rest API
 Storage                                                                 HBase                                     (for Applications)
                                                            HDFS                    GPFS-SNC *)



 Data                      Streams                          Netezza        BoardReader             R                  IBM
 Sources/                                                                                                             Open Source
                   Data Stage                                DB2          CSV/XML/JSON            SPSS
 Connectors
                           Flume                             JDBC          Web Crawler                              *) future release




 28                                                                                                                       © 2012 IBM Corporation
BigSheets
A visual tool for data manipulation and prototyping

      • Ad-hoc analytics for LOB user

      • Analyze a variety of data - unstructured and structured

      • Spreadsheet metaphor for exploring/ visualizing data

      • Browser-based




 29                                                               © 2012 IBM Corporation
Text Analytics
Turns disparate words into measurable insights




           Physically                                  Identify positive or                             Reporting/Monitoring
        assemble data,          Part-of-speech         negative sentiment,           Iterative           social commentary,
          standardize       identification, standard       NLP-based           classification using   combination w /structured
       form ats, address       and custom ized           analytics, define        autom ated and           data, clustering,
         auto-identify      extraction dictionaries,    variables, m acros     m anual techniques.      associated concepts,
      language, process           proper noun               and rules.        Concept derivation &    correlated concepts, auto-
        punctuation and     identification, concept                            inclusion, semantic         classification of
       non-gramm atical         categorization,                                  networks and co-      documents, sites, posts.
          characters,       synonyms, exclusions,                                occurrence rules
          standardize         m ulti-terms, regular
            spelling.         expressions, fuzzy-
                                    m atching




           Pre-configured text annotators ready for distributed processing on Big Data
                           Support for native languages including double-byte
 30                                                                                                              © 2012 IBM Corporation
Text Analytics
Highly accurate analysis of textual content

                                                  Unstructured text (document, email, etc)
  How it works
                                               Football World Cup 2010, one team
      • Parses text and detects meaning with   distinguished themselves well, losing to
        annotators                             the eventual champions 1-0 in the Final.
                                               Early in the second half, Netherlands’
      • Understands the context in which the
                                               striker, Arjen Robben, had a breakaway,
        text is analyzed
                                               but the keeper for Spain, Iker Casillas
      • Hundreds of pre-built annotators for   made the save. Winger Andres Iniesta
        names, addresses, phone numbers,       scored for Spain for the win.
        along others

  Accuracy
      • Highly accurate in deriving meaning
        from complex text                             Classification and Insight
  Performance
      • AQL language optimized for
        MapReduce

 31                                                                                © 2012 IBM Corporation
ML Analytics
Statistical and Predictive Analysis
  Framework for machine learning (ML) implementations on Big Data
      • Large, sparse data sets, e.g. 5B non-zero values
      • Runs on large BigInsights clusters with 1000s of nodes
  Productivity
      • Build and enhance predictive models directly on Big Data
      • High-level language – Declarative Machine Learning Language (DML)
        • E.g. 1500 lines of Java code boils down to 15 lines of DML code
      • Parallel SPSS data mining algorithms implementable in DML
  Optimization
      • Compile algorithms into optimized parallel code
                                                                                               4500
      • For different clusters and different data characteristics                              4000

                                                                                               3500
      • E.g. 1 hr. execution (hand-coded) down to 10 mins




                                                                       E xecution Time (sec)
                                                                                               3000

                                                                                               2500

                                                                                               2000

                                                                                               1500

                                                                                               1000

                                                                                                500

                                                                                                  0
                                                                                                      0       500            1000            1500            2000

                                                                                                                     # non zeros (million)

                                                                                                          Java Map-Reduce     Sy stemML      Single node R
 32                                                                                                                             © 2012 IBM Corporation
Workload Optimization
Optimized performance for big data analytic workloads



Adaptive MapReduce                                        Hadoop System Scheduler
       Algorithm to optimize execution time of                   Identifies small and large jobs from prior
       multiple small jobs                                       experience

       Performance gains of 30% reduce                           Sequences work to reduce overhead
       overhead of task startup



Task                    Map                             Adaptive Map                      Reduce
                        (break task into small parts)   (optimization —                   (many results to a
                                                        order small units of work)        single result set)




 33                                                                                                 © 2012 IBM Corporation
Public wind data is available on 284km x 284
          km grids (2.5o LAT/LONG)

          More data means more accurate and richer
          models (adding hundreds of variables)

            -   Vestas wind library at 2.5 PB: to grow to over 6
                PB in the near-term
            -   Granularity 27km x 27km grids: driving to 9x9,
                3x3 to 10m x 10m simulations
          Reduced turbine placement identification
          from weeks to hours

          Perspective: The Vestas Wind library

     34
     34                                          © 2012 IBM Corporation
34
InfoSphere Streams
Analytical platform for Big Data in-motion

                                                                Analytic Applications
                                                     BI /    Exploration / Functional Industry Predictiv e Content
                                                   Reporting Visualization    App       App    Analytics Analytics
  Built to analyze data in motion
      • Multiple concurrent input streams                      IBM Big Data Platform
      • Massive scalability                           Visualization        Application         Systems
                                                      & Discovery         Development         Management


  Process and analyze a variety of                                           Accelerators
  data
      • Structured, unstructured content, video,         Hadoop             Stream               Data
        audio                                            System            Computing           Warehouse

      • Advanced analytic operators


                                                            Information Integration & Governance



 35                                                                                              © 2012 IBM Corporation
Stream Computing
Analyze Data in Motion


         Traditional Computing                            Stream Computing




 Historical fact finding                        Current fact finding

 Find and analyze information stored on disk    Analyze data in motion – before it is stored

 Batch paradigm, pull model                     Low latency paradigm, push model

 Query-driven: submits queries to static data   Data driven – bring the data to the query

                                                                                           Data Base



 36                                                                               © 2012 IBM Corporation
Streams approach illustrated
                               tuple




 37                                    © 2012 IBM Corporation
IBM InfoSphere Streams
Massively Scalable Stream Analytics
  Linear Scalability
                                                     Deployments
      Clustered deployments – unlimited              Source     Analytic    Sync
      scalability                                    Adapters   Operators   Adapters

  Automated Deployment
      Automatically optimize operator
      deployment across clusters                                    Streams Studio IDE

  Performance Optimization                                                               Automated and
                                                                                         Optimized
      JVM Sharing – minimize memory use                                                  Deployment
      Fuse operators on             Streaming Data   Streams Runtime
                                          Sources
      same cluster
      Telco client – 25 Million
                                                                                               Visualization
      messages per second
  Analytics on Streaming Data
      Analytic accelerators for a
      variety of data types
      Optimized for real-time performance
 38                                                                                      © 2012 IBM Corporation
Cisco turns to IBM big
           data for intelligent
             infrastructure
             management
     •    Optimize building energy
          consumption with centralized
          monitoring
     •    Automate preventive and
          corrective maintenance

     Capabilities Utilized:
         • Streaming Analytics
         • Hadoop System
         • Business Intelligence

     Applications:
           •   Log Analytics
           •   Energy Bill Forecasting
           •   Energy consumption optimization
           •   Detection of anomalous usage
           •   Presence-aware energy mgt.
           •   Policy enforcement
39                                  © 2012 IBM Corporation
University of Ontario Institute of Technology


      Use case
       – Neonatal infant monitoring
       – Predict infection in ICU 24 hours in advance
      Solutions
       – 120 children monitored :120K msg/sec, billion msg/day
       – Trials expanding to include hospitals in US and China


                                Event Pre-    Analysis
                                processer     Framework




              Sensor                Stream-based Distributed Interoperable     Solutions
             Network                      Health care Infrastructure         (Applications)



 40                                                                                  © 2012 IBM Corporation
Without a Big Data Platform You Code…
                                                        Over 100 sample applications and toolkits with industry focused
                                                                  toolkits with 300+ functions and operators


       Event           Custom SQL
      Handling             and
                         Scripts
                                       Multithreading


  Check           Application
 Pointing        M anagement                              Accelerators
                                                                         Streams provides development, deployment,
                                    HA                        and
                                                            Tool kits
                                                                              runtime, and infrastructure services



                        Performance          Debug
       Connectors
                        Optimization




 Security                                                                “TerraEchos developers can deliver applications
                                                                             45% faster due to the agility of Streams
                                                                                   Processing Language…”
                                                                                – Alex Philip, CEO and President, TerraEchos


 41                                                                                                               © 2012 IBM Corporation
IBM is Committed to Innovation                                                             2012
                                                 IBM Resarch   Selected SW Acquisitions
                                                 Almaden
                                                 Austin
                                                 Melbourne
                                                 Sao Paulo
                                                 Beijing
                                                 Haif a
                                                 Delhi
                                                 Ireland
                                                 Y amato
                                                 Watson
                                                 Zurich

   • •$16B+ in acquisitions since 2005
       $16B+ in acquisitions since 2005
   • •10,000+ technical professionals
       10,000+ technical professionals
   • •~8000 dedicated consultants
       ~8000 dedicated consultants
   • •27,000+ business partner
       27,000+ business partner
      certifications
       certifications
   • •88 Analytics SolutionsCenters
        Analytics Solutions Centers

   • •100 analytics-based research assets;
       100 analytics-based research assets;
      almost 300 researchers
       almost 300 researchers

                                                                      “Watson is going to revolutionize many,
                                                                      many industries and it will fundamentally
                                                                      change the way we interact with computers
                                                                      & machines.”
                                                                      John Kelly, SVP & Head of IBM Research
2005   * TeaLeaf, Varicent Vivismo pending acquisition close

  42                                                                                              © 2012 IBM Corporation
Making Learning Easy and Fun
Ask for a Big Data Discovery Workshop




bigdatauniversity.com/




                                                      ibm.com/software/data/bigdata/

                                                      youtube.com/user/ibmbigdata
      ibm.com/software/data/infosphere/biginsights/
 43                                                                           © 2012 IBM Corporation
Questions & Answers




         Dipl.Ing.                 IBM Austria
         Wolfgang Nimführ          Obere Donaustrass e 95
                                   A1020 Vienna
         Information Agenda
         Executive Consultant
                                   Tel +43-664-618-5389
         Big Data Tiger Team
                                   wolfgang.nimfuehr@at.ibm.com
         IBM Software Group Europe




44                                                                © 2012 IBM Corporation

Weitere ähnliche Inhalte

Was ist angesagt?

The Zen and Art of IT Management (VM World Keynote 2012)
The Zen and Art of IT Management (VM World Keynote 2012)The Zen and Art of IT Management (VM World Keynote 2012)
The Zen and Art of IT Management (VM World Keynote 2012)CA Technologies
 
White Paper - Really Agile Business Intelligence
White Paper - Really Agile Business IntelligenceWhite Paper - Really Agile Business Intelligence
White Paper - Really Agile Business IntelligenceNewton Day Uploads
 
Cisco Connect 2018 Malaysia - It transformation-an imperative for driving bus...
Cisco Connect 2018 Malaysia - It transformation-an imperative for driving bus...Cisco Connect 2018 Malaysia - It transformation-an imperative for driving bus...
Cisco Connect 2018 Malaysia - It transformation-an imperative for driving bus...NetworkCollaborators
 
IGNITION: Winning data strategies for publishers by Todd Teresi/Quantcast
IGNITION: Winning data strategies for publishers by Todd Teresi/Quantcast IGNITION: Winning data strategies for publishers by Todd Teresi/Quantcast
IGNITION: Winning data strategies for publishers by Todd Teresi/Quantcast Babbel
 
IBM Information Management - Efter stormen: Uppnå konkurrenskraft och sänkta ...
IBM Information Management - Efter stormen: Uppnå konkurrenskraft och sänkta ...IBM Information Management - Efter stormen: Uppnå konkurrenskraft och sänkta ...
IBM Information Management - Efter stormen: Uppnå konkurrenskraft och sänkta ...IBM Sverige
 
BI at your fingertips - views also from Hariram Kalidas (GBM)
BI at your fingertips - views also from Hariram Kalidas (GBM)BI at your fingertips - views also from Hariram Kalidas (GBM)
BI at your fingertips - views also from Hariram Kalidas (GBM)Shwetank Jayaswal
 
Evaluating the opportunity for embedded ai in data productivity tools
Evaluating the opportunity for embedded ai in data productivity toolsEvaluating the opportunity for embedded ai in data productivity tools
Evaluating the opportunity for embedded ai in data productivity toolsNeil Raden
 
Customer summit - big data (final)
Customer summit  - big data (final)Customer summit  - big data (final)
Customer summit - big data (final)Anand Deshpande
 
Decoding Organizational DNA: Trust, Data and Unlocking Value in the Digital W...
Decoding Organizational DNA: Trust, Data and Unlocking Value in the Digital W...Decoding Organizational DNA: Trust, Data and Unlocking Value in the Digital W...
Decoding Organizational DNA: Trust, Data and Unlocking Value in the Digital W...Accenture Insurance
 
Delivering ITaaS With a Software-Defined Data Center
Delivering ITaaS With a Software-Defined Data CenterDelivering ITaaS With a Software-Defined Data Center
Delivering ITaaS With a Software-Defined Data CenterEMC
 
B13 Driving Business Intelligence
B13 Driving Business IntelligenceB13 Driving Business Intelligence
B13 Driving Business IntelligenceJohnRobson
 
Cep 23 Decisive Intelligence Briefing V1 2
Cep 23 Decisive Intelligence Briefing V1 2Cep 23 Decisive Intelligence Briefing V1 2
Cep 23 Decisive Intelligence Briefing V1 2Freddie McMahon
 
IP&A109 Next-Generation Analytics Architecture for the Year 2020
IP&A109 Next-Generation Analytics Architecture for the Year 2020IP&A109 Next-Generation Analytics Architecture for the Year 2020
IP&A109 Next-Generation Analytics Architecture for the Year 2020Anjan Roy, PMP
 
The End of the Wild-West of Data – Relevance and Regulation: the Cornerstones...
The End of the Wild-West of Data – Relevance and Regulation: the Cornerstones...The End of the Wild-West of Data – Relevance and Regulation: the Cornerstones...
The End of the Wild-West of Data – Relevance and Regulation: the Cornerstones...auexpo Conference
 
Powering Next Generation Data Architecture With Apache Hadoop
Powering Next Generation Data Architecture With Apache HadoopPowering Next Generation Data Architecture With Apache Hadoop
Powering Next Generation Data Architecture With Apache HadoopHortonworks
 
Slides: Using Analytics and Fraud Management To Increase Revenues and Differe...
Slides: Using Analytics and Fraud Management To Increase Revenues and Differe...Slides: Using Analytics and Fraud Management To Increase Revenues and Differe...
Slides: Using Analytics and Fraud Management To Increase Revenues and Differe...DATAVERSITY
 

Was ist angesagt? (20)

KPIs for Big Data
KPIs for Big DataKPIs for Big Data
KPIs for Big Data
 
The Zen and Art of IT Management (VM World Keynote 2012)
The Zen and Art of IT Management (VM World Keynote 2012)The Zen and Art of IT Management (VM World Keynote 2012)
The Zen and Art of IT Management (VM World Keynote 2012)
 
White Paper - Really Agile Business Intelligence
White Paper - Really Agile Business IntelligenceWhite Paper - Really Agile Business Intelligence
White Paper - Really Agile Business Intelligence
 
Cisco Connect 2018 Malaysia - It transformation-an imperative for driving bus...
Cisco Connect 2018 Malaysia - It transformation-an imperative for driving bus...Cisco Connect 2018 Malaysia - It transformation-an imperative for driving bus...
Cisco Connect 2018 Malaysia - It transformation-an imperative for driving bus...
 
IGNITION: Winning data strategies for publishers by Todd Teresi/Quantcast
IGNITION: Winning data strategies for publishers by Todd Teresi/Quantcast IGNITION: Winning data strategies for publishers by Todd Teresi/Quantcast
IGNITION: Winning data strategies for publishers by Todd Teresi/Quantcast
 
IBM Information Management - Efter stormen: Uppnå konkurrenskraft och sänkta ...
IBM Information Management - Efter stormen: Uppnå konkurrenskraft och sänkta ...IBM Information Management - Efter stormen: Uppnå konkurrenskraft och sänkta ...
IBM Information Management - Efter stormen: Uppnå konkurrenskraft och sänkta ...
 
BI at your fingertips - views also from Hariram Kalidas (GBM)
BI at your fingertips - views also from Hariram Kalidas (GBM)BI at your fingertips - views also from Hariram Kalidas (GBM)
BI at your fingertips - views also from Hariram Kalidas (GBM)
 
Evaluating the opportunity for embedded ai in data productivity tools
Evaluating the opportunity for embedded ai in data productivity toolsEvaluating the opportunity for embedded ai in data productivity tools
Evaluating the opportunity for embedded ai in data productivity tools
 
Customer summit - big data (final)
Customer summit  - big data (final)Customer summit  - big data (final)
Customer summit - big data (final)
 
Decoding Organizational DNA: Trust, Data and Unlocking Value in the Digital W...
Decoding Organizational DNA: Trust, Data and Unlocking Value in the Digital W...Decoding Organizational DNA: Trust, Data and Unlocking Value in the Digital W...
Decoding Organizational DNA: Trust, Data and Unlocking Value in the Digital W...
 
Juha Teljo
Juha TeljoJuha Teljo
Juha Teljo
 
Well-Tailored IT
Well-Tailored ITWell-Tailored IT
Well-Tailored IT
 
Delivering ITaaS With a Software-Defined Data Center
Delivering ITaaS With a Software-Defined Data CenterDelivering ITaaS With a Software-Defined Data Center
Delivering ITaaS With a Software-Defined Data Center
 
B13 Driving Business Intelligence
B13 Driving Business IntelligenceB13 Driving Business Intelligence
B13 Driving Business Intelligence
 
Cep 23 Decisive Intelligence Briefing V1 2
Cep 23 Decisive Intelligence Briefing V1 2Cep 23 Decisive Intelligence Briefing V1 2
Cep 23 Decisive Intelligence Briefing V1 2
 
IP&A109 Next-Generation Analytics Architecture for the Year 2020
IP&A109 Next-Generation Analytics Architecture for the Year 2020IP&A109 Next-Generation Analytics Architecture for the Year 2020
IP&A109 Next-Generation Analytics Architecture for the Year 2020
 
The End of the Wild-West of Data – Relevance and Regulation: the Cornerstones...
The End of the Wild-West of Data – Relevance and Regulation: the Cornerstones...The End of the Wild-West of Data – Relevance and Regulation: the Cornerstones...
The End of the Wild-West of Data – Relevance and Regulation: the Cornerstones...
 
Powering Next Generation Data Architecture With Apache Hadoop
Powering Next Generation Data Architecture With Apache HadoopPowering Next Generation Data Architecture With Apache Hadoop
Powering Next Generation Data Architecture With Apache Hadoop
 
Big Data KPIs
Big Data KPIsBig Data KPIs
Big Data KPIs
 
Slides: Using Analytics and Fraud Management To Increase Revenues and Differe...
Slides: Using Analytics and Fraud Management To Increase Revenues and Differe...Slides: Using Analytics and Fraud Management To Increase Revenues and Differe...
Slides: Using Analytics and Fraud Management To Increase Revenues and Differe...
 

Andere mochten auch

Praktiline pilvekonverents - IT haldust hõlbustavad uuendused
Praktiline pilvekonverents - IT haldust hõlbustavad uuendusedPraktiline pilvekonverents - IT haldust hõlbustavad uuendused
Praktiline pilvekonverents - IT haldust hõlbustavad uuendusedPrimend
 
Container microservices
Container microservicesContainer microservices
Container microservicesTsuyoshi Ushio
 
Nano Server First Step
Nano Server First StepNano Server First Step
Nano Server First StepKazuki Takai
 
Fracture du pied chez l'enfant
Fracture du pied chez l'enfantFracture du pied chez l'enfant
Fracture du pied chez l'enfantAyoub EL KADDOURI
 
Graylog for open stack 3 steps to know why
Graylog for open stack    3 steps to know whyGraylog for open stack    3 steps to know why
Graylog for open stack 3 steps to know whyMạnh Đinh
 
Disruptive Data Science - How Data Science and Big Data are Transforming Busi...
Disruptive Data Science - How Data Science and Big Data are Transforming Busi...Disruptive Data Science - How Data Science and Big Data are Transforming Busi...
Disruptive Data Science - How Data Science and Big Data are Transforming Busi...EMC
 
Keynote #Enterprise - L'ouverture du Cloud Microsoft, transformation open sou...
Keynote #Enterprise - L'ouverture du Cloud Microsoft, transformation open sou...Keynote #Enterprise - L'ouverture du Cloud Microsoft, transformation open sou...
Keynote #Enterprise - L'ouverture du Cloud Microsoft, transformation open sou...Paris Open Source Summit
 
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & TalendIntroducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & TalendCaserta
 
Build_Buy_StreamAnalytix_WhitePaper
Build_Buy_StreamAnalytix_WhitePaperBuild_Buy_StreamAnalytix_WhitePaper
Build_Buy_StreamAnalytix_WhitePaperJane Roberts
 
Giovanni Lanzani GoDataDriven
Giovanni Lanzani GoDataDrivenGiovanni Lanzani GoDataDriven
Giovanni Lanzani GoDataDrivenBigDataExpo
 
從系統思考看 DevOps:以 microservices 為例 (DevOps: a system dynamics perspective)
從系統思考看 DevOps:以 microservices 為例 (DevOps: a system dynamics perspective)從系統思考看 DevOps:以 microservices 為例 (DevOps: a system dynamics perspective)
從系統思考看 DevOps:以 microservices 為例 (DevOps: a system dynamics perspective)William Yeh
 
WSO2 BAM - Your Big Data Toolbox
WSO2 BAM - Your Big Data ToolboxWSO2 BAM - Your Big Data Toolbox
WSO2 BAM - Your Big Data ToolboxWSO2
 
Cloud Computing System models for Distributed and cloud computing & Performan...
Cloud Computing System models for Distributed and cloud computing & Performan...Cloud Computing System models for Distributed and cloud computing & Performan...
Cloud Computing System models for Distributed and cloud computing & Performan...hrmalik20
 
A1 keynote oracle_infrastructure_as_a_service_move_any_workload_to_the_cloud
A1 keynote oracle_infrastructure_as_a_service_move_any_workload_to_the_cloudA1 keynote oracle_infrastructure_as_a_service_move_any_workload_to_the_cloud
A1 keynote oracle_infrastructure_as_a_service_move_any_workload_to_the_cloudDr. Wilfred Lin (Ph.D.)
 
You're the New CDO, Now What?
You're the New CDO, Now What?You're the New CDO, Now What?
You're the New CDO, Now What?Caserta
 
NUON Rens Weijers
NUON Rens WeijersNUON Rens Weijers
NUON Rens WeijersBigDataExpo
 
Lambda Architecture and open source technology stack for real time big data
Lambda Architecture and open source technology stack for real time big dataLambda Architecture and open source technology stack for real time big data
Lambda Architecture and open source technology stack for real time big dataTrieu Nguyen
 
Primend Pilvekonverents - Azure Infrastruktuur
Primend Pilvekonverents - Azure InfrastruktuurPrimend Pilvekonverents - Azure Infrastruktuur
Primend Pilvekonverents - Azure InfrastruktuurPrimend
 
IBM Software Day 2013. Smarter analytics and big data. building the next gene...
IBM Software Day 2013. Smarter analytics and big data. building the next gene...IBM Software Day 2013. Smarter analytics and big data. building the next gene...
IBM Software Day 2013. Smarter analytics and big data. building the next gene...IBM (Middle East and Africa)
 

Andere mochten auch (20)

Praktiline pilvekonverents - IT haldust hõlbustavad uuendused
Praktiline pilvekonverents - IT haldust hõlbustavad uuendusedPraktiline pilvekonverents - IT haldust hõlbustavad uuendused
Praktiline pilvekonverents - IT haldust hõlbustavad uuendused
 
Container microservices
Container microservicesContainer microservices
Container microservices
 
Nano Server First Step
Nano Server First StepNano Server First Step
Nano Server First Step
 
Fracture du pied chez l'enfant
Fracture du pied chez l'enfantFracture du pied chez l'enfant
Fracture du pied chez l'enfant
 
Graylog for open stack 3 steps to know why
Graylog for open stack    3 steps to know whyGraylog for open stack    3 steps to know why
Graylog for open stack 3 steps to know why
 
Disruptive Data Science - How Data Science and Big Data are Transforming Busi...
Disruptive Data Science - How Data Science and Big Data are Transforming Busi...Disruptive Data Science - How Data Science and Big Data are Transforming Busi...
Disruptive Data Science - How Data Science and Big Data are Transforming Busi...
 
Keynote #Enterprise - L'ouverture du Cloud Microsoft, transformation open sou...
Keynote #Enterprise - L'ouverture du Cloud Microsoft, transformation open sou...Keynote #Enterprise - L'ouverture du Cloud Microsoft, transformation open sou...
Keynote #Enterprise - L'ouverture du Cloud Microsoft, transformation open sou...
 
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & TalendIntroducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
 
Build_Buy_StreamAnalytix_WhitePaper
Build_Buy_StreamAnalytix_WhitePaperBuild_Buy_StreamAnalytix_WhitePaper
Build_Buy_StreamAnalytix_WhitePaper
 
Giovanni Lanzani GoDataDriven
Giovanni Lanzani GoDataDrivenGiovanni Lanzani GoDataDriven
Giovanni Lanzani GoDataDriven
 
從系統思考看 DevOps:以 microservices 為例 (DevOps: a system dynamics perspective)
從系統思考看 DevOps:以 microservices 為例 (DevOps: a system dynamics perspective)從系統思考看 DevOps:以 microservices 為例 (DevOps: a system dynamics perspective)
從系統思考看 DevOps:以 microservices 為例 (DevOps: a system dynamics perspective)
 
WSO2 BAM - Your Big Data Toolbox
WSO2 BAM - Your Big Data ToolboxWSO2 BAM - Your Big Data Toolbox
WSO2 BAM - Your Big Data Toolbox
 
Cloud Computing System models for Distributed and cloud computing & Performan...
Cloud Computing System models for Distributed and cloud computing & Performan...Cloud Computing System models for Distributed and cloud computing & Performan...
Cloud Computing System models for Distributed and cloud computing & Performan...
 
A1 keynote oracle_infrastructure_as_a_service_move_any_workload_to_the_cloud
A1 keynote oracle_infrastructure_as_a_service_move_any_workload_to_the_cloudA1 keynote oracle_infrastructure_as_a_service_move_any_workload_to_the_cloud
A1 keynote oracle_infrastructure_as_a_service_move_any_workload_to_the_cloud
 
You're the New CDO, Now What?
You're the New CDO, Now What?You're the New CDO, Now What?
You're the New CDO, Now What?
 
NUON Rens Weijers
NUON Rens WeijersNUON Rens Weijers
NUON Rens Weijers
 
Lambda Architecture and open source technology stack for real time big data
Lambda Architecture and open source technology stack for real time big dataLambda Architecture and open source technology stack for real time big data
Lambda Architecture and open source technology stack for real time big data
 
Primend Pilvekonverents - Azure Infrastruktuur
Primend Pilvekonverents - Azure InfrastruktuurPrimend Pilvekonverents - Azure Infrastruktuur
Primend Pilvekonverents - Azure Infrastruktuur
 
IBM Software Day 2013. Smarter analytics and big data. building the next gene...
IBM Software Day 2013. Smarter analytics and big data. building the next gene...IBM Software Day 2013. Smarter analytics and big data. building the next gene...
IBM Software Day 2013. Smarter analytics and big data. building the next gene...
 
Rise of Container (RoC)
Rise of Container (RoC)Rise of Container (RoC)
Rise of Container (RoC)
 

Ähnlich wie IBM CEC Big Data 2011 06-11 final

EDF2012 Wolfgang Nimfuehr - Bringing Big Data to the Enterprise
EDF2012   Wolfgang Nimfuehr - Bringing Big Data to the EnterpriseEDF2012   Wolfgang Nimfuehr - Bringing Big Data to the Enterprise
EDF2012 Wolfgang Nimfuehr - Bringing Big Data to the EnterpriseEuropean Data Forum
 
Big data ibm keynote d advani presentation
Big data ibm keynote d advani presentationBig data ibm keynote d advani presentation
Big data ibm keynote d advani presentationMassTLC
 
Day 2 aziz apj aziz_big_datakeynote_press
Day 2 aziz apj aziz_big_datakeynote_pressDay 2 aziz apj aziz_big_datakeynote_press
Day 2 aziz apj aziz_big_datakeynote_pressIntelAPAC
 
Robert LeBlanc - Why Big Data? Why Now?
Robert LeBlanc - Why Big Data? Why Now?Robert LeBlanc - Why Big Data? Why Now?
Robert LeBlanc - Why Big Data? Why Now?Mauricio Godoy
 
Kim Escherich - How Big Data Transforms Our World
Kim Escherich - How Big Data Transforms Our WorldKim Escherich - How Big Data Transforms Our World
Kim Escherich - How Big Data Transforms Our WorldBigDataViz
 
Big Data in Financial Services: How to Improve Performance with Data-Driven D...
Big Data in Financial Services: How to Improve Performance with Data-Driven D...Big Data in Financial Services: How to Improve Performance with Data-Driven D...
Big Data in Financial Services: How to Improve Performance with Data-Driven D...Perficient, Inc.
 
Understanding the Tremendous Value of Mobile Analytics
Understanding the Tremendous Value of Mobile AnalyticsUnderstanding the Tremendous Value of Mobile Analytics
Understanding the Tremendous Value of Mobile AnalyticsDataClarity Corporation
 
Big Data Meets Social Analytics - IBM Connect 2012 (CN-CC13)
Big Data Meets Social Analytics - IBM Connect 2012 (CN-CC13)Big Data Meets Social Analytics - IBM Connect 2012 (CN-CC13)
Big Data Meets Social Analytics - IBM Connect 2012 (CN-CC13)Mark Heid
 
Inspiring Analytics: Tips and Examples for Achieving Better Business, Not Jus...
Inspiring Analytics: Tips and Examples for Achieving Better Business, Not Jus...Inspiring Analytics: Tips and Examples for Achieving Better Business, Not Jus...
Inspiring Analytics: Tips and Examples for Achieving Better Business, Not Jus...SAP Analytics
 
Data set The Future of Big Data
Data set The Future of Big DataData set The Future of Big Data
Data set The Future of Big DataData-Set
 
Age Friendly Economy - The Future of Big Data
Age Friendly Economy  - The Future of Big DataAge Friendly Economy  - The Future of Big Data
Age Friendly Economy - The Future of Big DataAgeFriendlyEconomy
 
AI Weekly - February 22, 2021
AI Weekly - February 22, 2021AI Weekly - February 22, 2021
AI Weekly - February 22, 2021Bruno Aziza
 
Business in the Moment: From Reactive to Proactive
Business in the Moment: From Reactive to ProactiveBusiness in the Moment: From Reactive to Proactive
Business in the Moment: From Reactive to ProactiveSAP Analytics
 
Big Data: A CIO’s Cut Out and Keep Guide
Big Data: A CIO’s Cut Out and Keep Guide Big Data: A CIO’s Cut Out and Keep Guide
Big Data: A CIO’s Cut Out and Keep Guide EMC
 
Big data cloud cloud circle keynote_final laura colvine 8th november 2012
Big data cloud cloud circle keynote_final laura colvine 8th november 2012Big data cloud cloud circle keynote_final laura colvine 8th november 2012
Big data cloud cloud circle keynote_final laura colvine 8th november 2012IBM
 
The Big Deal About Big Data For Customer Engagement
The Big Deal About Big Data For Customer EngagementThe Big Deal About Big Data For Customer Engagement
The Big Deal About Big Data For Customer EngagementIBM India Smarter Computing
 
Top 10 Disruptive Big Data Trends for 2022
Top 10 Disruptive Big Data Trends for 2022Top 10 Disruptive Big Data Trends for 2022
Top 10 Disruptive Big Data Trends for 2022Kavika Roy
 
Analytics: The Real-world Use of Big Data
Analytics: The Real-world Use of Big DataAnalytics: The Real-world Use of Big Data
Analytics: The Real-world Use of Big DataDavid Pittman
 
Deliver Data Governance with a “Yes”
Deliver Data Governance with a “Yes”Deliver Data Governance with a “Yes”
Deliver Data Governance with a “Yes”Jean-Michel Franco
 

Ähnlich wie IBM CEC Big Data 2011 06-11 final (20)

EDF2012 Wolfgang Nimfuehr - Bringing Big Data to the Enterprise
EDF2012   Wolfgang Nimfuehr - Bringing Big Data to the EnterpriseEDF2012   Wolfgang Nimfuehr - Bringing Big Data to the Enterprise
EDF2012 Wolfgang Nimfuehr - Bringing Big Data to the Enterprise
 
Big data ibm keynote d advani presentation
Big data ibm keynote d advani presentationBig data ibm keynote d advani presentation
Big data ibm keynote d advani presentation
 
Day 2 aziz apj aziz_big_datakeynote_press
Day 2 aziz apj aziz_big_datakeynote_pressDay 2 aziz apj aziz_big_datakeynote_press
Day 2 aziz apj aziz_big_datakeynote_press
 
Robert LeBlanc - Why Big Data? Why Now?
Robert LeBlanc - Why Big Data? Why Now?Robert LeBlanc - Why Big Data? Why Now?
Robert LeBlanc - Why Big Data? Why Now?
 
Kim Escherich - How Big Data Transforms Our World
Kim Escherich - How Big Data Transforms Our WorldKim Escherich - How Big Data Transforms Our World
Kim Escherich - How Big Data Transforms Our World
 
Big Data in Financial Services: How to Improve Performance with Data-Driven D...
Big Data in Financial Services: How to Improve Performance with Data-Driven D...Big Data in Financial Services: How to Improve Performance with Data-Driven D...
Big Data in Financial Services: How to Improve Performance with Data-Driven D...
 
Understanding the Tremendous Value of Mobile Analytics
Understanding the Tremendous Value of Mobile AnalyticsUnderstanding the Tremendous Value of Mobile Analytics
Understanding the Tremendous Value of Mobile Analytics
 
Big Data Meets Social Analytics - IBM Connect 2012 (CN-CC13)
Big Data Meets Social Analytics - IBM Connect 2012 (CN-CC13)Big Data Meets Social Analytics - IBM Connect 2012 (CN-CC13)
Big Data Meets Social Analytics - IBM Connect 2012 (CN-CC13)
 
Inspiring Analytics: Tips and Examples for Achieving Better Business, Not Jus...
Inspiring Analytics: Tips and Examples for Achieving Better Business, Not Jus...Inspiring Analytics: Tips and Examples for Achieving Better Business, Not Jus...
Inspiring Analytics: Tips and Examples for Achieving Better Business, Not Jus...
 
Data set The Future of Big Data
Data set The Future of Big DataData set The Future of Big Data
Data set The Future of Big Data
 
Thomas Inman
Thomas InmanThomas Inman
Thomas Inman
 
Age Friendly Economy - The Future of Big Data
Age Friendly Economy  - The Future of Big DataAge Friendly Economy  - The Future of Big Data
Age Friendly Economy - The Future of Big Data
 
AI Weekly - February 22, 2021
AI Weekly - February 22, 2021AI Weekly - February 22, 2021
AI Weekly - February 22, 2021
 
Business in the Moment: From Reactive to Proactive
Business in the Moment: From Reactive to ProactiveBusiness in the Moment: From Reactive to Proactive
Business in the Moment: From Reactive to Proactive
 
Big Data: A CIO’s Cut Out and Keep Guide
Big Data: A CIO’s Cut Out and Keep Guide Big Data: A CIO’s Cut Out and Keep Guide
Big Data: A CIO’s Cut Out and Keep Guide
 
Big data cloud cloud circle keynote_final laura colvine 8th november 2012
Big data cloud cloud circle keynote_final laura colvine 8th november 2012Big data cloud cloud circle keynote_final laura colvine 8th november 2012
Big data cloud cloud circle keynote_final laura colvine 8th november 2012
 
The Big Deal About Big Data For Customer Engagement
The Big Deal About Big Data For Customer EngagementThe Big Deal About Big Data For Customer Engagement
The Big Deal About Big Data For Customer Engagement
 
Top 10 Disruptive Big Data Trends for 2022
Top 10 Disruptive Big Data Trends for 2022Top 10 Disruptive Big Data Trends for 2022
Top 10 Disruptive Big Data Trends for 2022
 
Analytics: The Real-world Use of Big Data
Analytics: The Real-world Use of Big DataAnalytics: The Real-world Use of Big Data
Analytics: The Real-world Use of Big Data
 
Deliver Data Governance with a “Yes”
Deliver Data Governance with a “Yes”Deliver Data Governance with a “Yes”
Deliver Data Governance with a “Yes”
 

Mehr von COMMON Europe

What's New in WebSphere Application Server
What's New in WebSphere Application ServerWhat's New in WebSphere Application Server
What's New in WebSphere Application ServerCOMMON Europe
 
Compiling the Compiler
Compiling the CompilerCompiling the Compiler
Compiling the CompilerCOMMON Europe
 
Workload Groups overview updates
Workload Groups overview updatesWorkload Groups overview updates
Workload Groups overview updatesCOMMON Europe
 
Why i - Common Europe 2012
Why i - Common Europe 2012Why i - Common Europe 2012
Why i - Common Europe 2012COMMON Europe
 
The Ruby OpenSSL extension
The Ruby OpenSSL extensionThe Ruby OpenSSL extension
The Ruby OpenSSL extensionCOMMON Europe
 
Using Ruby on IBM i (i5/OS)
Using Ruby on IBM i (i5/OS)Using Ruby on IBM i (i5/OS)
Using Ruby on IBM i (i5/OS)COMMON Europe
 
IBM Systems Director Navigator for i
IBM Systems Director Navigator for iIBM Systems Director Navigator for i
IBM Systems Director Navigator for iCOMMON Europe
 
IBM i Trends & Directions Common Europe 2012
IBM i Trends & Directions Common Europe 2012IBM i Trends & Directions Common Europe 2012
IBM i Trends & Directions Common Europe 2012COMMON Europe
 
IBM i Technology Refreshes Overview 2012 06-04
IBM i Technology Refreshes Overview 2012 06-04IBM i Technology Refreshes Overview 2012 06-04
IBM i Technology Refreshes Overview 2012 06-04COMMON Europe
 
IBM i 7.1 & TRs CEC 2012
IBM i 7.1 & TRs CEC 2012IBM i 7.1 & TRs CEC 2012
IBM i 7.1 & TRs CEC 2012COMMON Europe
 
DB2 Web Query whats new
DB2 Web Query whats newDB2 Web Query whats new
DB2 Web Query whats newCOMMON Europe
 
Access client solutions overview
Access client solutions overviewAccess client solutions overview
Access client solutions overviewCOMMON Europe
 
What's new with Zend server
What's new with Zend serverWhat's new with Zend server
What's new with Zend serverCOMMON Europe
 
Php arrays for RPG programmers
Php arrays for RPG programmersPhp arrays for RPG programmers
Php arrays for RPG programmersCOMMON Europe
 
Open source report writing tools for IBM i Vienna 2012
Open source report writing tools for IBM i  Vienna 2012Open source report writing tools for IBM i  Vienna 2012
Open source report writing tools for IBM i Vienna 2012COMMON Europe
 
Moving 5.4 to 7.1 AB
Moving 5.4 to 7.1 ABMoving 5.4 to 7.1 AB
Moving 5.4 to 7.1 ABCOMMON Europe
 
Introduction to My SQL
Introduction to My SQLIntroduction to My SQL
Introduction to My SQLCOMMON Europe
 
IBM CEC 2012 Storage june 11, 2012
IBM CEC 2012 Storage june 11, 2012IBM CEC 2012 Storage june 11, 2012
IBM CEC 2012 Storage june 11, 2012COMMON Europe
 
Getting started with PHP on IBM i
Getting started with PHP on IBM iGetting started with PHP on IBM i
Getting started with PHP on IBM iCOMMON Europe
 

Mehr von COMMON Europe (20)

What's New in WebSphere Application Server
What's New in WebSphere Application ServerWhat's New in WebSphere Application Server
What's New in WebSphere Application Server
 
Compiling the Compiler
Compiling the CompilerCompiling the Compiler
Compiling the Compiler
 
Workload Groups overview updates
Workload Groups overview updatesWorkload Groups overview updates
Workload Groups overview updates
 
Why i - Common Europe 2012
Why i - Common Europe 2012Why i - Common Europe 2012
Why i - Common Europe 2012
 
The Ruby OpenSSL extension
The Ruby OpenSSL extensionThe Ruby OpenSSL extension
The Ruby OpenSSL extension
 
Using Ruby on IBM i (i5/OS)
Using Ruby on IBM i (i5/OS)Using Ruby on IBM i (i5/OS)
Using Ruby on IBM i (i5/OS)
 
IBM Systems Director Navigator for i
IBM Systems Director Navigator for iIBM Systems Director Navigator for i
IBM Systems Director Navigator for i
 
IBM i Trends & Directions Common Europe 2012
IBM i Trends & Directions Common Europe 2012IBM i Trends & Directions Common Europe 2012
IBM i Trends & Directions Common Europe 2012
 
IBM i Technology Refreshes Overview 2012 06-04
IBM i Technology Refreshes Overview 2012 06-04IBM i Technology Refreshes Overview 2012 06-04
IBM i Technology Refreshes Overview 2012 06-04
 
IBM i 7.1 & TRs CEC 2012
IBM i 7.1 & TRs CEC 2012IBM i 7.1 & TRs CEC 2012
IBM i 7.1 & TRs CEC 2012
 
DB2 Web Query whats new
DB2 Web Query whats newDB2 Web Query whats new
DB2 Web Query whats new
 
Access client solutions overview
Access client solutions overviewAccess client solutions overview
Access client solutions overview
 
What's new with Zend server
What's new with Zend serverWhat's new with Zend server
What's new with Zend server
 
RPG investment
RPG investmentRPG investment
RPG investment
 
Php arrays for RPG programmers
Php arrays for RPG programmersPhp arrays for RPG programmers
Php arrays for RPG programmers
 
Open source report writing tools for IBM i Vienna 2012
Open source report writing tools for IBM i  Vienna 2012Open source report writing tools for IBM i  Vienna 2012
Open source report writing tools for IBM i Vienna 2012
 
Moving 5.4 to 7.1 AB
Moving 5.4 to 7.1 ABMoving 5.4 to 7.1 AB
Moving 5.4 to 7.1 AB
 
Introduction to My SQL
Introduction to My SQLIntroduction to My SQL
Introduction to My SQL
 
IBM CEC 2012 Storage june 11, 2012
IBM CEC 2012 Storage june 11, 2012IBM CEC 2012 Storage june 11, 2012
IBM CEC 2012 Storage june 11, 2012
 
Getting started with PHP on IBM i
Getting started with PHP on IBM iGetting started with PHP on IBM i
Getting started with PHP on IBM i
 

Kürzlich hochgeladen

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 

Kürzlich hochgeladen (20)

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 

IBM CEC Big Data 2011 06-11 final

  • 1. Smarter Computing - Big Data 11 June 2012 Dipl.Ing.Wolfgang Nimführ Information Agenda Executive Consultant Big Data Tiger Team IBM Software Group Europe wolfgang.nimfuehr@at.ibm.com © 2012 IBM Corporation
  • 2. Legal Disclaimer © IBM Corporation 2012. All Rights Reserved. The information contained in this publication is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained in this publication, it is provided AS IS without warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans and strategy, which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this publication or any other materials. Nothing contained in this publication is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in this presentation may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results. Information regarding potential future products is intended to outline our general product direction and it should not b e relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal ob ligation to deliver any material, code or functionality. Information about potential future products may not b e incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion. 2 © 2012 IBM Corporation
  • 3. Welcome to the Instrumented Interconnected World! INSTRUMENTED INTERCONNECTED INTELLIGENT Build a Smarter Planet 3 © 2012 IBM Corporation
  • 4. Why Big Data Searches for "big data" on Gartner's website “most enterprise data warehouse (EDW) and BI have increased 981% between March 2011 - teams currently lack a clear understanding of big October 2011 data technologies… They are increasingly asking the question, "How can we use big data to deliver new insights?" Gartner 2012 “Big Data: The next frontier for innovation, competition and productivity” McKinsey Global Institute 2012 will be the year of 'big data' BBC Nov 30 2011 Big Data will be the CIO Issue of 2012 IDC Prediction 2012 report Big Data - We are at a huge inflection point and this opportunity comes only once. We are declaring that IBM is the #1 leader in providing a Big Data platform. Alyse Passarelli, WW VP IM Sales Jan 10th 2012 4 © 2012 IBM Corporation
  • 5. The Information Explosion in Data and Real World Events 44x as much Data and Content 2020 35 zettabytes Business leaders frequently Over Coming Decade 1 in3 make decisions based on information they don’t trust, or don’t ha ve 2009 800,000 petabytes 1 in2 Business leaders say they don’t have access to the information they need to do their jobs 80% of CIOs cited “Business Of world’s data is unstructured 83% intelligence and analytics” as part of their visionary plans to enhance competitiveness of CEOs need to do a better job 60% capturing and understanding information rapidly in order to make swift business decisions Organizations Need Deeper Insights 5 5 © 2012 IBM Corporation
  • 6. The resulting explosion of information creates a need for a new kind of intelligence The percentage of available data an enterprise can analyze is decreasing proportionately to the available to it Quite simply, this means as enterprises, we are getting Missing Insights and “more naive” about our business over time Analytics We don’t know what we could already know…. Data AVAILABLE to an organization The Blind Spot Data an organization can PROCESS 6 © 2012 IBM Corporation
  • 7. Challenge Study a Large Volume and Variety of Data to Find New Insights Multi-channel customer sentiment and experience a analysis Support medical diagnostics Detect life-threatening conditions Predict weather patterns to plan optimal wind turbine usage, and optimize capital expenditure on asset placement Make risk decisions and frauds detection based on real-time transactional data Identify criminals and threats from disparate video, audio, and data feeds 7 © 2012 IBM Corporation
  • 8. Leveraging Big Data Analytics How do you address the challenges presented by empowered market participants generating mountains of data? Can you capture data Can you do it in real- Can you turn that data generated by these time? into insights to predict interactions? customer / competitive / Sourc e: market behavior? 1 – Barrera, Clod and Wojtowecz. “Cloud Leads Five Storage Trends for 2011.” CIO. J anuar y 27, 2011 . 2 – http://www.i nternetworlds tats .com/stats.htm. 3 – http://www.abires earch.com/pr ess/3584-More+than+Seven+Trillion+SMS+Messages+Will+Be+Sent+in+2011 8 © 2012 IBM Corporation
  • 9. How does Big Data Analytics impact business? Deploying these competencies extensively correlates to long-term financial performance Listen and Anticipate consistently deployed across the enterprise correlate to higher compound annual growth rates (5-year CAGR, 2005-2010) Source: Outperforming in a Data Rich, H yper Connected W orld, an IB M Center for Applied In sights r esear ch r eport. Copyright © IBM 2012 9 © 2012 IBM Corporation
  • 10. Leveraging Big Data Analytics can improve Experience … Client Mgr Data Scientist Dashboards Call Center … Information Management Capabilities Natural Language External Data Internal Data • Web Logs • Relationship / risk • Event triggers • Twitter feeds data • Customer Profitability • Facebook chats • Product analysis • YouTube Video profitability data • Complaint Data • Blogs/Posting Big Data • Email • Voice to Te xt Data • Appraisal data Analytics correspondents • Transactional data • Company website • Policy & Procedure • Credit bureau data Hub logs data 10 © 2012 IBM Corporation
  • 11. On 16 Feb 2011 the IBM Watson system won Jeopardy! Can we design a computing system that rivals a human’s ability to answer questions posed in natural language, interpreting meaning and context and retrieving, analyzing and understanding vast amounts of information in real-time? 11 © 2012 IBM Corporation
  • 12. IBM Watson‘s project started 2007 • Project started in 2007, lead David Ferrucci • Initial goal: create a system able to process natural language & extract knowledge faster than any other computer or human • Jeopardy! was chosen because it’s a huge “IBM is not in the entertainment challenge for a computer to find the questions business. But we are in the business of to such “human” answers under time pressure technology and pushing frontiers.” David Shepler, IBM Research Program Manager • Watson was NOT online! • Watson weighs the probability of his answer being right – doesn’t ring the buzzer if he’s not confident enough • Which questions Watson got wrong almost as interesting as which he got right! 12 © 2012 IBM Corporation
  • 13. Different Types of Evidence: Keyword Evidence In May 1898 Portugal celebrated In May, Gary arrived in the 400th anniversary of this India after he celebrated his explorer’s arrival in India. anniversary in Portugal. arrived in celebrated Keyword Matching Keyword Matching celebrated In May Keyword Matching Keyword Matching In May 1898 Evidence 400th Keyword Matching anniversary suggests “Gary” anniversary Keyword Matching is the answer BUT the system Portugal Keyword Matching Keyword Matching in Portugal must learn that keyword arrival in matching may be weak relative India Keyword Matching Keyword Matching India to other types of evidence explorer Gary 13 © 2012 IBM Corporation
  • 14. Different Types of Evidence: Deeper Evidence In May 1898 Portugal celebrated On 27th May 1498, Vasco da Gama On 27th May 1498, Vasco da Gama On 27th May 1498, Vasco da Gama the 400th anniversary of this On landedin Kappad Beach Vasco da landed in of May Beach the in th Kappad 1498, landed 27Kappad Beach explorer’s arrival in India. Gama landed in Kappad Beach Search Far and Wide Explore many hypotheses celebrated Find Judge Evidence landed in Portugal Many inference algorithms Temporal May 1898 400th anniversary 27th May 1498 Reasoning Date Math arrival Statistical Stronger in Paraphrasing Para- evidence can phras es GeoSpatial be much India Reasoning Kappad Beach harder to find Geo-KB and score. explorer Vasco da Gama 14 The evidence is still not 100% certain. © 2012 IBM Corporation
  • 15. DeepQA: Massively Parallel Probabilistic Evidence-Based Architecture Question 1000’s of 100,000’s scores from many simultaneous 100s Possible Pieces of Evidence 100s sources Text Analysis Algorithms Answers Multiple Interpretations Question & Final Confidence Question Hypothesis Hypothesis and Topic Synthesis Merging & Decomposition Generation Evidence Scoring Analysis Ranking Hypothesis Hypothesis and Evidence Generation Scoring Answer & Confidence ... 15 © 2012 IBM Corporation
  • 16. Maximum Benefit Requires Combining Deep and Reactive Analytics Hypotheses Predictions Real time Optimization 100,000 updates/sec, 5 ms/decision Exa Round-trip automation Deep Deep 10 PB f or Deep Analytics Analytics Peta History Predictive Analytics 100,000 records/sec, 6B/day 10 ms/decision 6 PB f or Deep Analytics Feedback Data Scale Tera nio In Smart Traffic ra t te 250K GPS probes/sec g Reality Actions g ra Inte 630K segments/sec tio n Giga 2 ms/decision, 4K vehicles DeepQA Fast Traditional Data 100s GB for Deep Analytics Mega Warehouse and 3 sec/decision 1 PB training corpus Business Integration Intelligence Observations Kilo Reactive yr mo wk day hr min sec … ms µs Analytics Occasional Frequent Real-time 16 Decision Frequency © 2012 IBM Corporation
  • 17. Traditional Approach vs Big Data Approach Traditional Approach Big Data Approach Structured & Repeatable Analysis Iterative & Exploratory Analysis IT Business Users Delivers a platform to Determine what enable creative question to ask discovery IT Business Structures the Explores what data to answer questions could be that question asked Monthly sales reports Brand sentiment Profitability analysis Product strategy Customer surveys Ma ximum asset utilization 17 © 2012 IBM Corporation
  • 18. Big Data use cases across all industries Financial Services Utilities Fraud detection Weather impact analysis on Risk management power generation 360° View of the Customer Transmission monitoring Smart grid management Transportation IT Weather and traffic Transition log analysis impact on logistics and for multiple fuel consumption transactional systems Cybersecurity Health & Life Sciences Epidemic early warning Retail system 360° View of the Customer ICU monitoring Click-stream analysis Remote healthcare monitoring Real-time promotions Telecommunications Law Enforcement CDR processing Real-time multimodal surveillance Churn prediction Situational awareness Geomapping / marketing Cyber security detection Network monitoring 18 © 2012 IBM Corporation
  • 19. Monetizing Relationships - not just Transactions Calling Network Merged Network company Telco Amy Bearn 32, Married, mother of 3, How v aluable is Amy to my mobile phone network? How likely is she to Accountant switch carriers? How many other Telco Score: 91 customers will f ollow CPG Score: 76 Fashion Score: 88 Retail Telco How v aluable is Amy to my retail sales? Who does she influence? Social Network Public What do they spend? Database 19 © 2012 IBM Corporation
  • 20. ° Sample: Big Data 360°Lead Generation Personal Attributes Personal Attributes • Identifiers: name, address, age, gender, • Identifiers: name, address, age, gender, occupation… occupation… Timely Insights Timely Insights • Interests: sports, pets, cuisine… • Intent to buy various products • Interests: sports, pets, cuisine… • Intent to buy various products • Life Cycle Status: marital, parental • Current Location • Life Cycle Status: marital, parental • Current Location Social Media based • Sentiment on products, services, campaigns • Sentiment on products, services, campaigns 360-degree • Incidents damaging reputation • Incidents damaging reputation Consumer Profiles • Customer satisfaction/attrition • Customer satisfaction/attrition Life Events Life Events • Life-changing events: relocation, having a • Life-changing events: relocation, having a baby, getting married, getting divorced, buying baby, getting married, getting divorced, buying a house… a house… Products Interests Products Interests • Personal preferences of products • Personal preferences of products • Product Purchase history • Product Purchase history Relationships Relationships • Suggestions on products & services • Suggestions on products & services • Personal relationships: family, friends and • Personal relationships: family, friends and roommates… roommates… • Business relationships: co-workers and • Business relationships: co-workers and work/interest network… work/interest network… Monetizable intent to buy products Life Events I need a new digital camera for my food pictures, any College: Off to Stanford for my MBA! Bbye chicago! I need a new digital camera for my food pictures, any College: Off to Stanford for my MBA! Bbye chicago! recommendations around 300? recommendations around 300? Looks like we'll be moving to New Orleans sooner than I thought. What should I buy?? A mini laptop with Windows 7 OR a Apple Looks like we'll be moving to New Orleans sooner than I thought. What should I buy?? A mini laptop with Windows 7 OR a Apple MacBook!??! MacBook!??! Intent to buy a house Location announcements I'm thinking about buying a home in Buckingham Estates per a I'm thinking about buying a home in Buckingham Estates per a I'm at Starbucks Parque Tezontle http://4sq.com/fYReSj recommendation. Anyone have advice on that area? #atx #austinrealestate 20 at Starbucks Parque Tezontle http://4sq.com/fYReSj I'm recommendation. Anyone have advice on that area? #atx #austinrealestate © 2012 IBM Corporation #austin #austin
  • 21. ° Sample: Big Data 360°Lead Generation Real-time product Real-time product intents enriched with intents enriched with consumer attributes consumer attributes Entries contain promotional messages, Entries contain promotional messages, wishful thinking, questions, etc wishful thinking, questions, etc Integration across Social Media sites Integration across Social Media sites Micro-segmentation of Micro-segmentation of product intents by product intents by Real-time tracking by occupation Real-time tracking by occupation micro-segmentation micro-segmentation For many of the attributes we need to extract, For many of the attributes we need to extract, cleanse, normalize and categorize cleanse, normalize and categorize Micro-segmentation of Micro-segmentation of consumers by hobbies consumers by hobbies 21 © 2012 IBM Corporation
  • 22. Sample: Institutional Risk Application Comprehensive view of publicly traded companies and related people based on regulatory filings Extract Integrate 22 © 2012 IBM Corporation
  • 23. Requirements for a Big Data Solution Platform Analyze a Variety of Information Novel analytics on a broad set of mixed information that could not be analyzed before Multiple relational & non-relational data types and schemas Analyze Information in Motion Streaming data analysis Large volume data bursts & ad-hoc analysis Analyze Extreme Volumes of Information Cost-efficiently process and analyze petabytes of information Manage & analyze high volumes of structured, relational data Discover & Experiment Ad-hoc analytics, data discovery & experimentation Manage & Plan Enforce data structure, integrity and control to ensure consistency for repeatable queries 23 © 2012 IBM Corporation
  • 24. IBM Big Data Platform for Ingest, Data and Analytics Analytic Applications BI / Exploration / Functional Industry Predictive Content Reporting Visualization App App Analytics Analytics New analytic applications drive the requirements for a big data platform IBM Big Data Platform • Integrate and manage the full variety, velocity and volume of data Visualization Application Systems & Discovery Development Management • Apply advanced analytics to information in its native form • Visualize all available data for ad- Accelerators hoc analysis • Development environment for Hadoop Stream Data building new analytic applications System Computing Warehouse • Workload optimization and scheduling • Security and Governance Information Integration & Governance 24 © 2012 IBM Corporation
  • 25. Big Data Hadoop Capabilities Big Data Challenges IBM Big Data Solutions • Very high volumes (TBs to PBs) NoSQL Data unstructured data IBM BigInsights Hadoop-based processing for • Exploration and discovery analytics on variety and • Text, Entity and Social Media volumes of data Analytics • Real time processing IBM Streams Streaming • Detect failure patterns • High volume, low latency Low latency analytics for processing streaming data • Scoring and decision analytics 25 © 2012 IBM Corporation
  • 26. High Level Conceptual View *) Real Time Scoring and Response Streaming Sens ors Streaming Structured or Unstructured • Smart Grid Analytics Analytics and • Distribution Grid Reporting Monitoring Unstructured IBM • Root Cause Failure Streams Analysis • Demand Response Regulations Effectiveness Exploration/Discovery Queryable Archive Improv ed Analytics Web/social Social Structured Unstructured • Sentiment analysis • Call Centre analysis IBM • Log analysis BigInsights Analytics and • Outage Information Reporting • Micro customer Improv ed Analytics segmentation Structured • Offering Management Data Asset Landscape Generation Transmission Distribution Smart Meters Foundational • Meter Data Management • Customer Portals Trading Supplier Orders Customer • Smart Meter Analytics • Demand Forecasting • Generation Scheduling Operational Legacy • Customer Segmentation Systems IBM • Campaign Management Applcations Marketing Maintenance Employee GIS power i • Outage Management • Estimate Load Shedding • Time of Use Tariffs • Maintenance Scheduling 26 *) Example for Industry Energy & Utility © 2012 IBM Corporation
  • 27. IBM InfoSphere BigInsights Analytical platform for Big Data at-rest Based on open source & IBM Analytic Applications technologies BI / Exploration / Functional Industry Predictiv e Content Reporting Visualization App App Analytics Analytics Distinguishing characteristics • Built-in analytics enhances business IBM Big Data Platform knowledge Visualization Application Systems • Enterprise software integration & Discovery Development Management complements and extends existing capabilities Accelerators • Production-ready platform with tooling for analysts, developers, and administrators Hadoop Stream Data speeds time-to-value and simplifies System Computing Warehouse development/maintenance IBM advantage • Combination of software, hardware, services and advanced research Information Integration & Governance 27 © 2012 IBM Corporation
  • 28. IBM InfoSphere BigInsights Embrace and Extend Hadoop Analytics BigSheets Text Analytics ML Analytics *) Interface Management Console Application (browser based) Pig Hive Jaql Avro IBM LZO Compression Zookeeper MapReduce AdaptiveMR FLEX BigIndex Developing Tooling (Eclipse Plug-Ins) Oozie Lucene Rest API Storage HBase (for Applications) HDFS GPFS-SNC *) Data Streams Netezza BoardReader R IBM Sources/ Open Source Data Stage DB2 CSV/XML/JSON SPSS Connectors Flume JDBC Web Crawler *) future release 28 © 2012 IBM Corporation
  • 29. BigSheets A visual tool for data manipulation and prototyping • Ad-hoc analytics for LOB user • Analyze a variety of data - unstructured and structured • Spreadsheet metaphor for exploring/ visualizing data • Browser-based 29 © 2012 IBM Corporation
  • 30. Text Analytics Turns disparate words into measurable insights Physically Identify positive or Reporting/Monitoring assemble data, Part-of-speech negative sentiment, Iterative social commentary, standardize identification, standard NLP-based classification using combination w /structured form ats, address and custom ized analytics, define autom ated and data, clustering, auto-identify extraction dictionaries, variables, m acros m anual techniques. associated concepts, language, process proper noun and rules. Concept derivation & correlated concepts, auto- punctuation and identification, concept inclusion, semantic classification of non-gramm atical categorization, networks and co- documents, sites, posts. characters, synonyms, exclusions, occurrence rules standardize m ulti-terms, regular spelling. expressions, fuzzy- m atching Pre-configured text annotators ready for distributed processing on Big Data Support for native languages including double-byte 30 © 2012 IBM Corporation
  • 31. Text Analytics Highly accurate analysis of textual content Unstructured text (document, email, etc) How it works Football World Cup 2010, one team • Parses text and detects meaning with distinguished themselves well, losing to annotators the eventual champions 1-0 in the Final. Early in the second half, Netherlands’ • Understands the context in which the striker, Arjen Robben, had a breakaway, text is analyzed but the keeper for Spain, Iker Casillas • Hundreds of pre-built annotators for made the save. Winger Andres Iniesta names, addresses, phone numbers, scored for Spain for the win. along others Accuracy • Highly accurate in deriving meaning from complex text Classification and Insight Performance • AQL language optimized for MapReduce 31 © 2012 IBM Corporation
  • 32. ML Analytics Statistical and Predictive Analysis Framework for machine learning (ML) implementations on Big Data • Large, sparse data sets, e.g. 5B non-zero values • Runs on large BigInsights clusters with 1000s of nodes Productivity • Build and enhance predictive models directly on Big Data • High-level language – Declarative Machine Learning Language (DML) • E.g. 1500 lines of Java code boils down to 15 lines of DML code • Parallel SPSS data mining algorithms implementable in DML Optimization • Compile algorithms into optimized parallel code 4500 • For different clusters and different data characteristics 4000 3500 • E.g. 1 hr. execution (hand-coded) down to 10 mins E xecution Time (sec) 3000 2500 2000 1500 1000 500 0 0 500 1000 1500 2000 # non zeros (million) Java Map-Reduce Sy stemML Single node R 32 © 2012 IBM Corporation
  • 33. Workload Optimization Optimized performance for big data analytic workloads Adaptive MapReduce Hadoop System Scheduler Algorithm to optimize execution time of Identifies small and large jobs from prior multiple small jobs experience Performance gains of 30% reduce Sequences work to reduce overhead overhead of task startup Task Map Adaptive Map Reduce (break task into small parts) (optimization — (many results to a order small units of work) single result set) 33 © 2012 IBM Corporation
  • 34. Public wind data is available on 284km x 284 km grids (2.5o LAT/LONG) More data means more accurate and richer models (adding hundreds of variables) - Vestas wind library at 2.5 PB: to grow to over 6 PB in the near-term - Granularity 27km x 27km grids: driving to 9x9, 3x3 to 10m x 10m simulations Reduced turbine placement identification from weeks to hours Perspective: The Vestas Wind library 34 34 © 2012 IBM Corporation 34
  • 35. InfoSphere Streams Analytical platform for Big Data in-motion Analytic Applications BI / Exploration / Functional Industry Predictiv e Content Reporting Visualization App App Analytics Analytics Built to analyze data in motion • Multiple concurrent input streams IBM Big Data Platform • Massive scalability Visualization Application Systems & Discovery Development Management Process and analyze a variety of Accelerators data • Structured, unstructured content, video, Hadoop Stream Data audio System Computing Warehouse • Advanced analytic operators Information Integration & Governance 35 © 2012 IBM Corporation
  • 36. Stream Computing Analyze Data in Motion Traditional Computing Stream Computing Historical fact finding Current fact finding Find and analyze information stored on disk Analyze data in motion – before it is stored Batch paradigm, pull model Low latency paradigm, push model Query-driven: submits queries to static data Data driven – bring the data to the query Data Base 36 © 2012 IBM Corporation
  • 37. Streams approach illustrated tuple 37 © 2012 IBM Corporation
  • 38. IBM InfoSphere Streams Massively Scalable Stream Analytics Linear Scalability Deployments Clustered deployments – unlimited Source Analytic Sync scalability Adapters Operators Adapters Automated Deployment Automatically optimize operator deployment across clusters Streams Studio IDE Performance Optimization Automated and Optimized JVM Sharing – minimize memory use Deployment Fuse operators on Streaming Data Streams Runtime Sources same cluster Telco client – 25 Million Visualization messages per second Analytics on Streaming Data Analytic accelerators for a variety of data types Optimized for real-time performance 38 © 2012 IBM Corporation
  • 39. Cisco turns to IBM big data for intelligent infrastructure management • Optimize building energy consumption with centralized monitoring • Automate preventive and corrective maintenance Capabilities Utilized: • Streaming Analytics • Hadoop System • Business Intelligence Applications: • Log Analytics • Energy Bill Forecasting • Energy consumption optimization • Detection of anomalous usage • Presence-aware energy mgt. • Policy enforcement 39 © 2012 IBM Corporation
  • 40. University of Ontario Institute of Technology Use case – Neonatal infant monitoring – Predict infection in ICU 24 hours in advance Solutions – 120 children monitored :120K msg/sec, billion msg/day – Trials expanding to include hospitals in US and China Event Pre- Analysis processer Framework Sensor Stream-based Distributed Interoperable Solutions Network Health care Infrastructure (Applications) 40 © 2012 IBM Corporation
  • 41. Without a Big Data Platform You Code… Over 100 sample applications and toolkits with industry focused toolkits with 300+ functions and operators Event Custom SQL Handling and Scripts Multithreading Check Application Pointing M anagement Accelerators Streams provides development, deployment, HA and Tool kits runtime, and infrastructure services Performance Debug Connectors Optimization Security “TerraEchos developers can deliver applications 45% faster due to the agility of Streams Processing Language…” – Alex Philip, CEO and President, TerraEchos 41 © 2012 IBM Corporation
  • 42. IBM is Committed to Innovation 2012 IBM Resarch Selected SW Acquisitions Almaden Austin Melbourne Sao Paulo Beijing Haif a Delhi Ireland Y amato Watson Zurich • •$16B+ in acquisitions since 2005 $16B+ in acquisitions since 2005 • •10,000+ technical professionals 10,000+ technical professionals • •~8000 dedicated consultants ~8000 dedicated consultants • •27,000+ business partner 27,000+ business partner certifications certifications • •88 Analytics SolutionsCenters Analytics Solutions Centers • •100 analytics-based research assets; 100 analytics-based research assets; almost 300 researchers almost 300 researchers “Watson is going to revolutionize many, many industries and it will fundamentally change the way we interact with computers & machines.” John Kelly, SVP & Head of IBM Research 2005 * TeaLeaf, Varicent Vivismo pending acquisition close 42 © 2012 IBM Corporation
  • 43. Making Learning Easy and Fun Ask for a Big Data Discovery Workshop bigdatauniversity.com/ ibm.com/software/data/bigdata/ youtube.com/user/ibmbigdata ibm.com/software/data/infosphere/biginsights/ 43 © 2012 IBM Corporation
  • 44. Questions & Answers Dipl.Ing. IBM Austria Wolfgang Nimführ Obere Donaustrass e 95 A1020 Vienna Information Agenda Executive Consultant Tel +43-664-618-5389 Big Data Tiger Team wolfgang.nimfuehr@at.ibm.com IBM Software Group Europe 44 © 2012 IBM Corporation